Packages

t

com.sparkutils.quality.impl

CollectRunnerBase

trait CollectRunnerBase[T] extends Expression with NonSQLExpression with SplitCompilation with HasOutput

Children will be rewritten by the plan, it's then re-incorporated into ruleSuite expressionOffsets.length is the length of the trigger expressions in realChildren, realChildren(expressionOffsets.length + expressionOffsets(x)) will be the correct OutputExpression

Linear Supertypes
HasOutput, SplitCompilation, Runner, NonSQLExpression, Expression, TreeNode[Expression], WithOrigin, TreePatternBits, Product, Equals, AnyRef, Any
Known Subclasses
CollectRunnerRunner
Type Hierarchy
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. CollectRunnerBase
  2. HasOutput
  3. SplitCompilation
  4. Runner
  5. NonSQLExpression
  6. Expression
  7. TreeNode
  8. WithOrigin
  9. TreePatternBits
  10. Product
  11. Equals
  12. AnyRef
  13. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Abstract Value Members

  1. abstract val alreadyZero: Boolean
    Definition Classes
    Runner
  2. abstract val audited: Boolean
    Definition Classes
    HasOutput
  3. abstract def canEqual(that: Any): Boolean
    Definition Classes
    Equals
  4. abstract val canUnroll: Array[Int]
  5. abstract def children: Seq[Expression]
    Definition Classes
    TreeNode
  6. implicit abstract val classTagT: ClassTag[T]
  7. abstract def doGenCode(ctx: CodegenContext, ev: ExprCode): ExprCode
    Attributes
    protected
    Definition Classes
    Expression
  8. abstract val expressionOffsets: Array[Int]
  9. abstract val extraConfig: Map[String, String]
    Definition Classes
    CollectRunnerBase → Runner
  10. abstract val flatten: Boolean
  11. abstract val includeNulls: Boolean
  12. abstract val isInPlace: Array[Boolean]
  13. abstract def productArity: Int
    Definition Classes
    Product
  14. abstract def productElement(n: Int): Any
    Definition Classes
    Product
  15. abstract val resultDataType: Option[DataType]
  16. abstract val ruleSuite: RuleSuite
    Definition Classes
    CollectRunnerBase → Runner
  17. abstract val tClass: Class[T]
  18. abstract val triggerCount: Int
    Definition Classes
    CollectRunnerBase → HasOutput
  19. abstract val unroll: Boolean
  20. abstract val unrollOutputArraySize: Int
  21. abstract val variableFuncGroup: Int
    Definition Classes
    CollectRunnerBase → Runner
  22. abstract val variablesPerFunc: Int
    Definition Classes
    CollectRunnerBase → Runner
  23. abstract def withNewChildrenInternal(newChildren: IndexedSeq[Expression]): Expression
    Attributes
    protected
    Definition Classes
    TreeNode
  24. abstract def withZeroCode(): Runner

    After calling now wrapping of zero code will be performed when the com.sparkutils.quality.impl.extension.ZeroCodeGenWrap optimisation is enabled

    After calling now wrapping of zero code will be performed when the com.sparkutils.quality.impl.extension.ZeroCodeGenWrap optimisation is enabled

    Definition Classes
    Runner

Concrete Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##: Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. lazy val actualType: DataType
  5. def apply(number: Int): TreeNode[_]
    Definition Classes
    TreeNode
  6. def applyResult(level1: Int, level2: Int, result: InternalRow, ruleResult: Int): Unit

    rolls the overalls up in place - must be genericarraydata / arraybasedmap data with a copy from createDefaultRuleResult used by codegen

    rolls the overalls up in place - must be genericarraydata / arraybasedmap data with a copy from createDefaultRuleResult used by codegen

    Definition Classes
    Runner
  7. def argString(maxFields: Int): String
    Definition Classes
    TreeNode
  8. def asCode: String
    Definition Classes
    TreeNode
  9. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  10. def canAudit: Boolean
    Definition Classes
    HasOutput
  11. lazy val canFlatten: Boolean
  12. lazy val canonicalized: Expression
    Definition Classes
    Expression
  13. def checkInputDataTypes(): TypeCheckResult
    Definition Classes
    Expression
  14. def childrenResolved: Boolean
    Definition Classes
    Expression
  15. def clone(): Expression
    Definition Classes
    TreeNode → AnyRef
  16. def collect[B](pf: PartialFunction[Expression, B]): Seq[B]
    Definition Classes
    TreeNode
  17. def collectFirst[B](pf: PartialFunction[Expression, B]): Option[B]
    Definition Classes
    TreeNode
  18. def collectLeaves(): Seq[Expression]
    Definition Classes
    TreeNode
  19. lazy val compiledRealChildren: Array[ExpressionWrapper]
  20. final def containsAllPatterns(patterns: TreePattern*): Boolean
    Definition Classes
    TreePatternBits
  21. final def containsAnyPattern(patterns: TreePattern*): Boolean
    Definition Classes
    TreePatternBits
  22. def containsChild: Set[TreeNode[_]]
    Definition Classes
    TreeNode
  23. final def containsPattern(t: TreePattern): Boolean
    Definition Classes
    TreePatternBits
    Annotations
    @inline()
  24. def contextIndependentFoldable: Boolean
    Definition Classes
    Expression
  25. def copyTagsFrom(other: Expression): Unit
    Definition Classes
    TreeNode
  26. def createDefaultRuleResult(): InternalRow

    Used by codegen

    Used by codegen

    Definition Classes
    Runner
  27. def dataType: DataType
    Definition Classes
    CollectRunnerBase → Expression
  28. val defaultOverallProcessor: (Int, Int) => Int
    Definition Classes
    HasOutput → Runner
  29. val defaultOverallResult: Int
    Definition Classes
    HasOutput → Runner
  30. val defaultRuleResult: Int
    Definition Classes
    HasOutput → Runner
  31. lazy val deterministic: Boolean
    Definition Classes
    Expression
  32. def doGenCodeI(outerCtx: CodegenContext, ev: ExprCode): ExprCode
    Attributes
    protected
  33. lazy val elementType: DataType
  34. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  35. def equals(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef → Any
  36. def eval(input: InternalRow): Any
    Definition Classes
    CollectRunnerBase → Expression
  37. def exists(f: (Expression) => Boolean): Boolean
    Definition Classes
    TreeNode
  38. def fastEquals(other: TreeNode[_]): Boolean
    Definition Classes
    TreeNode
  39. def find(f: (Expression) => Boolean): Option[Expression]
    Definition Classes
    TreeNode
  40. def flatArguments: Iterator[Any]
    Attributes
    protected
    Definition Classes
    Expression
  41. def flatMap[A](f: (Expression) => IterableOnce[A]): Seq[A]
    Definition Classes
    TreeNode
  42. def foldable: Boolean
    Definition Classes
    Expression
  43. def foreach(f: (Expression) => Unit): Unit
    Definition Classes
    TreeNode
  44. def foreachUp(f: (Expression) => Unit): Unit
    Definition Classes
    TreeNode
  45. def freshCopyIfContainsStatefulExpression(): Expression
    Definition Classes
    Expression
  46. def genCode(ctx: CodegenContext): ExprCode
    Definition Classes
    Expression
  47. def generateTreeString(depth: Int, lastChildren: ArrayList[Boolean], append: (String) => Unit, verbose: Boolean, prefix: String, addSuffix: Boolean, maxFields: Int, printNodeId: Boolean, printOutputColumns: Boolean, indent: Int): Unit
    Definition Classes
    TreeNode
  48. val generatorClassSource: Seq[CodeAndComment]
    Definition Classes
    SplitCompilation
  49. def generatorClazz(i: Int): GeneratedClass
    Definition Classes
    SplitCompilation
  50. val generatorClazz_: Seq[GeneratedClass]
    Definition Classes
    SplitCompilation
    Annotations
    @transient()
  51. final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  52. def getDefaultTreePatternBits: BitSet
    Attributes
    protected
    Definition Classes
    TreeNode
  53. def getTagValue[T](tag: TreeNodeTag[T]): Option[T]
    Definition Classes
    TreeNode
  54. def groupedSqlCall(ruleSuiteCall: String): String

    For collector and engine it's typically just their sql function name, for folder it must also include the starting expression.sql.

    For collector and engine it's typically just their sql function name, for folder it must also include the starting expression.sql. This will be called with resolved expressions but not with structs so the folder starter expression is expected to be executable

    ruleSuiteCall

    provided by the grouping code but resolves to a rulesuite

    Definition Classes
    CollectRunnerBase → HasOutput
  55. def hashCode(): Int
    Definition Classes
    TreeNode → AnyRef → Any
  56. def height: Int
    Definition Classes
    TreeNode
  57. def inPlaceArrayOffsets(ctx: CodegenContext, resultRow: String, ruleRunnerExpressionIdx: Int): InPlaceOffsets
    Definition Classes
    Runner
  58. def innerChildren: Seq[TreeNode[_]]
    Definition Classes
    TreeNode
  59. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  60. def isRuleIneffective(ruleId: RuleId): Boolean
    Attributes
    protected
    Definition Classes
    TreeNode
  61. def isTagsEmpty: Boolean
    Definition Classes
    TreeNode
  62. def jsonFields: List[JField]
    Attributes
    protected
    Definition Classes
    TreeNode
  63. final def legacyWithNewChildren(newChildren: Seq[Expression]): Expression
    Attributes
    protected
    Definition Classes
    TreeNode
  64. def makeCopy(newArgs: Array[AnyRef]): Expression
    Definition Classes
    TreeNode
  65. def map[A](f: (Expression) => A): Seq[A]
    Definition Classes
    TreeNode
  66. def mapChildren(f: (Expression) => Expression): Expression
    Definition Classes
    TreeNode
  67. def mapProductIterator[B](f: (Any) => B)(implicit arg0: ClassTag[B]): Array[B]
    Attributes
    protected
    Definition Classes
    TreeNode
  68. def markRuleAsIneffective(ruleId: RuleId): Unit
    Attributes
    protected
    Definition Classes
    TreeNode
  69. def mergeTagsFrom(other: Expression): Unit
    Definition Classes
    TreeNode
  70. def multiTransformDown(rule: PartialFunction[Expression, Seq[Expression]]): LazyList[Expression]
    Definition Classes
    TreeNode
  71. def multiTransformDownWithPruning(cond: (TreePatternBits) => Boolean, ruleId: RuleId)(rule: PartialFunction[Expression, Seq[Expression]]): LazyList[Expression]
    Definition Classes
    TreeNode
  72. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  73. def nodeName: String
    Definition Classes
    TreeNode
  74. val nodePatterns: Seq[TreePattern]
    Attributes
    protected
    Definition Classes
    TreeNode
  75. def nodeWithOutputColumnsString(maxColumns: Int): String
    Definition Classes
    TreeNode
  76. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  77. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  78. def nullIntolerant: Boolean
    Definition Classes
    Expression
  79. def nullable: Boolean
    Definition Classes
    CollectRunnerBase → Expression
  80. def numberedTreeString: String
    Definition Classes
    TreeNode
  81. val origin: Origin
    Definition Classes
    TreeNode → WithOrigin
  82. def otherCopyArgs: Seq[AnyRef]
    Attributes
    protected
    Definition Classes
    TreeNode
  83. def p(number: Int): Expression
    Definition Classes
    TreeNode
  84. def performGroupingAuditDump(): Unit
    Definition Classes
    HasOutput
  85. def prettyJson: String
    Definition Classes
    TreeNode
  86. def prettyName: String
    Definition Classes
    Expression
  87. def productElementName(n: Int): String
    Definition Classes
    Product
  88. def productElementNames: Iterator[String]
    Definition Classes
    Product
  89. def productIterator: Iterator[Any]
    Definition Classes
    Product
  90. def productPrefix: String
    Definition Classes
    Product
  91. def realChildren: Seq[Expression]
    Definition Classes
    CollectRunnerBase → HasOutput
  92. def references: AttributeSet
    Definition Classes
    Expression
  93. lazy val reincorporated: RuleSuite
  94. lazy val resolved: Boolean
    Definition Classes
    Expression
  95. final def semanticEquals(other: Expression): Boolean
    Definition Classes
    Expression
  96. def semanticHash(): Int
    Definition Classes
    Expression
  97. def setTagValue[T](tag: TreeNodeTag[T], value: T): Unit
    Definition Classes
    TreeNode
  98. def simpleString(maxFields: Int): String
    Definition Classes
    Expression → TreeNode
  99. def simpleStringWithNodeId(): String
    Definition Classes
    Expression → TreeNode
  100. final def sql: String
    Definition Classes
    NonSQLExpression → Expression
  101. lazy val starterSize: Int
  102. def stateful: Boolean
    Definition Classes
    Expression
  103. def stringArgs: Iterator[Any]
    Attributes
    protected
    Definition Classes
    TreeNode
  104. final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  105. lazy val throwable: Boolean
    Definition Classes
    Expression
  106. def toJSON: String
    Definition Classes
    TreeNode
  107. def toString(): String
    Definition Classes
    CollectRunnerBase → Expression → TreeNode → AnyRef → Any
  108. def transform(rule: PartialFunction[Expression, Expression]): Expression
    Definition Classes
    TreeNode
  109. def transformDown(rule: PartialFunction[Expression, Expression]): Expression
    Definition Classes
    TreeNode
  110. def transformDownWithPruning(cond: (TreePatternBits) => Boolean, ruleId: RuleId)(rule: PartialFunction[Expression, Expression]): Expression
    Definition Classes
    TreeNode
  111. def transformUp(rule: PartialFunction[Expression, Expression]): Expression
    Definition Classes
    TreeNode
  112. def transformUpWithBeforeAndAfterRuleOnChildren(cond: (Expression) => Boolean, ruleId: RuleId)(rule: PartialFunction[(Expression, Expression), Expression]): Expression
    Definition Classes
    TreeNode
  113. def transformUpWithPruning(cond: (TreePatternBits) => Boolean, ruleId: RuleId)(rule: PartialFunction[Expression, Expression]): Expression
    Definition Classes
    TreeNode
  114. def transformWithPruning(cond: (TreePatternBits) => Boolean, ruleId: RuleId)(rule: PartialFunction[Expression, Expression]): Expression
    Definition Classes
    TreeNode
  115. def treePatternBits: BitSet
    Definition Classes
    TreeNode → TreePatternBits
  116. def treeString(append: (String) => Unit, verbose: Boolean, addSuffix: Boolean, maxFields: Int, printOperatorId: Boolean, printOutputColumns: Boolean): Unit
    Definition Classes
    TreeNode
  117. final def treeString(verbose: Boolean, addSuffix: Boolean, maxFields: Int, printOperatorId: Boolean, printOutputColumns: Boolean): String
    Definition Classes
    TreeNode
  118. final def treeString: String
    Definition Classes
    TreeNode
  119. def triggerRules: Seq[Expression]
    Definition Classes
    HasOutput
  120. def typeSuffix: String
    Attributes
    protected
    Definition Classes
    Expression
  121. def unsetTagValue[T](tag: TreeNodeTag[T]): Unit
    Definition Classes
    TreeNode
  122. final def validateNodePatterns(): Unit
    Definition Classes
    Expression → TreeNode
  123. final def verboseString(maxFields: Int): String
    Definition Classes
    Expression → TreeNode
  124. def verboseStringWithSuffix(maxFields: Int): String
    Definition Classes
    TreeNode
  125. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  126. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  127. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  128. final def withCanonicalizedChildren: Expression
    Attributes
    protected
    Definition Classes
    Expression
  129. final def withNewChildren(newChildren: Seq[Expression]): Expression
    Definition Classes
    TreeNode

Deprecated Value Members

  1. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable]) @Deprecated
    Deprecated

    (Since version 9)

Inherited from HasOutput

Inherited from SplitCompilation

Inherited from Runner

Inherited from NonSQLExpression

Inherited from Expression

Inherited from TreeNode[Expression]

Inherited from WithOrigin

Inherited from TreePatternBits

Inherited from Product

Inherited from Equals

Inherited from AnyRef

Inherited from Any

Ungrouped