InMemoryRelation Logical Operator

InMemoryRelation is a leaf logical operator, i.e. has no child operators. InMemoryRelation

class InMemoryRelation(
  output: Seq[Attribute],
  useCompression: Boolean,
  batchSize: Int,
  storageLevel: StorageLevel,
  @transient child: SparkPlan,
  tableName: Option[String])(
  @transient var _cachedColumnBuffers: RDD[CachedBatch] = null,
  val batchStats: LongAccumulator = child.sqlContext.sparkContext.longAccumulator)
extends logical.LeafNode with MultiInstanceRelation

results matching ""

    No results matching ""