== Physical Plan ==
* Project (3)
+- * Filter (2)
+- * Scan ExistingRDD Delta Table State with Stats #1 - hdlfs://9b46f9d5-066e-49af-bc5c-7af37534ca4d.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/market-unit/_delta_log (1)
(1) Scan ExistingRDD Delta Table State with Stats #1 - hdlfs://9b46f9d5-066e-49af-bc5c-7af37534ca4d.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/market-unit/_delta_log [codegen id : 1]
Output [11]: [path#3906, partitionValues#3907, size#3908L, modificationTime#3909L, dataChange#3910, stats#3917, tags#3912, deletionVector#3913, baseRowId#3914L, defaultRowCommitVersion#3915L, clusteringProvider#3916]
Arguments: [path#3906, partitionValues#3907, size#3908L, modificationTime#3909L, dataChange#3910, stats#3917, tags#3912, deletionVector#3913, baseRowId#3914L, defaultRowCommitVersion#3915L, clusteringProvider#3916], Delta Table State with Stats #1 - hdlfs://9b46f9d5-066e-49af-bc5c-7af37534ca4d.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/market-unit/_delta_log MapPartitionsRDD[223] at $anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128, ExistingRDD, UnknownPartitioning(0)
(2) Filter [codegen id : 1]
Input [11]: [path#3906, partitionValues#3907, size#3908L, modificationTime#3909L, dataChange#3910, stats#3917, tags#3912, deletionVector#3913, baseRowId#3914L, defaultRowCommitVersion#3915L, clusteringProvider#3916]
Condition : ((UDF(true, size#3908L, (stats#3917.numRecords - coalesce(deletionVector#3913.cardinality, 0)), stats#3917.numRecords) AND UDF(true, size#3908L, (stats#3917.numRecords - coalesce(deletionVector#3913.cardinality, 0)), stats#3917.numRecords)) AND if (isnull((((stats#3917.nullCount.marketUnit < stats#3917.numRecords) AND ((stats#3917.minValues.marketUnit <= DIP_1691) AND (DIP_1691 <= stats#3917.maxValues.marketUnit))) OR (((isnull(stats#3917.nullCount.marketUnit) OR isnull(stats#3917.numRecords)) OR (isnull(stats#3917.minValues.marketUnit) AND NOT (stats#3917.nullCount.marketUnit = stats#3917.numRecords))) OR (isnull(stats#3917.maxValues.marketUnit) AND NOT (stats#3917.nullCount.marketUnit = stats#3917.numRecords)))))) false else UDF(knownnotnull((((stats#3917.nullCount.marketUnit < stats#3917.numRecords) AND ((stats#3917.minValues.marketUnit <= DIP_1691) AND (DIP_1691 <= stats#3917.maxValues.marketUnit))) OR (((isnull(stats#3917.nullCount.marketUnit) OR isnull(stats#3917.numRecords)) OR (isnull(stats#3917.minValues.marketUnit) AND NOT (stats#3917.nullCount.marketUnit = stats#3917.numRecords))) OR (isnull(stats#3917.maxValues.marketUnit) AND NOT (stats#3917.nullCount.marketUnit = stats#3917.numRecords))))), size#3908L, (stats#3917.numRecords - coalesce(deletionVector#3913.cardinality, 0)), stats#3917.numRecords))
(3) Project [codegen id : 1]
Output [11]: [path#3906, partitionValues#3907, size#3908L, modificationTime#3909L, dataChange#3910, null AS stats#3960, tags#3912, deletionVector#3913, baseRowId#3914L, defaultRowCommitVersion#3915L, clusteringProvider#3916]
Input [11]: [path#3906, partitionValues#3907, size#3908L, modificationTime#3909L, dataChange#3910, stats#3917, tags#3912, deletionVector#3913, baseRowId#3914L, defaultRowCommitVersion#3915L, clusteringProvider#3916]