RE: Does Diyotta support Spark Joiner with Cartesian Product?
Does Diyotta support Spark Joiner with Cartesian Product?
Yes. By using the below property we can achieve it.
“spark.sql.crossJoin.enabled”
This property can be set at either Data Point or Data Flow. If we set at Data Point level then it will apply for all the Data Flow’s. If required in specific Data Flow then it should be set at that particular Data Flow.
- Data Point
In Spark Datapoint click on “Runtime Properties”, select “Run Property Type” as “ALL”. Click on “+” button and find the property “spark.sql.crossJoin.enabled” and set the value to TRUE.
2. Data Flow
In the Data Flow “Design Tab” click on “Runtime Properties”, select “Run Property Type” as “ALL”. Click on “+” button and find the property “spark.sql.crossJoin.enabled” and set the value to TRUE.
