RE: Does Diyotta support Spark Joiner with Cartesian Product?

Does Diyotta support Spark Joiner with Cartesian Product?

Add Comment
1 Answers

Yes. By using the below property we can achieve it.
“spark.sql.crossJoin.enabled”

This property can be set at either Data Point or Data Flow. If we set at Data Point level then it will apply for all the Data Flow’s. If required in specific Data Flow then it should be set at that particular Data Flow.

  1. Data Point

In Spark Datapoint click on “Runtime Properties”, select “Run Property Type” as “ALL”. Click on “+” button and find the property “spark.sql.crossJoin.enabled” and set the value to TRUE.

RE: Does Diyotta support Spark Joiner with Cartesian Product?

2. Data Flow

In the Data Flow “Design Tab” click on “Runtime Properties”, select “Run Property Type” as “ALL”. Click on “+” button and find the property “spark.sql.crossJoin.enabled” and set the value to TRUE.

RE: Does Diyotta support Spark Joiner with Cartesian Product?

Expert Answered on July 15, 2019.
Add Comment

Your Answer

By posting your answer, you agree to the privacy policy and terms of service.