RE: How to configure Diyotta’s spark execution to use the different scheduler mode Spark offers?

How to configure Diyotta’s spark execution to use the different scheduler mode Spark offers?

RaviP Beginner Asked on July 15, 2019 in Spark Process Platform.
Add Comment
1 Answers

“spark.scheduler.mode” is available in Spark Data PointàRuntime Properties à Run Property Type à Scheduling

The same is also available at the Data Flow level. If we set at data point it will be applied for all the data flows using that data point. If required for a specific data flow then it should be set at that particular Data Flow.

  1. Data Point

In Spark Data Ppoint click on “Runtime Properties”, select “Run Property Type” as “Scheduling”. Click on “+” button and find the property “spark.scheduler.mode” and click on the check box and then Ok.Then set the value to FAIR/FIFO.

RE: How to configure Diyotta’s spark execution to use the different scheduler mode Spark offers?

  1. Data Flow

In Spark Data Flow click on “Runtime Properties”, select “Run Property Type” as “Scheduling”. Click on “+” button and find the property “spark.scheduler.mode” and click on the check box and then Ok. Then  set the value to FAIR/FIFO.

RE: How to configure Diyotta’s spark execution to use the different scheduler mode Spark offers?

Expert Answered on July 15, 2019.
Add Comment

Your Answer

By posting your answer, you agree to the privacy policy and terms of service.