Murthy Desineedi's Profile
Expert
49
Points

Questions
0

Answers
44

  • Expert Asked on July 17, 2019 in Diyotta Agent.

    Diyotta provides User level interface to configure SSL. As shown below screen shot user has to provide “key store” and “trust store” details which will receive at Diyotta agent functionality to make it SSL enabled.

     

    RE: How to enable SSL on agent?

    • 213 views
    • 1 answers
    • 0 votes
  • Expert Asked on July 17, 2019 in Diyotta Agent.

    We can register agent in Diyotta Admin. Below are the steps to register,

    1. Agent name is same as which provided at agent configuration
    2. Host will be server id where we are installed agent.

    RE: How to register an agent in Diyotta?

    • 214 views
    • 1 answers
    • 0 votes
  • Expert Asked on July 17, 2019 in Architecture.

    The core components that make up the Data Connect integration are as follows

    • Kafka connect framework
    • Kafka
    • Zookeeper

    Even if you did not have Kafka in your infrastructure, the Data Connect extension package comes with all the above components. At a high-level, the execution architecture for real time data ingestion follows the below steps

    • Source connector reads from the event source (RDBMS in case of CDC)
    • The new events are captured in Kafka topic specific to each source object
    • Sink connector reads from the Kafka topic and writes to sink

     

     

    • 236 views
    • 1 answers
    • 0 votes
  • Expert Asked on July 17, 2019 in Diyotta Controller.

    Yes, Diyotta supports HA, by changing below settings we can enable HA in Diyotta Controller.

     

    Open $DIYOTTA_HOME/controller/conf/diserver.config or go to Admin –> Configuration –> Server Settings –> JMX Settings.

     

    Set below properties:

     

    diserver.ha=Y

     

    diserver.ha.host1=          <DI_HOST1>:<DI_HOST1_STARTUP_PORT>

     

    diserver.ha.host2=          <DI_HOST2>:<DI_HOST2_STARTUP_PORT>

    • 189 views
    • 1 answers
    • 0 votes
  • Expert Asked on July 17, 2019 in Diyotta Controller.

    Maximum and minimum memory utilization of Diyotta controller depends on the configuration parameter call “diserver.java_opts” present in diserver.config file present at “$DIYOTTA_HOME/controller/conf” directory. By default, this value is defined with minimum heap space of 1024mb and maximum of 4026mb as below

    diserver.java_opts = -Xms1024m -Xmx4096m

    -Xms1024m means controller process will initiate a minimum of 1024mb

    -Xmx4096m means controller process can utilize up to 4096 mb.

    We can change these settings by modifying diserver.java_opts property in diserver.config directly or we can go to Diyotta admin -> Configurations -> Server Settings -> JAVA_OPTS Settings.

    • 165 views
    • 1 answers
    • 0 votes
  • Expert Asked on July 17, 2019 in Connectors.

    To import the Source or Target Objects from the Dataflow level, the connection which we use to import Source or Target Object should not have any dataobjects imported before. So when we drag the source or target on to the canvas it will ask for import dataobject.

    Please see the below image:

    RE: How to import Source or Target Objects from the Dataflow Level?

    • 187 views
    • 1 answers
    • 0 votes
  • Expert Asked on July 17, 2019 in Diyotta Studio.
    1. Hive Partitions is a way to organizes tables into partitions by dividing tables into different parts based on partition keys.
    2. Example of hive query for partition will be as below
    • create table state_part(District string,Enrolments string) PARTITIONED BY(state string);
    • For partition we must set this property

    3.set hive.exec.dynamic.partition =true;

    .set hive.exec.dynamic.partition.mode=nonstrict

    • 237 views
    • 1 answers
    • 0 votes
  • Expert Asked on July 17, 2019 in Diyotta Studio.

    There are three types of execution engines, they are

    1. Mr (Map Reduce job)

    We can use this MR mode if we need executions to be processed under map reduce jobs. If we select this option for this property, the below commands will be applicable while preparing query

    set hive.execution.engine = mr;

    set mapred.job.queue.name = default;

    1. Tez

    Tez is an extensible framework for building high performance batch and interactive data processing applications, coordinated by YARN in Apache Hadoop. If we select this option for this property, the below commands will be applicable while preparing query

    set hive.execution.engine = tez;

    set tez.queue.name = default;

     

    • Spark

    We can use this mode if we need hive executions to be process under spark engine. If we select this option for this property, the below commands will be applicable while preparing query

    set hive.execution.engine = Spark;

    set spark.yarn.queue= default;

     

     

    RE: What are the types of Execution Engines does diyotta supports?

    • 216 views
    • 1 answers
    • 0 votes
  • Expert Asked on July 17, 2019 in Diyotta Studio.

    There are two types of processing engines of hive.

    1. Hive
    2. Impala

     

    • 173 views
    • 2 answers
    • 0 votes
  • Expert Asked on July 17, 2019 in Diyotta Admin.

    Users can be created under Admin module with Admin User. There are there types of users.

    1) Admin User

    2) Tenant Admin User

    3) Normal User

    Admin users can create Admin , Tenant and normal users. Tenant users can create Tenant and normal users. Normal can create only normal users.

     

    RE: How to Create/Modify/Delete the Users ?

    To create Admin User :

    Admin user can be created by clicking on the New button with plus mark under Users in Admin module.

    Under User details fill all the mandatory details like Login Id, Name, Password, Email. Nothing to select under organization.

     

    RE: How to Create/Modify/Delete the Users ?

    Select Grant Administrator Access check box as shown in figure. Assigning User groups is not mandatory. Click on Save button.

     

    To create Tenant User :

    Tenant user can be created by clicking on the New button with plus mark under Users in Admin module.

    Fill all the mandatory details like Login Id, Name, Password, Email for User details. Select the required organization and check the check box Tenant Admin Privilege. Select the required projects and give them roles in Privileges. Assigning User groups is not mandatory. Click on Save button

     

    RE: How to Create/Modify/Delete the Users ?

    To create Normal User :

    Normal user can be created by clicking on the New button with plus mark under Users in Admin module.

    Fill all the mandatory details like Login Id, Name, Password, Email for User details. Select the required organizations. Select the required projects and give them roles in Privileges. Assigning User groups is not mandatory. Click on Save button.

     

    RE: How to Create/Modify/Delete the Users ?

    To edit any project :

    To edit any User select the respective user by clicking on check box and click on open under edit button with pencil symbol as shown in above figure or directly click on User name. Like wise To delete any user  select the respective user by clicking on check box and click on Delete under edit button with pencil symbol as shown in above figure and click on Save button.

     

    RE: How to Create/Modify/Delete the Users ?

    • 211 views
    • 1 answers
    • 0 votes