How to implement upsert logic in hive target table as per source data?

How to implement upsert logic in hive target table as per source data?

Beginner Asked on July 16, 2019 in Connectors.
Add Comment
1 Answer(s)

In the existing hive target, we have an option “overwrite partitions” which will perform the upsert operation on the target table as per the source data.

Dataflow à Target instance à properties à Overwrite Partitions.

When the overwrite partitions is selected it will insert and overwrite the data present in already existing hive table level partitions. It will not perform entire table level insert and overwrite. Which is a performance improvement during the execution in this scenario.

RE: How to implement upsert logic in hive target table as per source data?

Expert Answered on July 16, 2019.
Add Comment

Your Answer

By posting your answer, you agree to the privacy policy and terms of service.