Is there an option to generate single trailer for the AVRO target, when the partition is enabled

I have enabled job level partition in which AVRO is the target present in it.  Instead of creating the trailer file for each partition is there a way we can have a single file created for all the partitions

Beginner Asked on June 2, 2020 in Diyotta Monitor.
Add Comment
1 Answer(s)

In prior versions, when job partition is used with Avro target instance in the data flow, for each job partition, a trailer file is generated. We have modified this to generate a  combined single trailer file.

For example, if partition size is set as 2 then the trailer file would be generated as below.

RE: Is there an option to generate single trailer for the AVRO target, when the partition is enabled

Expert Answered on June 8, 2020.
Add Comment

Your Answer

By posting your answer, you agree to the privacy policy and terms of service.