RE: How to sort the data before unloading into a file?
I have to unload data from postgres database to a file. There are multiple transformations performed before finalizing the data to be unloaded. I do not see a sort option in Diyotta. How can I achieve this?
Hi try the below steps to sort data.
After using multiple transformations use the Temp Stage transform to sort the data.
- Create a derived attribute in the temp stage transform and use the Rank function in the expression editor(apply the function on the key column which you want to sort).
- Expression transform can also be used in this scenario, but using Temp Stage we can connect to other transforms or targets if required.
See below images for more detail implementation.
Thanks.