RE: When trying to run the jobflow we are facing TFORM table not present Error during the execution.
current workflow we’re trying to implement is BQ -> CloudSQL Upsert. We are loading the data from BQ to a temp cloudsql table with a Dataflow. Then we have completed the jobflow DB command that loads data from a temp table into target table in cloudsql. The issue is that when we link both Dataflow instance and DB command together in a job flow, it returning the following error “Tform database is not assigned to native data point.Dependency fail in :netbox_physical_devices_DF;”. Have included the logs from the monitors for this run. Note: The jobs run successfully on their own, the failure only occurs when they’re linked together. I have attached the logs and the exported job flow as well.
We have imported the jobflow you have shared with us. In the dataflow, you have added a sql parameter and the context is empty. Context is required for the sql parameter in the dataflow to run. Also, the sql parameter is not required as you have added the derived attribute in the source transformation which has the current_Timestamp system parameter present in it. So due to this when we run the jobflow we are getting the Tform database is not assigned to the native data point. Can you delete the sql parameter in the dataflow and then try to run the jobflow again.