We are getting the error “Datetime field overflow” in Diyotta 4.x for most of the jobflows
Consider following example to analyze the issue-
we have column NFA_DATE_TS defined as timestamp(0).In Hive, the same column value is stored similar to Teradata timestamp(0) format (we defined derived attribute for this).
Now from Hive-> Teradata, in TFRM database, Diyotta is defining the column as timestamp(6) instead of timestamp(0) in working table and converting all hive values to timestamp(6) format.
As a result, in next step, while inserting timestamp(6) values to actual table timestamp(0) field, we are getting “Datetime field overflow” error.
Now we have fixed the datatime overflow issue in 4.1.0.3118.006 version
Now the TFORM table is getting created in the Hive database with timestamp(0) in sync with the Teradata database. Now the issue should be resolved and timestamp value should load properly into the Teradata table.
