Time Datatype for Redshift
In Redshift, if there is a column with Time or TimeZ, then Torch will display it as timestamp.
Reason: Torch runs on Spark, and the Spark engine does not understand just the time data type, it either understands date or timestamp. Therefore, it infers the Time and TimeZ column as timestamp.
For example:
In Redshift, the actual value for the Time or TimeZ field is ‘04:05:06’ or ‘04:05 AM UTC’.

But, the value displayed in the table is ‘1970-01-01 04:05:06’ on the Sample Data or Profile window.

Internally, Torch converts it to timestamp, such that the date is an epoch date, which is equivalent to not having it.
Was this page helpful?