Casting string to date/timestamp in DLT pipeline does not throw an error

Problem When working with Delta Live Tables, you  should encounter an issue when a string value is cast to a date/timestamp datatype, but do not. Example A sample DLT pipeline definition: @dlt.table(    name='test',    temporary=True ) def df_src():    return (        spark.sql("select 101 as id, cast('test' as Date) as dt from source_table")    ) C...

0 min reading time