Timestamp change to underlying Apache Parquet/change data files while using Change Data Capture (CDC)

Problem When using Change Data Capture (CDC) to consume incremental data from an external table, you see that the underlying Apache Parquet or change data files’ timestamp changes.  This problem typically arises after moving the files to a different workspace and changing the underlying S3 bucket for the table. Despite copying all S3 files, includin...

1 min reading time

Production environment will not connect to Sybase

Problem You may encounter an issue when trying to connect to Sybase from your production environment. org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 1.0 failed 4 times, most recent failure: Lost task 0.3 in stage 1.0 (TID 4) (10.244.90.50 executor 1): com.sybase.jdbc4.jdbc.SybSQLException: Incorrect syntax near 'L...

0 min reading time

UDF functions not supported error in Unity Catalog

Problem  While working in Unity Catalog, you receive an error message indicating that UDF functions are not supported.  UC_COMMAND_NOT_SUPPORTED.WITHOUT_RECOMMENDATION] The command(s): UDF/UDAF functions are not supported in Unity Catalog. SQLSTATE: 0AKUC; Cause This is expected behavior. Unity Catalog shared clusters do not support Java UDF functio...

0 min reading time