Updated May 19th, 2022 by annapurna.hiriyur

Load special characters with Spark-XML

Problem You have special characters in your source files and are using the OSS library Spark-XML. The special characters do not render correctly. For example, “CLU®” is rendered as “CLU�”. Cause Spark-XML supports the UTF-8 character set by default. You are using a different character set in your XML files. Solution You must specify the character se...

0 min reading time
Updated May 10th, 2022 by annapurna.hiriyur

HIVE_CURSOR_ERROR when reading a table in Athena

Problem You create an external table in Athena and integrate it with Delta Lake using the instructions in the Presto and Athena to Delta Lake integration documentation. The external table in Athena is defined in the Apache Hive metastore. You run a select query on external table from the Athena Query Editor and it returns a HIVE_CURSOR_ERROR. HIVE_C...

1 min reading time
Updated May 10th, 2022 by annapurna.hiriyur

Cannot delete data using JDBC in Eclipse

Problem You cannot delete data from a Delta table using JDBC from your local Eclipse environment. The same delete operation works when run in a notebook. You can connect to Databricks from your local environment. A select query works. Integer count = namedlocalJdbcTemplate.queryForObject("SELECT COUNT(*) FROM <table-name> ", new MapSqlParamete...

1 min reading time
Load More