Databricks Knowledge Base

Main Navigation

  • Help Center
  • Documentation
  • Knowledge Base
  • Community
  • Training
  • Feedback

Python with Apache Spark (AWS)

These articles can help you to use Python with Apache Spark.

22 Articles in this category

Contact Us

If you still have questions or prefer to get help directly from an agent, please submit a request. We’ll get back to you as soon as possible.

Please enter the details of your request. A member of our support staff will respond as soon as possible.

  • Home
  • All articles
  • Python with Apache Spark (AWS)

AttributeError: ‘function’ object has no attribute

Using protected keywords from the DataFrame API as column names results in a function object has no attribute error message....

Last updated: May 19th, 2022 by noopur.nigam

Convert Python datetime object to string

Display date and time values in a column, as a datetime object, and as a string....

Last updated: May 19th, 2022 by Adam Pavlacka

Create a cluster with Conda

Learn how to create a Databricks cluster with Conda....

Last updated: May 19th, 2022 by Adam Pavlacka

Display file and directory timestamp details

Display file creation date and modification date using Python....

Last updated: May 19th, 2022 by rakesh.parija

Install and compile Cython

Learn how to install and compile Cython with Databricks....

Last updated: May 19th, 2022 by Adam Pavlacka

Reading large DBFS-mounted files using Python APIs

Learn how to resolve errors when reading large DBFS-mounted files using Python APIs....

Last updated: May 19th, 2022 by Adam Pavlacka

Use the HDFS API to read files in Python

Learn how to read files directly by using the HDFS API in Python....

Last updated: May 19th, 2022 by arjun.kaimaparambilrajan

How to import a custom CA certificate

Learn how to import a custom CA certificate into your Databricks cluster for Python use....

Last updated: February 27th, 2023 by arjun.kaimaparambilrajan

Job remains idle before starting

Apache Spark jobs remain idle for a long time before starting....

Last updated: May 19th, 2022 by ashish

List all workspace objects

List all Databricks workspace objects under a given path....

Last updated: May 19th, 2022 by Adam Pavlacka

Load special characters with Spark-XML

Special characters are not rendering correctly. Use charset with Spark-XML....

Last updated: May 19th, 2022 by annapurna.hiriyur

Python commands fail on high concurrency clusters

Python commands fail on high concurrency clusters with Apache Spark process isolation and shared session enabled. WARN error message....

Last updated: May 19th, 2022 by xin.wang

Cluster cancels Python command execution after installing Bokeh

Learn what to do when your Databricks cluster cancels Python command execution after you install Bokeh....

Last updated: May 19th, 2022 by Adam Pavlacka

Cluster cancels Python command execution due to library conflict

Learn what to do when your Databricks cluster cancels Python command execution due to a library conflict....

Last updated: May 19th, 2022 by Adam Pavlacka

Python command execution fails with AttributeError

Learn what to do when a Python command in your Databricks notebook fails with AttributeError....

Last updated: May 19th, 2022 by Adam Pavlacka

Python REPL fails to start in Docker

Learn how to fix a Python virtualenv error that prevents REPL from starting in a Docker container...

Last updated: May 19th, 2022 by arjun.kaimaparambilrajan

How to run SQL queries from Python scripts

Learn how to run SQL queries using Python scripts....

Last updated: May 19th, 2022 by arjun.kaimaparambilrajan

Run C++ code in Python

Learn how to run C++ code in Python....

Last updated: May 19th, 2022 by Adam Pavlacka

Python 2 sunset status

Learn about the sunset status of Python 2 in Databricks....

Last updated: May 19th, 2022 by Adam Pavlacka

Job fails with Java IndexOutOfBoundsException error

When groupby() is used along with applyInPandas it generates an exception due to an arrow buffer limitation....

Last updated: December 21st, 2022 by rakesh.parija

Job fails with NoSuchElementException error

NoSuchElementException errors can occur when using Apache Arrow....

Last updated: March 3rd, 2023 by ashish

Job fails with IndexOutOfBoundsException and ArrowBuf errors

When Groupby is used with applyinPandas it can result in Apache Arrow buffer size estimation errors....

Last updated: March 3rd, 2023 by ashish


© Databricks 2022-2023. All rights reserved. Apache, Apache Spark, Spark, and the Spark logo are trademarks of the Apache Software Foundation.

Send us feedback | Privacy Notice (Updated) | Terms of Use | Your Privacy Choices | Your California Privacy Rights Privacy Rights icon

Definition by Author

0
0