Databricks Knowledge Base

Main Navigation

  • Help Center
  • Documentation
  • Knowledge Base
  • Community
  • Training
  • Feedback

Python with Apache Spark (GCP)

These articles can help you to use Python with Apache Spark.

14 Articles in this category

Contact Us

If you still have questions or prefer to get help directly from an agent, please submit a request. We’ll get back to you as soon as possible.

Please enter the details of your request. A member of our support staff will respond as soon as possible.

  • Home
  • All articles
  • Python with Apache Spark (GCP)

AttributeError: ‘function’ object has no attribute

Using protected keywords from the DataFrame API as column names results in a function object has no attribute error message....

Last updated: May 19th, 2022 by noopur.nigam

Convert Python datetime object to string

Display date and time values in a column, as a datetime object, and as a string....

Last updated: May 19th, 2022 by Adam Pavlacka

Display file and directory timestamp details

Display file creation date and modification date using Python....

Last updated: May 19th, 2022 by rakesh.parija

Reading large DBFS-mounted files using Python APIs

Learn how to resolve errors when reading large DBFS-mounted files using Python APIs....

Last updated: May 19th, 2022 by Adam Pavlacka

How to import a custom CA certificate

Learn how to import a custom CA certificate into your Databricks cluster for Python use....

Last updated: February 27th, 2023 by arjun.kaimaparambilrajan

Job remains idle before starting

Apache Spark jobs remain idle for a long time before starting....

Last updated: May 19th, 2022 by ashish

List all workspace objects

List all Databricks workspace objects under a given path....

Last updated: May 19th, 2022 by Adam Pavlacka

Python commands fail on high concurrency clusters

Python commands fail on high concurrency clusters with Apache Spark process isolation and shared session enabled. WARN error message....

Last updated: May 19th, 2022 by xin.wang

Cluster cancels Python command execution after installing Bokeh

Learn what to do when your Databricks cluster cancels Python command execution after you install Bokeh....

Last updated: May 19th, 2022 by Adam Pavlacka

Cluster cancels Python command execution due to library conflict

Learn what to do when your Databricks cluster cancels Python command execution due to a library conflict....

Last updated: May 19th, 2022 by Adam Pavlacka

Python command execution fails with AttributeError

Learn what to do when a Python command in your Databricks notebook fails with AttributeError....

Last updated: May 19th, 2022 by Adam Pavlacka

Job fails with Java IndexOutOfBoundsException error

When groupby() is used along with applyInPandas it generates an exception due to an arrow buffer limitation....

Last updated: December 21st, 2022 by rakesh.parija

Job fails with NoSuchElementException error

NoSuchElementException errors can occur when using Apache Arrow....

Last updated: March 3rd, 2023 by ashish

Job fails with IndexOutOfBoundsException and ArrowBuf errors

When Groupby is used with applyinPandas it can result in Apache Arrow buffer size estimation errors....

Last updated: March 3rd, 2023 by ashish


© Databricks 2022-2023. All rights reserved. Apache, Apache Spark, Spark, and the Spark logo are trademarks of the Apache Software Foundation.

Send us feedback | Privacy Notice (Updated) | Terms of Use | Your Privacy Choices | Your California Privacy Rights Privacy Rights icon

Definition by Author

0
0