Object lock error when writing Delta Lake tables to S3

Delta Lake does not support S3 buckets with object lock enabled. com.amazonaws.services.s3.model.AmazonS3Exception

Written by ashritha.laxminarayana

Last published at: May 10th, 2022

Problem

You are trying to perform a Delta write operation to a S3 bucket and get an error message.

com.amazonaws.services.s3.model.AmazonS3Exception: Content-MD5 HTTP header is required for Put Part requests with Object Lock parameters

Cause

Delta Lake does not support S3 buckets with object lock enabled.

Solution

You should use an S3 bucket that does not have object lock enabled.

For more information, please review the AWS documentation on S3 object lock.