Delta Lake Users and Developers

Contact owners and managers

1–30 of 501

Welcome to the Delta Lake User Google Group. This is a public forum. Accordingly, please do not share any confidential information with Databricks personnel or with other users in the channel. Your use of this group is subject to the Databricks Terms of Use (this channel constitutes a "Site" under such terms) and the Databricks Privacy Policy. Additionally, as a reminder, please note that your use of this channel is subject to all applicable Google Group terms, including without limitation the Google Group Privacy Policy.

0 selected

Tomás Trindade, Burak Yavuz2

Apr 16

Table version with timeStamp returns table modification time

Due to clock skew, we trust the storage system's timestamp as the commit timestamp. It would also

unread,

Table version with timeStamp returns table modification time

Due to clock skew, we trust the storage system's timestamp as the commit timestamp. It would also

Apr 16

Apr 5

AWS Athena Describe Table query throws error

HI I am new to Delta Lake and trying to consume data on Delta Lake in S3 from AWS Athena. I

unread,

AWS Athena Describe Table query throws error

HI I am new to Delta Lake and trying to consume data on Delta Lake in S3 from AWS Athena. I

Apr 5

Marcel Mossmann, … Artem Zhukov6

Apr 4

Delta-sharing support for deletion vectors

Hi Lin, Sorry, about the delay on my reply. Thanks a lot for answer, we will further analyze our

unread,

Delta-sharing support for deletion vectors

Hi Lin, Sorry, about the delay on my reply. Thanks a lot for answer, we will further analyze our

Apr 4

Mar 26

Help with operationMetrics parameter differences with version upgrade

Hi everyone, Really hope one of you kind souls is able to solve this mystery I've had for a while

unread,

Help with operationMetrics parameter differences with version upgrade

Hi everyone, Really hope one of you kind souls is able to solve this mystery I've had for a while

Mar 26

Artem Zhukov, Lin Zhou3

Mar 26

Delta-sharing with columnMapping.mode=name

Hi Lin, -- zhukovgreen, Data Engineer @Paylocity https://github.com/zhukovgreen On Mar 22, 2024, at

unread,

Delta-sharing with columnMapping.mode=name

Hi Lin, -- zhukovgreen, Data Engineer @Paylocity https://github.com/zhukovgreen On Mar 22, 2024, at

Mar 26

Hao Xu, Denny Lee2

Mar 21

Request to join slack channel

Hi Hao, You should be able to join at https://go.delta.io/slack. HTH! Denny Lee denny.lee@databricks.

unread,

Request to join slack channel

Hi Hao, You should be able to join at https://go.delta.io/slack. HTH! Denny Lee denny.lee@databricks.

Mar 21

Mar 11

add/remove columns in partition - delta table on aws

Hi everyone, I wish to change the partition columns of one of my table. It is a table created on aws

unread,

add/remove columns in partition - delta table on aws

Hi everyone, I wish to change the partition columns of one of my table. It is a table created on aws

Mar 11

Feb 21

Delta Standalone Bugs

Hello, I think the race-condition issue was on my end, sort of. It was being caused by one of

unread,

Delta Standalone Bugs

Hello, I think the race-condition issue was on my end, sort of. It was being caused by one of

Feb 21

Gaurav Aggarwal

Feb 21

Managed vs Unmanaged (Extenal) Table for very large data

Hi everyone, I am a newbie and have few questions. I need to write Spark Dataframe (using Azure

unread,

Managed vs Unmanaged (Extenal) Table for very large data

Hi everyone, I am a newbie and have few questions. I need to write Spark Dataframe (using Azure

Feb 21

Aayush Jain, Tathagata Das2

Feb 21

Merge operation using Delta Standalone

Hello Aayush, There are 2 viable approaches depending on the scale of your data - If the scale of

unread,

Merge operation using Delta Standalone

Hello Aayush, There are 2 viable approaches depending on the scale of your data - If the scale of

Feb 21

Feb 20

Programmatically creating shares on premises delta sharing server

Hello everyone, Does someone know how to create shares using any API I have successfully set up a

unread,

Programmatically creating shares on premises delta sharing server

Hello everyone, Does someone know how to create shares using any API I have successfully set up a

Feb 20

Feb 16

DELTA_SPARK_SESSION_NOT_SET exception on Delta 3.0.0/Spark 3.5.0

Hi, Trying to migrate a spark/delta job from AWS EMR with Spark 3.4.0/Delta 2.4.0 to a newer version

unread,

DELTA_SPARK_SESSION_NOT_SET exception on Delta 3.0.0/Spark 3.5.0

Hi, Trying to migrate a spark/delta job from AWS EMR with Spark 3.4.0/Delta 2.4.0 to a newer version

Feb 16

Venki Korukanti

Feb 1

Delta Lake 3.1.0 Announcement

Hi everyone, We are happy to announce the release of Delta Lake 3.1.0. Delta-Spark: Support for merge

unread,

Delta Lake 3.1.0 Announcement

Hi everyone, We are happy to announce the release of Delta Lake 3.1.0. Delta-Spark: Support for merge

Feb 1

12/18/23

Delta Sharing | Deploy on Kubernetes Engine

Hi, I want to deploy delta share on Kubernetes Engine. Firstly, is it possible to do it ? Is there

unread,

Delta Sharing | Deploy on Kubernetes Engine

Hi, I want to deploy delta share on Kubernetes Engine. Firstly, is it possible to do it ? Is there

12/18/23

Jesus Camacho Rodriguez

12/4/23

Invitation to contribute to OneTable

Hi All, We are reaching out regarding a new project in the table formats space - OneTable. OneTable[1

unread,

Invitation to contribute to OneTable

Hi All, We are reaching out regarding a new project in the table formats space - OneTable. OneTable[1

12/4/23

Jerome Yang, Burak Yavuz3

11/27/23

How delta lake cleanup aborted data files

Thank you for the clarification, it helps a lot! Regards, Junfeng 在2023年11月27日星期一 UTC+8 23:46:15<

unread,

How delta lake cleanup aborted data files

Thank you for the clarification, it helps a lot! Regards, Junfeng 在2023年11月27日星期一 UTC+8 23:46:15<

11/27/23

11/15/23

IcebergConversionTransaction.scala build error

Hi, I'm running into the build error below. Tried master and branch-3.0. Occurs both during

unread,

IcebergConversionTransaction.scala build error

Hi, I'm running into the build error below. Tried master and branch-3.0. Occurs both during

11/15/23

rameshkumar....@gmail.com, Adam Binford4

11/15/23

Streaming: how to manage the delta table meta cache.

Thank you, Adam Binford. On Thu, Nov 9, 2023 at 5:30 PM Adam Binford <ada...@gmail.com> wrote:

unread,

Streaming: how to manage the delta table meta cache.

Thank you, Adam Binford. On Thu, Nov 9, 2023 at 5:30 PM Adam Binford <ada...@gmail.com> wrote:

11/15/23

rameshkumar....@gmail.com, … Sergey Ivanychev7

11/9/23

The symlink manifest has not been updated correctly.

Thank you for the clarification, Ryan. Sergey Ivanychev As of now, I am explicitly updating the

unread,

The symlink manifest has not been updated correctly.

Thank you for the clarification, Ryan. Sergey Ivanychev As of now, I am explicitly updating the

11/9/23

COCOCAT TACOCOC

10/28/23

Delta Kernel vs Delta Standalone

I'm having trouble understanding the difference between Delta Kernel and Delta Standalone. At the

unread,

Delta Kernel vs Delta Standalone

I'm having trouble understanding the difference between Delta Kernel and Delta Standalone. At the

10/28/23

COCOCAT TACOCOC, Matthew Powers2

10/24/23

Delta Standalone, Delta-rs data skipping support

delta-rs performs file skipping, see this presentation for benchmarks to see how much Z Ordering can

unread,

Delta Standalone, Delta-rs data skipping support

delta-rs performs file skipping, see this presentation for benchmarks to see how much Z Ordering can

10/24/23

Ashoka sangapallar Jayappa

10/24/23

Schema Evolution - (Adding new Column to existing Delta table/ Adding new element to existing struct column in rust/deltalake)

Hi Guys. I am trying to do schema evolution for one of the use case using rust/delta on Azure stack.

unread,

Schema Evolution - (Adding new Column to existing Delta table/ Adding new element to existing struct column in rust/deltalake)

Hi Guys. I am trying to do schema evolution for one of the use case using rust/delta on Azure stack.

10/24/23

10/21/23

Delta lake connected via STS JDBC unable to get table columns meta data (using hive-jdbc)

Hello, I am using hive-jdbc jar to connect delta lake using Spark Thrift Servre connection string. I

unread,

Delta lake connected via STS JDBC unable to get table columns meta data (using hive-jdbc)

Hello, I am using hive-jdbc jar to connect delta lake using Spark Thrift Servre connection string. I

10/21/23

10/17/23

Delta Lake 3.0.0 Announcement

Hello everyone, We are happy to announce the final release of Delta Lake 3.0.0 on Apache Spark 3.5!

unread,

Delta Lake 3.0.0 Announcement

Hello everyone, We are happy to announce the final release of Delta Lake 3.0.0 on Apache Spark 3.5!

10/17/23

Sunayana Rambhatla

10/15/23

Performing aggregate queries on shared table data

I have a Delta Lake data source and I am setting up Delta Sharing on top of it. As a recipient, I

unread,

Performing aggregate queries on shared table data

I have a Delta Lake data source and I am setting up Delta Sharing on top of it. As a recipient, I

10/15/23

Tahseen Firoz, Mich Talebzadeh2

10/13/23

Liquid Clustering

There was a reference to some initial findings in linkedlin on Liquid Clustering. See below link

unread,

Liquid Clustering

There was a reference to some initial findings in linkedlin on Liquid Clustering. See below link

10/13/23

Sunayana Rambhatla, OKAWA Shingo2

10/13/23

Querying Data in Shared Tables using Delta Sharing

Hi Sunayana. > My question is, instead of reading the entire data from the table, I want to

unread,

Querying Data in Shared Tables using Delta Sharing

Hi Sunayana. > My question is, instead of reading the entire data from the table, I want to

10/13/23

10/9/23

Delta Lake 3.0 RC2 Announcement

Hi everyone, We are happy to announce the second release candidate of Delta Lake 3.0 on Spark 3.5.

unread,

Delta Lake 3.0 RC2 Announcement

Hi everyone, We are happy to announce the second release candidate of Delta Lake 3.0 on Spark 3.5.

10/9/23

9/22/23

Optimize write in open source delta

I am using your PR, https://github.com/delta-io/delta/pull/1198 , for optimize write in my EMR

unread,

Optimize write in open source delta

I am using your PR, https://github.com/delta-io/delta/pull/1198 , for optimize write in my EMR

9/22/23

Sandeep Anumula

9/14/23

Delta sharing server docker image gives file not found exception

Hi All, I'm try to explore delta share docker image https://hub.docker.com/r/deltaio/delta-

unread,

Delta sharing server docker image gives file not found exception

Hi All, I'm try to explore delta share docker image https://hub.docker.com/r/deltaio/delta-

9/14/23

Search

Clear search

Close search

Google apps

Main menu