Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for more type widening in Delta Lake connector #22433

Closed
ebyhr opened this issue Jun 19, 2024 · 0 comments · Fixed by #22458
Closed

Add support for more type widening in Delta Lake connector #22433

ebyhr opened this issue Jun 19, 2024 · 0 comments · Fixed by #22458
Assignees
Labels
delta-lake Delta Lake connector

Comments

@ebyhr
Copy link
Member

ebyhr commented Jun 19, 2024

#22142 added support for type widening supported by OSS Delta Lake:

  • byte → short or integer
  • short → integer

Databricks supports more type widening than OSS Delta Lake.
We can skip unsupported type widening until supporting them.

Source type Supported wider types
byte short, int, long, decimal, double
short int, long, decimal, double
int long, decimal, double
long decimal
float double
decimal decimal with greater precision and scale
date timestampNTZ

https://docs.databricks.com/en/delta/type-widening.html#supported-type-changes

@ebyhr ebyhr added the delta-lake Delta Lake connector label Jun 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
delta-lake Delta Lake connector
Development

Successfully merging a pull request may close this issue.

2 participants