Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix: try to fix timeouts #2318

Merged
merged 2 commits into from
Mar 22, 2024
Merged

fix: try to fix timeouts #2318

merged 2 commits into from
Mar 22, 2024

Conversation

ion-elgreco
Copy link
Collaborator

Description

I ran this version in a pipeline at work and now it didn't give this anymore:

OSError: Generic MicrosoftAzure error: Error after 0 retries in 30.000943594s, max_retries:10, retry_timeout:180s, source:error sending request for url (https://<redacted>.blob.core.windows.net/dev-preprocessed/<redacted>/product_line_code=<redacted>/event_year_month_clt=202209/part-00001-874ec394-72d0-44fb-8cbb-2b7b73b41ede-c000.snappy.parquet): operation timed out

@github-actions github-actions bot added binding/python Issues for the Python package binding/rust Issues for the Rust crate labels Mar 22, 2024
@wjones127 wjones127 merged commit 22f03b4 into delta-io:main Mar 22, 2024
22 of 23 checks passed
This was referenced Apr 4, 2024
Closed
Merged
ion-elgreco pushed a commit that referenced this pull request Apr 5, 2024
@PeterKeDer
fix(rust): remove flush after writing every batch (#2387)
69317f8 
# Description

Reverts #2318 by removing
`flush` after writing each batch since it was causing smaller than
expected row groups to be written during compaction.

# Related Issue(s)
- closes #2386
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@wjones127 wjones127 wjones127 approved these changes

@fvaleye fvaleye Awaiting requested review from fvaleye fvaleye is a code owner

@roeap roeap Awaiting requested review from roeap roeap is a code owner

@rtyler rtyler Awaiting requested review from rtyler rtyler is a code owner

Assignees
No one assigned
Labels
binding/python Issues for the Python package binding/rust Issues for the Rust crate
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@ion-elgreco @wjones127