Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create a script that reads and writes Zarr arrays using directory and zip stores. #5

Open
caviere opened this issue Dec 28, 2022 · 1 comment

Comments

@caviere
Copy link
Contributor

caviere commented Dec 28, 2022

Steps followed:

  1. Go through the pytest documentation to use it to write tests and check data integrity.
  2. Create an automated script that generates directory and zip stores.
  3. Ensure that after every write data integrity is being checked.

Here's the link to what I have so far: https:/caviere/script/blob/master/sample.py

@caviere
Copy link
Contributor Author

caviere commented Jan 9, 2023

Steps to follow:

  1. Add the fsspec implementation to the script and note its performance.
  2. Add timing calculations to measure how long certain processes take.
  3. Use real-world datasets to compare the different implementations and document the findings.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant