-
Notifications
You must be signed in to change notification settings - Fork 10
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
handle multi-workers data loaders more gracefully #137
Comments
kaczmarj
added a commit
that referenced
this issue
Jul 10, 2023
Fixes #137 The OpenSlide object is no longer created in `__init__`. Previously the openslide object was shared across workers. Now each worker creates its own OpenSlide object. I hypothesize that this will allow multi-worker data loading on Windows.
one issue with this implementation is that an exception is raised when |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
in our current Dataset class, add a worker_init function that initializes the whole slide image object. then in the Dataloader instantiation, pass that function name.
see Bayer-Group/tiffslide#18 (comment) for an example.
The text was updated successfully, but these errors were encountered: