Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Payload load data of different modality into cache #832

Open
hepengfe opened this issue Jun 10, 2022 · 0 comments
Open

Payload load data of different modality into cache #832

hepengfe opened this issue Jun 10, 2022 · 0 comments
Assignees
Labels
topic: data Issue about data loader modules and data processing related topic: ontology All issues related to ontologies in core, top and base_ontology

Comments

@hepengfe
Copy link
Collaborator

hepengfe commented Jun 10, 2022

Is your feature request related to a problem? Please describe.
Follow up on #828, I complete a draft that Payload can holds loading method and load path(assigned in reader), and they can be used together to achieve lazy loading in processor (rather than reader). However, load data into payload cache is not implemented yet. By implementing this feature, we also need to remove old DataPack methods such set_text and set_audio as it's outdated. DataPack should supports multiple Payloads with different Modality.

It's also part of #810

Describe the solution you'd like

  • remove Datapack.set_text and Datapack.set_audio.
  • add cache assignment in Payload.load

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context

@hepengfe hepengfe added topic: data Issue about data loader modules and data processing related topic: ontology All issues related to ontologies in core, top and base_ontology labels Jun 10, 2022
@hepengfe hepengfe added this to the 0.3 stable version milestone Jun 10, 2022
@hepengfe hepengfe self-assigned this Jun 10, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
topic: data Issue about data loader modules and data processing related topic: ontology All issues related to ontologies in core, top and base_ontology
Projects
None yet
Development

No branches or pull requests

1 participant