Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Payload Implementation #828

Merged
merged 147 commits into from
Jun 30, 2022
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
147 commits
Select commit Hold shift + click to select a range
bad351f
add payloads and its basic operations in DataStore and DataPack
hepengfe Jun 8, 2022
3adfbef
Merge branch 'master' of https:/feipenghe/forte into payload
hepengfe Jun 8, 2022
9964029
docstring fix
hepengfe Jun 8, 2022
41a1d44
add implementation of payload with interface for users writing their …
hepengfe Jun 8, 2022
c72bf60
minor fix
hepengfe Jun 8, 2022
4da6791
Merge branch 'master' into payload
hepengfe Jun 8, 2022
0f9993c
add audio payload test example
hepengfe Jun 8, 2022
8ab7033
Merge branch 'payload' of https:/feipenghe/forte into pay…
hepengfe Jun 8, 2022
a3b42dd
move SoundfileAudioPayload out
hepengfe Jun 8, 2022
84e2d62
add Meta
hepengfe Jun 9, 2022
e26560f
add the logic of adding meta
hepengfe Jun 9, 2022
7fa2428
add more meta adding in DataStore
hepengfe Jun 9, 2022
520163b
rewrite audio reader and processor to adapt the new Payload design
hepengfe Jun 10, 2022
9e67de2
new Payload stores loading_function and loading_path and add Meta cla…
hepengfe Jun 10, 2022
3bb940e
temporarily import Meta inside the class as there is another Meta cla…
hepengfe Jun 10, 2022
4fcc72b
remove import Meta inside DataPack class
hepengfe Jun 10, 2022
8b647e9
no changes
hepengfe Jun 10, 2022
3a9e0c7
allow users to pass None to pack so that Entry won't be added to Data…
hepengfe Jun 10, 2022
a30fb81
pass None as pack to AudioProcessingMeta so that AudioProcessingMeta …
hepengfe Jun 10, 2022
4eafd16
remove Meta importing
hepengfe Jun 10, 2022
d0f0939
pylint fix: fix imports
hepengfe Jun 10, 2022
35a97d3
make Payload class variables private
hepengfe Jun 10, 2022
19afb61
remove initialized DataPack
hepengfe Jun 10, 2022
7a92b28
Delete payload_test.py
hepengfe Jun 10, 2022
cec1a22
new cache and meta for payload
hepengfe Jun 13, 2022
15009fd
new reader test based on code changes
hepengfe Jun 13, 2022
c2b61db
pass reader configs(reading method) to AudioPayload and AudioReadingMeta
hepengfe Jun 13, 2022
e2d8a7a
parse reading configs into a reading function
hepengfe Jun 13, 2022
309c102
reconstruct reading meta which is bound to payload
hepengfe Jun 13, 2022
1777c9e
rewrite set text function and set audio function
hepengfe Jun 14, 2022
0f0fd75
clean up unnecessary class variables and add TextReadingMeta
hepengfe Jun 15, 2022
9ded0d7
test ImagePayload
hepengfe Jun 15, 2022
96acb05
get_single with payload index
hepengfe Jun 15, 2022
e9ac305
keep reading meta in the payload
hepengfe Jun 15, 2022
8e6e8a5
initialize metadata in payload
hepengfe Jun 15, 2022
528a789
ReadingMeta datastore
hepengfe Jun 15, 2022
0dbba66
remove meta_name
hepengfe Jun 15, 2022
595a6b4
payload_index -> entry_index
hepengfe Jun 15, 2022
9644b64
docstring for get_single
hepengfe Jun 15, 2022
55d4e0a
add payload ontology
hepengfe Jun 15, 2022
d456417
remote text, audio property and get_image_array function and remove R…
hepengfe Jun 16, 2022
9196099
remove payload ontology
hepengfe Jun 16, 2022
4bc7917
remove ReadingMeta
hepengfe Jun 16, 2022
a0d30c2
remove reading meta
hepengfe Jun 16, 2022
e83a633
add enum modality
hepengfe Jun 16, 2022
34f5f3a
payload cache
hepengfe Jun 16, 2022
6b88c39
add docstring for payload_index
hepengfe Jun 16, 2022
9dacad2
payload_index docstring
hepengfe Jun 16, 2022
d18b8b4
add docstring for payload related functions
hepengfe Jun 16, 2022
20e943f
remove unused method
hepengfe Jun 16, 2022
406b659
get_payload_at() and DataPack.payloads of three modalities
hepengfe Jun 17, 2022
c854b46
remove payloads of different modalities
hepengfe Jun 17, 2022
5d225f8
AudioReadingMeta -> Generics
hepengfe Jun 17, 2022
3e13c9d
add payload ontologies of three modalities
hepengfe Jun 17, 2022
aa275e3
update generated base ontology classes
hepengfe Jun 17, 2022
e0bb7b7
DataPack.audio -> pack.get_payload_data_at(audio, 0)
hepengfe Jun 17, 2022
841f318
DataPack.audio -> input_pack.get_payload_at(audio, 0)
hepengfe Jun 17, 2022
0389a59
adapt Modality parameter and audio -> get_payload_at(audio) in tests/…
hepengfe Jun 17, 2022
dd8b593
add payload operations in data store
hepengfe Jun 17, 2022
64ae4d8
add enum
hepengfe Jun 17, 2022
6b4c54a
get around an no-key-found issue with conditional popping state key
hepengfe Jun 17, 2022
156a924
add modality imports in forte.data init
hepengfe Jun 17, 2022
e2ac2f7
import IntEnum
hepengfe Jun 17, 2022
7ce6676
update text operation based on TextPayload
hepengfe Jun 17, 2022
0baeb1b
Payload serialization function
hepengfe Jun 17, 2022
39d663c
Payload DataStore
hepengfe Jun 17, 2022
10a942f
import Modality
hepengfe Jun 17, 2022
2277b17
payload ontology json
hepengfe Jun 17, 2022
72ce2e1
payload ontology classes
hepengfe Jun 17, 2022
960699b
remove Modality import
hepengfe Jun 17, 2022
1609a7b
revert changes in tests/forte/data/readers/audio_reader_test.py
hepengfe Jun 17, 2022
069dd76
update grid tests based on the new Payload
hepengfe Jun 17, 2022
1a47ef6
update test based on new Payload for tests/forte/image_annotation_tes…
hepengfe Jun 17, 2022
451e085
update generics count due to its function as Payload Meta data
hepengfe Jun 17, 2022
e26b37a
modality class
hepengfe Jun 17, 2022
97d3925
revert changes in get_single()
hepengfe Jun 18, 2022
f5d44c2
revert changes in get_single()
hepengfe Jun 18, 2022
f8a0ef6
pylint fix
hepengfe Jun 20, 2022
cd26081
pylint
hepengfe Jun 20, 2022
544a808
pylint
hepengfe Jun 20, 2022
e716868
pylint
hepengfe Jun 20, 2022
1496b40
pylint
hepengfe Jun 20, 2022
32e770b
pylint
hepengfe Jun 20, 2022
f71782d
pylint
hepengfe Jun 20, 2022
07a4ab2
mypy
hepengfe Jun 20, 2022
4e7cac5
update base ontology
hepengfe Jun 20, 2022
90c66f1
pylint
hepengfe Jun 20, 2022
10f2b14
remove enum installation as it's built-in
hepengfe Jun 21, 2022
94f180f
fix doc build
hepengfe Jun 21, 2022
259a9a5
fix spelling
hepengfe Jun 21, 2022
871e02c
add enum34
hepengfe Jun 21, 2022
eff96fc
remove meta data for payloads
hepengfe Jun 21, 2022
8ba49f7
revert empty ontology initialization change
hepengfe Jun 21, 2022
628887b
adjust generics count and testing state.pop(_entry__pack)
hepengfe Jun 21, 2022
a127d86
Merge branch 'master' into payload
hepengfe Jun 22, 2022
0fc42be
temporary fix
hepengfe Jun 22, 2022
c62f6e7
remove unused Generics
hepengfe Jun 22, 2022
f6c3863
capitalize first character in Enum
hepengfe Jun 24, 2022
3215179
Merge branch 'payload' of https:/feipenghe/forte into pay…
hepengfe Jun 24, 2022
90aa217
fix docstring for text() and change modality from str format to IntEnum
hepengfe Jun 24, 2022
1596a6f
change modality from str format to IntEnum
hepengfe Jun 24, 2022
16a05df
change modality from str format to IntEnum
hepengfe Jun 24, 2022
95f2e66
change modality from str format to IntEnum
hepengfe Jun 24, 2022
fd7558b
change modality from str format to IntEnum
hepengfe Jun 24, 2022
b6f7bde
change modality from str format to IntEnum
hepengfe Jun 24, 2022
9e89f06
change modality from str format to IntEnum
hepengfe Jun 24, 2022
6e4aa81
correct text function
hepengfe Jun 24, 2022
f139333
Merge branch 'master' into payload
hepengfe Jun 24, 2022
0595676
entry converter with payload support
hepengfe Jun 24, 2022
861f37c
cutomized payload serialization function
hepengfe Jun 24, 2022
101111f
add_payload_raw
hepengfe Jun 27, 2022
79c062f
remove extra parameter Modality
hepengfe Jun 27, 2022
369e2c2
cast entry to Payload
hepengfe Jun 27, 2022
808ada0
list to sequence
hepengfe Jun 27, 2022
4d1982c
remove extra paramater Modality
hepengfe Jun 27, 2022
b514bee
datapack.set_Text
hepengfe Jun 27, 2022
25cdeaa
remove extra imports
hepengfe Jun 27, 2022
85b52fc
remove extra paramter modality
hepengfe Jun 27, 2022
0c40f8b
remove modality paramter
hepengfe Jun 27, 2022
2eac83f
remove duplication check for payload
hepengfe Jun 27, 2022
be4c98c
improve docstring for payload
hepengfe Jun 27, 2022
6f40557
new ontology
hepengfe Jun 27, 2022
801b666
set Payload._modality based on Payload class type
hepengfe Jun 27, 2022
8ddfd63
remove set_cache not needed
hepengfe Jun 27, 2022
98df201
set_cache -> set_audio
hepengfe Jun 27, 2022
2c8e7d9
change self.device back
hepengfe Jun 27, 2022
41bfd87
set_audio(audio_data, sample_rate)
hepengfe Jun 27, 2022
e65587c
get_payload_data -> self.text
hepengfe Jun 27, 2022
0038c71
Merge branch 'master' into payload
hepengfe Jun 27, 2022
dd9839d
fix modality
hepengfe Jun 27, 2022
5b5b304
Merge branch 'payload' of https:/feipenghe/forte into pay…
hepengfe Jun 27, 2022
d427c8a
Merge branch 'master' into payload
hepengfe Jun 27, 2022
42928d8
get_modality -> modality property
hepengfe Jun 29, 2022
1ae7282
add_entry_raw for Payload
hepengfe Jun 29, 2022
53bc5b1
remove unused imports
hepengfe Jun 29, 2022
5aa6be0
remove modality parameter in ImagePayload
hepengfe Jun 29, 2022
c225b42
Revert "remove modality parameter in ImagePayload"
hepengfe Jun 29, 2022
1051558
Merge branch 'master' into payload
hepengfe Jun 29, 2022
10ff586
correct ontology files
hepengfe Jun 29, 2022
a68445d
revert base back changes
hepengfe Jun 29, 2022
7102b3e
kept base_pack.py unchanged
hepengfe Jun 29, 2022
2a92023
correct docstring
hepengfe Jun 29, 2022
69676ca
revert changes in unrelevant file
hepengfe Jun 29, 2022
1f8f8ed
revert metric.py changes
hepengfe Jun 29, 2022
453dcc0
remove unused import
hepengfe Jun 29, 2022
e1fe2bf
remove unused textpayload
hepengfe Jun 29, 2022
6758f76
revert changes in audio reader
hepengfe Jun 29, 2022
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions forte/data/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -20,3 +20,4 @@
from forte.data.data_store import *
from forte.data.selector import *
from forte.data.index import *
from forte.data.modality import *
Loading