UnicodeDecodeError in doc.from_bytes

[atvarghese]

I created a spacy file using
byte_string = doc.to_bytes()
open(file, 'wb').write(byte_string)

However on reading the same file back using

byte_string = next(Doc.read_bytes(open(file, 'rb')))
doc = Doc(nlp.vocab)
doc.from_bytes(byte_string)

I am getting a UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc2 in position 144: invalid continuation byte

Complete Stack Trace:
doc.from_bytes(byte_string)
File "spacy/tokens/doc.pyx", line 613, in spacy.tokens.doc.Doc.from_bytes (spacy/tokens/doc.cpp:12325)
File "spacy/serialize/packer.pyx", line 129, in spacy.serialize.packer.Packer.unpack_into (spacy/serialize/packer.cpp:6258)
File "spacy/serialize/packer.pyx", line 184, in spacy.serialize.packer.Packer._char_decode (spacy/serialize/packer.cpp:7637)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc2 in position 144: invalid continuation byte

Environment
Spacy 1.7.5
OS: Ubuntu
Python: 3.5

[ines]

Closing this and making #1045 the master issue. Work in progress for spaCy v2.0!

[lock]

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.