-
Notifications
You must be signed in to change notification settings - Fork 0
/
CHANGES
27 lines (23 loc) · 1.07 KB
/
CHANGES
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
Version 1.1.1-devel
-------------------
Version 1.1.0 [29 Mar 17]
-------------------------
- Morphodita_parsito models (now version 3) require at least
UDPipe version 1.1.0.
- CoNLL-U v2 format is supported. Notably spaces in forms
and lemmas are now allowed, as are empty nodes.
- Support options for input_format and output_format instances.
- Preserve all spacing when tokenizing.
- Optionally generate document-level token ranges in the original text.
- Optionally respect given segmentation during tokenization.
- Tokenizer can be trained to allow spaces in tokens
(default if there are forms with spaces in the training data).
- Parser can be trained to return always one root per sentence (default).
- Improve input_format API to allow inter-block state (for correct
tracking of inter-sentence spaces and document-level offsets).
- Improve output_format API to support begin/end document marks
and to allow state in the output_format instance (to allow
numbering output sentences, for example).
Version 1.0.0 [27 May 16]
-------------------------
- Initial public release.