Natural Language Processing

There is a newer version of the record available.

Published January 17, 2022 | Version v2.2.2
Software Open

KorAP/KorAP-Tokenizer: KorAP-Tokenizer v2.2.2

Creators

Description

2.2.2

  • Bug fix: a single quotation mark at the beginning of a word is no longer interpreted as a beginning of an omission, but as quotation mark token.
  • dependencies updated
2.2.1 (unreleased)
  • "du." is no longer treated as an abbreviation.

Files

KorAP/KorAP-Tokenizer-v2.2.2.zip

Files (6.6 MB)

Name Size Download all
md5:2b3b8042547ce1804d765b7eaed1e33b
6.6 MB Preview Download

Additional details

Related works

Is supplement to
https://github.com/KorAP/KorAP-Tokenizer/tree/v2.2.2 (URL)