Projects

Kazakh Named Entity Recognition

KazNERD is the largest publicly available dataset for Kazakh named entity recognition. The dataset was built as there is a clear need for publicly available annotated corpora in Kazakh, as well as annotation guidelines containing straightforward–but rigorous–rules and examples. The dataset annotation, based on the IOB2 scheme, was carried out on television news text by two native Kazakh speakers under the supervision of the first author. The resulting dataset contains 112,702 sentences and 136,333 annotations for 25 entity classes. State-of-the-art machine learning models to automatise Kazakh named entity recognition were also built, with the best-performing model achieving an exact match F1-score of 97.22% on the test set.

The annotated dataset, guidelines, and codes used to train the models are freely available for download under the CC BY 4.0 licence from https://github.com/IS2AI/KazNERD .

If you use KazNERD for research, ISSAI requests that the original paper be cited as follows:

Rustem Yeshpanov, Yerbolat Khassanov, and Huseyin Atakan Varol. 2022. KazNERD: Kazakh Named Entity Recognition Dataset. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 417–426, Marseille, France. European Language Resources Association.

If you use KazNERD for commercial purposes, ISSAI requests that this statement to your product or service be added:

Our product uses ISSAI KazNERD (https://aclanthology.org/2022.lrec-1.44), which is available under a Creative Commons Attribution 4.0 International License.

0 / 1000

Named Entity Classes:

  • ADAGE - Well-known Kazakh proverbs and sayings.
  • ART - Titles of books, songs, television programmes, etc.
  • CARDINAL - Cardinal numbers, including whole numbers, fractions, and decimals.
  • CONTACT - Addresses, emails, phone numbers, URLs.
  • DATE - Dates or periods of hours or more.
  • DISEASE - Diseases or medical conditions.
  • EVENT - Named events and phenomena.
  • FACILITY - Names of man-made structures.
  • GPE - Names of geopolitical entities.
  • LANGUAGE - Named languages.
  • LAW - Named legal documents.
  • LOCATION - Names of geographical locations other than GPEs.
  • MONEY - Monetary values.
  • NORP - Adjectival forms of GPE and LOCATION; named religions, etc.
  • NON_HUMAN - Names of pets, animals or non-human creatures.
  • ORDINAL - Ordinal numbers, including adverbials.
  • ORGANISATION - Names of companies, government agencies, etc..
  • PERCENTAGE - Percentages.
  • PERSON - Names of persons.
  • POSITION - Names of posts and job titles.
  • PRODUCT - Names of products.
  • PROJECT - Names of projects, policies, plans, etc.
  • QUANTITY - Length, distance, etc. measurements.
  • TIME - Times of day and time duration less than hours.
  • MISCELLANEOUS - Entities of interest but hard to assign a proper tag to.

GitHub icon
Powered by GitHub