Parallel Bidirectionally Pretrained Taggers as Feature Generators

Објеката

Тип
Рад у часопису
Верзија рада
објављена верзија
Језик
енглески
Креатор
Ranka Stanković, Mihailo Škorić, Branislava Šandrih Todorović
Извор
Applied Sciences
Издавач
MDPI AG
Датум издавања
2022
Сажетак
In a setting where multiple automatic annotation approaches coexist and advance separately but none completely solve a specific problem, the key might be in their combination and integration. This paper outlines a scalable architecture for Part-of-Speech tagging using multiple standalone annotation systems as feature generators for a stacked classifier. It also explores automatic resource expansion via dataset augmentation and bidirectional training in order to increase the number of taggers and to maximize the impact of the composite system, which is especially viable for low-resource languages. We demonstrate the approach on a preannotated dataset for Serbian using nested cross-validation to test and compare standalone and composite taggers. Based on the results, we conclude that given a limited training dataset, there is a payoff from cutting a percentage of the initial training set and using it to fine-tune a machine-learning-based stacked classifier, especially if it is trained bidirectionally. Moreover, we found a measurable impact on the usage of multiple tagsets to scale-up the architecture further through transfer learning methods.
том
12
издање
10
doi
10.3390/app12105028
issn
2076-3417
Subject
анотација, обрада природног језика, издвајање обележја, композитне структуре, врста речи
annotation, natural language processing, feature extraction, composite structures, part of speech
Шира категорија рада
M20
Ужа категорија рада
М22
Права
Отворени приступ
Лиценца
All rights reserved
Формат
.pdf
Медија
applsci-12-05028.pdf

Ranka Stanković, Mihailo Škorić, Branislava Šandrih Todorović. "Parallel Bidirectionally Pretrained Taggers as Feature Generators" in Applied Sciences, MDPI AG (2022). https://doi.org/10.3390/app12105028

This item was submitted on 16. мај 2022. by [anonymous user] using the form “Рад у часопису” on the site “Радови”: http://drug.rgf.bg.ac.rs/s/repo

Click here to view the collected data.