Рад у часопису

објављена верзија

енглески

Ranka Stanković, Mihailo Škorić, Branislava Šandrih Todorović

Parallel Bidirectionally Pretrained Taggers as Feature Generators

Applied Sciences

MDPI AG

2022

In a setting where multiple automatic annotation approaches coexist and advance separately but none completely solve a specific problem, the key might be in their combination and integration. This paper outlines a scalable architecture for Part-of-Speech tagging using multiple standalone annotation systems as feature generators for a stacked classifier. It also explores automatic resource expansion via dataset augmentation and bidirectional training in order to increase the number of taggers and to maximize the impact of the composite system, which is especially viable for low-resource languages. We demonstrate the approach on a preannotated dataset for Serbian using nested cross-validation to test and compare standalone and composite taggers. Based on the results, we conclude that given a limited training dataset, there is a payoff from cutting a percentage of the initial training set and using it to fine-tune a machine-learning-based stacked classifier, especially if it is trained bidirectionally. Moreover, we found a measurable impact on the usage of multiple tagsets to scale-up the architecture further through transfer learning methods.

12

10

10.3390/app12105028

2076-3417

анотација, обрада природног језика, издвајање обележја, композитне структуре, врста речи

annotation, natural language processing, feature extraction, composite structures, part of speech

https://www.mdpi.com/2076-3417/12/10/5028/pdf

M20

М22

Отворени приступ

All rights reserved

.pdf