Towards automatic essay scoring of Basque language texts from a rule-based approach based on curriculum-aware systems

Jose Maria Arriola, Mikel Iruskieta, Ekain Arrieta, Jon Alkorta


Abstract
Although the Basque Education Law mentions that students must finish secondary compulsory education at B2 Basque level and their undergraduate studies at the C1 level, there are no objective tests or tools that can discriminate between these levels. This work presents the first rule-based method to grade written Basque learner texts. We adapt the adult Basque learner curriculum based on the CEFR to create a rule-based grammar for Basque. This paper summarises the results obtained in different classification tasks by combining information formalised through CG3 and different machine learning algorithms used in text classification. Besides, we perform a manual evaluation of the grammar. Finally, we discuss the informa- tiveness of these rules and some ways to further improve assisted text grading and combine rule-based approaches with other approaches based on readability and complexity measures.
Anthology ID:
2023.nodalida-cgmta.4
Volume:
Proceedings of the NoDaLiDa 2023 Workshop on Constraint Grammar - Methods, Tools and Applications
Month:
May
Year:
2023
Address:
Tórshavn, Faroe Islands
Editors:
Eckhard Bick, Trond Trosterud, Tanel Alumäe
Venue:
WS
SIG:
Publisher:
Association of Computational Linguistics
Note:
Pages:
20–28
Language:
URL:
https://aclanthology.org/2023.nodalida-cgmta.4
DOI:
Bibkey:
Cite (ACL):
Jose Maria Arriola, Mikel Iruskieta, Ekain Arrieta, and Jon Alkorta. 2023. Towards automatic essay scoring of Basque language texts from a rule-based approach based on curriculum-aware systems. In Proceedings of the NoDaLiDa 2023 Workshop on Constraint Grammar - Methods, Tools and Applications, pages 20–28, Tórshavn, Faroe Islands. Association of Computational Linguistics.
Cite (Informal):
Towards automatic essay scoring of Basque language texts from a rule-based approach based on curriculum-aware systems (Arriola et al., 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.nodalida-cgmta.4.pdf