Automated Labeling of PDF Mathematical Exercises with Word N-Grams VSM Classification

Autor/inn/en	Yamauchi, Taisei; Flanagan, Brendan; Nakamoto, Ryosuke; Dai, Yiling; Takami, Kyosuke; Ogata, Hiroaki
Titel	Automated Labeling of PDF Mathematical Exercises with Word N-Grams VSM Classification
Quelle	In: Smart Learning Environments, 10 (2023), Artikel 51 (30 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Flanagan, Brendan)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
DOI	10.1186/s40561-023-00271-9
Schlagwörter	Mathematics Instruction; Classification; Algorithms; Barriers; Computer Assisted Instruction; Artificial Intelligence; Learning Analytics; Prediction; Computer Software; Task Analysis; Metadata + Suchen Sie Ihr Suchwort? Mathematics lessons; Mathematikunterricht; Classification system; Klassifikation; Klassifikationssystem; Algorithm; Algorithmus; Computer based training; Computerunterstützter Unterricht; Künstliche Intelligenz; Vorhersage; Aufgabenanalyse; Metadaten
Abstract	In recent years, smart learning environments have become central to modern education and support students and instructors through tools based on prediction and recommendation models. These methods often use learning material metadata, such as the knowledge contained in an exercise which is usually labeled by domain experts and is costly and difficult to scale. It recognizes that automated labeling eases the workload on experts, as seen in previous studies using automatic classification algorithms for research papers and Japanese mathematical exercises. However, these studies didn't delve into fine-grained labeling. In addition to that, as the use of materials in the system becomes more widespread, paper materials are transformed into PDF formats, which can lead to incomplete extraction. However, there is less emphasis on labeling incomplete mathematical sentences to tackle this problem in the previous research. This study aims to achieve precise automated classification even from incomplete text inputs. To tackle these challenges, we propose a mathematical exercise labeling algorithm that can handle detailed labels, even for incomplete sentences, using word n-grams, compared to the state-of-the-art word embedding method. The results of the experiment show that mono-gram features with Random Forest models achieved the best performance with a macro F-measure of 92.50%, 61.28% for 24-class labeling and 297-class labeling tasks, respectively. The contribution of this research is showing that the proposed method based on traditional simple n-grams has the ability to find context-independent similarities in incomplete sentences and outperforms state-of-the-art word embedding methods in specific tasks like classifying short and incomplete texts. (As Provided).
Anmerkungen	Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01