Constructing a Norm for Children’s Scientific Drawing: Distribution Features Based on Semantic Similarity of Large Language Models
摘要: 利用儿童画了解儿童的概念认知已被证实是一种较为有效的方法,但既往的研究存在两大问题:1.绘画内容严重依赖于任务,结论生态效度低;2.对于绘画解释主观性过强。为了解决这一问题,本研究基于大语言模型(LLM)识别 1420 张儿童科学绘画(涵盖 9 个科学概念)的绘画内容,并利用 word2vec 算法计算其语义相似度,探究了同一主题儿童是否存在一致性的绘画表示,从而尝试建立儿童科学绘画的常模,为相关儿童画研究提供一个基线参照系。结果显示,儿童表示不同概念的一致性有较大差异,且存在一致性偏差的可能,即出现趋同的错误表示导致误导了 LLM。同时利用肯德尔秩相关系数(Kendall-𝜏)分析了影响儿童表示的相关因素。结果发现正确率是一个最敏感的指标,样本量、语义相似度等数据都与其相关;同样,概念含有的推理成分的多寡也是一个重要的相关因素。另外,大部分儿童倾向于利用课堂上见过的样例来表示较为抽象的概念,表明儿童可能需要具象样例来理解抽象概念。
Abstract: Using children’s drawings to understand children’s concept learning has been proven to be an effective method, but there are still two major problems in previous research: 1. The drawings heavily relies on the task, so the ecological validity of the conclusions is low; 2. The subjective interpretation of drawings is inevitable. To address these problems, this study uses the Large Language Model (LLM) to identify the drawing contents of 1096 children’s scientific drawings (covering 6 scientific concepts), and uses the word2vec algorithm to calculate their semantic similarity. The study explores whether there are consistent drawing representations among children with the same theme, and attempts to establish a norm for children’s scientific drawings, providing a baseline reference for following children’s drawing research. The results showed that there were significant differences in the consistency of children’s representations of different concepts, and there was a possibility of consistency bias, that is, the appearance of consistency representations misled LLM. At the same time, linear regression tests were used to analyze the relevant factors that affect children’s representation. The results show that sample size and teaching strategies can affect the accuracy of LLM’s image recognition, while the degree of conceptual abstraction may affect the consistency of representation.
[V1] | 2025-03-03 18:10:55 | PSSXiv:202503.00115V1 | 下载全文 |
1. 教师支持对高中生数学学业复原力的建构路径研究一一基于应对方式与焦虑的链式中介分析 | 2025-04-25 |
2. 短时正念练习对青少年注意子系统的差别化影响 | 2025-04-03 |
3. 空间映射论:物质与意识的和谐共生 | 2025-04-07 |
4. 意识宇宙论:人类科学发展与精神信仰的灯塔 | 2025-04-07 |
5. 意识本源论:意识的本质探寻与进化轨迹 | 2025-04-07 |