您当前的位置:首页 > 论文详情

构建儿童科学绘画的常模:基于大语言模型语义相似性的分布特征

Constructing a Norm for Children’s Scientific Drawing: Distribution Features Based on Semantic Similarity of Large Language Models

摘要: 利用儿童画了解儿童的概念认知已被证实是一种较为有效的方法,但既往的研究存在两大问题:1.绘画内容严重依赖于任务,结论生态效度低;2.对于绘画解释主观性过强。为了解决这一问题,本研究基于大语言模型(LLM)识别 1420 张儿童科学绘画(涵盖 9 个科学概念)的绘画内容,并利用 word2vec 算法计算其语义相似度,探究了同一主题儿童是否存在一致性的绘画表示,从而尝试建立儿童科学绘画的常模,为相关儿童画研究提供一个基线参照系。结果显示,儿童表示不同概念的一致性有较大差异,且存在一致性偏差的可能,即出现趋同的错误表示导致误导了 LLM。同时利用肯德尔秩相关系数(Kendall-𝜏)分析了影响儿童表示的相关因素。结果发现正确率是一个最敏感的指标,样本量、语义相似度等数据都与其相关;同样,概念含有的推理成分的多寡也是一个重要的相关因素。另外,大部分儿童倾向于利用课堂上见过的样例来表示较为抽象的概念,表明儿童可能需要具象样例来理解抽象概念。

Abstract: Using children’s drawings to understand children’s concept learning has been proven to be an effective method, but there are still two major problems in previous research: 1. The drawings heavily relies on the task, so the ecological validity of the conclusions is low; 2. The subjective interpretation of drawings is inevitable. To address these problems, this study uses the Large Language Model (LLM) to identify the drawing contents of 1096 children’s scientific drawings (covering 6 scientific concepts), and uses the word2vec algorithm to calculate their semantic similarity. The study explores whether there are consistent drawing representations among children with the same theme, and attempts to establish a norm for children’s scientific drawings, providing a baseline reference for following children’s drawing research. The results showed that there were significant differences in the consistency of children’s representations of different concepts, and there was a possibility of consistency bias, that is, the appearance of consistency representations misled LLM. At the same time, linear regression tests were used to analyze the relevant factors that affect children’s representation. The results show that sample size and teaching strategies can affect the accuracy of LLM’s image recognition, while the degree of conceptual abstraction may affect the consistency of representation.

版本历史

[V1] 2025-03-03 18:10:55 PSSXiv:202503.00115V1 下载全文
点击下载全文
在线阅读
许可声明
metrics指标
  •  点击量81
  •  下载量17
  • 评论量 0
评论
分享
邀请专家评阅
收藏