Pedagogy Benchmark

AI models do well at student exams, but do they know about pedagogy and helping students learn? We made The Pedagogy Benchmark to see if AI models can pass teacher exams.

In education, it's important to make a distinction between content knowledge and pedagogical knowledge (how to teach). Existing benchmarks predominantly focus on content knowledge, leaving a critical gap in assessing models' understanding of pedagogy — the method and practice of teaching.

We developed the Pedagogy Benchmark using a carefully curated set of questions sourced from the Chilean Ministry of Education's professional development exams for teachers, which cover a range of pedagogical subdomains such as teaching strategies and assessment methods.

Science (Pre-primary)

At a preschool level, the educational team needs to evaluate in everyday contexts the following learning objective from the Natural Environment Exploration core: "Communicate some basic properties of the natural elements they explore, such as colours, textures, sizes, temperatures among others". Which performance of the children would demonstrate the achievement of the selected learning objective?

1. During a learning experience, Santiago draws stones of different sizes
2. During lunchtime, Pablo looks at the spoon and seeing his reflection says: "Look, Pablo!"
3. During an experience in the yard, Maria collects different types of tree leaves in a basket
4. During free play time in the yard, Soledad rubs some seeds in her hands and says: "Prickly"

Correct answer: 4

Social Studies (Primary)

According to the following objective: "Read simple plans of your environment, using reference points and categories of relative position," what activities are most appropriate to evaluate it in Year 2?

1. Draw a plan of the classroom
2. Interpret the symbols of a city plan
3. Describe the location of places on a given map
4. Determine the coordinates of given points on a grid

Correct answer: 3

General (Secondary)

According to Bowlby's theory, which of the following statements corresponds to a characteristic of attachment?

1. It is a process that lasts until the early years of life
2. It is a bond that must be stable and continuous to ensure proper development
3. It is a bond that determines all affective relationships in life and development
4. It is the first relationship of the newborn with its mother and cannot be replaced by another person

Correct answer: 2