Rylan Schaeffer

Logo
Resume
Research
Learning
Blog
Teaching
Jokes
Kernel Papers


7 August 2021

How many observations is one generic worth?

by Tessler, Bridgers, Tenenbaum (CogSci 2020)

Background

In a previous paper, the authors posited that the generic construct in language is equivalent to an observation and used this equivalence to model human concept learning via language as Bayesian belief updating (albeit with generics rather than observations). In this paper, the authors seek to titrate how effective a single generic is at communicating a concept. This also relates to how flexible generics can be; for instance, the three following generics have different prevalence.

One motivating reason to think that a generic utterance is more impactful than an observation is that if the utterance comes from an informed, well-intentioned partner, then the utterance is equivalent to the purest observation possible, as opposed to some noisy/ambiguous observation.

Research Questions

What is the exchange rate between 1 generic (e.g. “Feps have white wings”) and observations (e.g. 3 pictures of Feps)?

Experiment 1

Humans participants are tasked to learn novel categories from examples, generic language or a combination of both. There are 10 conditions. 8 of the conditions are formed from the cross product of how many examples (1, 2, 3, or 4) and whether the examples are pedagogical or accidental. The remaining two conditions are either a generic utterance, or a generic utterance with a single pedagogical example. The figure below shows 3 of the 10 conditions: (A) three pedagogical examples, (B) one accidental example, (C) one generic utterance with a single pedagogical example.

Experiment 2

One problem with the previous experiment is that in the examples, the feature that will be generalized (e.g. wing color) is not explicitly individuated. For instance, the cursor would point to the wing of the Fep, but that leaves ambiguity about the exact feature being pedagogically highlighted or accidentally observed. Consequently, the authors ran the experiment again with more explicit labeling of the feature e.g. “The wings are white”

Results

tags: cultural-learning - cultural-ratchet - natural-language-processing