← Reflective Self-Models

The MIND · R4 video

When does a self-model help?

A robot asks for left and gets right. Follow how a controller uses evidence about its own changing machinery—and what this finite pilot can tell us about self-models.

11:12 · English captions · Third video draft · Synthetic narration

The paper behind the video

When Does an Explicit Self-Model Help? Calibration and Control under Internal Change in a Finite-State Pilot

The explicit, compiled, and external trackers use the same calculation. The supplied gains over two restricted rules concern evidence use; this comparison gives the self-model label no extra measured benefit. It does not establish subjective awareness.

Review draft with stock synthetic narration. The paper reports an inherited finite benchmark; the diagrams explain that model rather than depict a physical robot experiment.

Chapters

Transcript

0:00 · A command, a surprise

Imagine a robot trying to steer. Its controller chooses what to do and sends a command: turn left. The actuator turns that command into movement. But the observed output is a wheel turning right.

Compare that with the target: turn left. The observed movement missed the target. Was this a one-off error, or have the controls reversed? The controller needs evidence to tell those possibilities apart.

0:32 · Being, Becoming, and a changing description

A snapshot of the robot tells us how its controls are configured now. Following it through time tells us how that configuration changes. The controls might be normal, then become reversed. These two views, what is and what changes, are what we mean here by Being and Becoming.

Keep two things separate. There is the actuator's actual condition. And there is the controller's estimate of that condition. The controls can change before the estimate catches up. New evidence can also correct an estimate when the controls have not changed.

So the small question here is how a system can keep a useful description of its own changing machinery. A larger question is whether that tells us anything about self-awareness. We will return to that after seeing exactly what this study tests.

1:29 · Make the task small enough to inspect

The paper uses a toy model, not a physical robot. There are three successive actions. Each command has two possibilities, which we can picture as left and right. Normal controls usually preserve the command; reversed controls usually swap it. Random errors can also affect a movement.

Before acting, the controller gets three preliminary checks, called calibration probes. They can be wrong, so the controller starts with an uncertain estimate. Before the second action, there is a one-in-four chance of a reversal. If it happens, it lasts through the third action.

The target is chosen separately. The controller compares its command with the actual output: did they agree or point opposite ways? In this model that gives a noisy clue specifically about the actuator. Real-world causes can be harder to separate.

2:29 · What feedback and a Bayesian update do

Follow the loop. The controller chooses a command. The actuator produces an output. Information about that output comes back. The controller uses it to revise its estimate before choosing another command. That return of information is feedback.

Bayesian updating is one particular way to use that feedback. It keeps possible explanations in play and asks: how likely is the new clue under each possibility? It combines that evidence with what earlier observations already supported.

Here is one example from the paper. Three noisy checks leave the controller with eighty percent probability for normal controls and twenty percent for reversed. These are estimates of the controls, not the chance that the next action succeeds.

Now the first action's output agrees with its command. We observed one agreement. The model predicts an agreement nine times out of ten if the controls are normal, but only one time out of ten if they are reversed. Those are the chances of seeing this same clue under the two possibilities, not two more observations. This clue gives more support to normal controls.

Watch where the new weights come from. For normal controls, take eighty from the prior estimate and multiply by the agreement chance, point nine. That gives seventy-two. For reversed controls, twenty times point one gives two. These weights total seventy-four. Rescale that total to one hundred percent: about ninety-seven percent normal, three percent reversed. That change is the Bayesian update.

There is a separate step before action two. The controller allows for the one-in-four chance that the controls may reverse. Its normal estimate drops to about seventy-four percent. No new observation caused that drop; it is allowing for possible change. The next action uses this revised estimate.

4:40 · Three names for the same calculation

Now we can compare the ways of describing that calculation. First, the explicit self-model: a named estimate of the controller's own actuator. Explicit means that the quantity is identified as such in the model.

Second, the compiled version. That name suggests a rule which maps an observation history to an action. Here, however, it runs exactly the same update code. A separate lookup table was not built.

Third, the external observer. The same estimate is attributed to an observer outside the controller. It gets the same relevant signals at the same time, with no communication delay or cost in this model.

Give all three the same sequence of events, and every action and probability report matches. This equality is built into the comparison. It tells us that changing the label or its assigned location cannot improve these outputs by itself.

5:48 · Two rules that use the evidence differently

The paper also compares two restricted rules. The one called periodic keeps its starting estimate throughout these three actions. It uses neither later feedback nor the known chance of reversal. Think: keep the starting estimate.

The change-point rule allows for the chance of reversal. A contradiction is an observation that conflicts with its current best guess about the controls. It counts these instead of reweighting after each observation. One contradictory observation raises the count to one. A second consecutive contradiction makes it swap the probabilities and reset the count. A confirming observation also resets the count.

That gives us five policies: the explicit self-model, compiled version, and external observer, plus the two-contradiction rule and the keep-starting-estimate rule.

All five get the same three initial checks, the same kinds of information, and feedback at the same points in time. What differs is how they use that evidence. Equality of memory and calculation costs was not established. Neither was equality of energy use and latency, or engineering effort. Equal initial checks do not mean equal total cost.

7:13 · What improved, and what did not

The reported numbers come from an existing frozen benchmark. This manuscript analyzes those results; it did not run new simulations or collect human data.

The main outcome is how often actions fail. Across the model's possible episodes, the Bayesian trio fails on about twenty-three out of every hundred actions. The two-contradiction rule fails on about twenty-seven. The keep-starting-estimate rule fails on about twenty-nine. These are model averages, not counts from a hundred physical robot tests.

So, on average, the updating trio avoids about four failures per hundred actions compared with waiting for two contradictions, and about six compared with keeping the starting estimate. In this small task, using the evidence in the full Bayesian calculation helps the controller choose commands that work. But all three versions share that gain. Calling one version a self-model gives it no additional advantage here.

The updating trio also does better on the paper's short recovery measure and on avoiding two failures after a reversal. Every rule pays for the same three initial checks. The improvement concerns these two restricted rules; it does not rank all possible change-detection methods.

The paper also scores forecasts of whether the next action will succeed. A confidently wrong forecast gets a larger penalty than a cautious wrong one. This is called a Brier score. The trio scores better, but that score alone does not show whether its stated probabilities match how often the actions actually succeed. The actions also change how predictable success is. No human feeling of confidence was measured.

9:09 · How this relates to awareness

There are different questions hiding in the word awareness. Can a system use information about what is happening around it? Can it track something about its own machinery? And does anything feel like something to that system? Keep those questions separate.

This pilot studies a narrow part of the second question. Its estimate concerns its own actuator, and helps choose commands. That fits the paper's minimal functional definition of a self-model. It does not establish a sense of identity, reflection on oneself, or subjective experience.

Nor does the result show that explicit self-models never help. It shows that the same working calculation succeeds under all three descriptions. The gains over the two restricted rules come from the way evidence is used. The self-model label adds no extra measured benefit here.

10:10 · Return to Being and Becoming

Return to the robot. Its controls have a condition now, and that condition can change. Observation lets the controller revise its description and use it to act. This is a small example of keeping a useful account of Being through Becoming. A changing description and a changing machine are connected, but they are not the same event.

One useful next test is to give the competing designs the same memory limit, then ask whether an explicitly organized actuator model helps with new actuator changes. The alternatives must get the same information and comparable resources. The outcome is open.

That would test what a particular self-model enables a system to do. Whether the system is aware in the sense of having an experience would remain a further question.