Temple of Two
← Instruments

Study

Phase-Modulated Attention

A 176M hybrid SSM-attention model where Kuramoto oscillators modulate attention routing.

StudyPublishedSupported within scope

176M params · entropy regime switching

The question
Oscillators are everywhere in biological commitment. Do they do anything causal in an artificial one, or do they just ride along?
The instrument
Kuramoto oscillators placed in the attention routing path of a 176M hybrid SSM-attention language model, with system-prompt framing as the manipulated variable.
The finding
System prompt framing induces attention-dependent entropy regime switching. Placement is the variable that matters: oscillators must gate information flow, not accompany it.
What failed
The liminal K-SSM. Oscillators in hidden state turned out to be epiphenomenal — beautiful dynamics, no effect on the language model. That negative result is what located the causal entry point for this one.
Standing
StudyPublishedSupported within scope
Verify it
DOI 10.5281/zenodo.18810911 ↗Repository ↗

Metrics with scope

Every number names what was measured, on what sample, and as of when.

  • Model size

    176M

    Hybrid SSM-attention architecture, trained from scratch

    As of 2026-02-28 · source

  • Prior negative result

    K-SSM epiphenomenal

    Oscillators in hidden state; published rather than discarded

    As of 2026-02-28

From wonder to receipt

Phase-Modulated Attention

Wonder initiated the search. Rigor changed the answer.

StudyPublishedSupported within scope
  1. 01Wonder

    Oscillators govern commitment everywhere in biology. Does rhythm do any real work inside an artificial system, or does it just look like it should?

  2. 02Hypothesis

    If Kuramoto coupling is causal rather than decorative, oscillators placed in the attention routing path should change model behaviour where oscillators in hidden state did not.

  3. 03Instrument

    A 176M hybrid SSM-attention language model with Kuramoto oscillators modulating attention routing, and system-prompt framing as the manipulated variable.

  4. 04Encounter

    Attention-dependent entropy regime switching. Placement was the variable: the liminal K-SSM had put oscillators in hidden state and found them epiphenomenal.

  5. 05Standing

    Supported within scope, and standing on a published negative result. Without the K-SSM failure there would have been no reason to look at routing.

  6. 06Receipt

    DOI 10.5281/zenodo.18810911 · phase-modulated-attention

DOI 10.5281/zenodo.18810911 ↗Repository ↗