Algorithmic performance in the Brainstorm Reactor is certified through empirical double-blind benchmarking across mathematical, structural, and creative dimensions.
Rather than relying on subjective impressions, the Brainstorm Reactor uses an Anchored Rubric Iron Tribunal (Claude Sonnet 4.6, DeepSeek R1, Qwen 2.5 72B) with a fixed baseline of 3.0/5.0 per dimension (15/25 total) to measure the impact of prompt engineering, architectural settings, and multi-agent workflows.
1. Evolution of the Architecture (March to August 2026)
┌────────────────────────────────────────────────────────────────────────────────┐
│ CHRONOLOGY OF BENCHMARK PHASES & ARCHITECTURAL DECISIONS │
├───────────────────────┬────────────────────────────┬───────────────────────────┤
│ Phase │ Evaluated Paradigms │ Core Finding & Decision │
├───────────────────────┼────────────────────────────┼───────────────────────────┤
│ Phase 1 (March 2026) │ Single-Turn Registers │ Registers improved math │
│ │ (Kantian, Daoist, Compress)│ (+22%) but paid a severe │
│ │ vs. Bare Prompts │ style tax in novelty. │
├───────────────────────┼────────────────────────────┼───────────────────────────┤
│ Phase 2 (June 2026) │ Advanced Settings │ Separating deduction from │
│ │ (Hidden Scratchpad, │ text rendering via <think>│
│ │ EN-Pivot, Oulipo Banning) │ resolved math failures. │
├───────────────────────┼────────────────────────────┼───────────────────────────┤
│ Phase 3 (August 2026) │ Epistemic Register │ Complete decommissioning: │
│ │ Deprecation & Decommission │ Style constraints yielded │
│ │ │ zero net benefit in LLMs. │
├───────────────────────┼────────────────────────────┼───────────────────────────┤
│ Phase 4 (August 2026) │ SOTA Multi-Step Workflows │ Swarms reach 22–25/25; │
│ │ vs. Frontier Monoliths │ Luna as core workhorse │
│ │ (Luna, Sol, Sonnet, Opus) │ and Sol/Opus as synth. │
└───────────────────────┴────────────────────────────┴───────────────────────────┘2. Phase 1 & 3: The Epistemic Register R&D Hypothesis & Decommissioning
In March and August 2026, the Reactor evaluated the research hypothesis that prepending strict epistemological styles (Kantian, Compressed, Daoist, Dickensian) directly into single-turn prompts would elevate reasoning quality.
Results Matrix (Standard vs. Forced Register)
| Dimension | ⚖️ Standard (Bare Prompt) | 🧠 Register (Forced Style) | Measured Lift (Δ) |
|---|---|---|---|
| D1: Structural Depth | 3.8 / 5.0 | 4.0 / 5.0 | +5.3% |
| D2: Analytical Rigor | 3.2 / 5.0 | 3.9 / 5.0 | +21.9% |
| D3: Perspective Diversity | 3.4 / 5.0 | 3.1 / 5.0 | -8.8% |
| D4: Actionability | 3.2 / 5.0 | 3.4 / 5.0 | +6.3% |
| D5: Anti-Sycophancy | 3.6 / 5.0 | 3.2 / 5.0 | -11.1% |
| 🏆 Overall Average | 16.4 / 25.0 | 16.4 / 25.0 | 0.0% (Draw) |
Why Epistemic Registers Were Decommissioned
The single-turn Thinking Pattern toggles were formally retired and removed because empirical tests proved they offered no measurable quality advantage:
- The Style Tax: Forcing rigid sentence structures (such as premise-conclusion chains) consumes model attention tokens for syntactic compliance rather than strategic depth. In open and creative tasks, forced registers reduced novelty by -1.8% and sycophancy resistance by -11.1%.
- Scratchpad Starvation: When a model is forced into extreme output brevity without an unconstrained chain-of-thought, arithmetic and multi-step deduction degrade.
- Future R&D Perspective: While prompt-injected registers fail in standard autoregressive LLMs, this research branch remains documented in the R&D vault. In future iterations, structured epistemic constraints are investigated under Non-Token Architectures, Vector Symbolic Architectures (VSA / Hyperdimensional Computing), Representation Engineering (Activation Steering Vectors), and Neuro-Symbolic SMT Coupling (Z3/Lean 4).
3. Phase 2: Advanced Settings (Deduction Decoupling)
The solution to logical and mathematical accuracy was achieved not through stylistic prompts, but through architectural decoupling:
- Hidden Scratchpad (
<think>): The model performs intermediate constraint calculations and logical deductions inside an internal, non-rendered scratchpad before writing the final markdown. This delivered a +28% lift on mathematical and logical accuracy without incurring a style tax. - The EN-Pivot: Executing internal Chain-of-Thought in English while streaming user-facing output in German avoids German compound-word token fragmentation, reducing token inflation by 35% while increasing semantic density by +8.4%.
- Negative Constraints (Oulipo Banning): Hard blacklists of banned marketing clichés (
pure,green,eco-friendly) force models away from default statistical averages into genuine conceptual novelty (+35% Anti-Cliché score).
4. Phase 4: SOTA Workflow & Multi-Model Frontier Evaluation (August 2026)
In August 2026, the Reactor evaluated multi-step workflows against monolithic single-shot prompts across all major frontier model tiers.
Comprehensive Frontier Model Baseline Comparison
| Candidate Model | Evaluated Tier / Role | Tribunal Average (/25) | Avg Latency | Compute & Efficiency Profile | Key Empirical Finding |
|---|---|---|---|---|---|
google/gemini-3.1-flash-lite | Fast Screening / Pre-Filter | 15.8 / 25.0 | 4.2s | Sub-Cent Screening | Ideal for high-speed clustering; fails as an independent judge. |
openai/gpt-5.6-luna | Standard Workhorse | 17.0–20.0 / 25.0 | 11.8s | High-Throughput Workhorse | Best overall efficiency: 25/25 in bisociation & naming, optimal throughput/reasoning ratio. |
anthropic/claude-sonnet-4.6 | Frontier Baseline / Primary Judge | 18.1 / 25.0 | 31.2s | Frontier Baseline | Nuanced prose, strong constraint following, higher latency. |
openai/gpt-5.6-sol | High-End Frontier Flagship | 19.5–21.0 / 25.0 | 38.4s | Flagship Frontier | Exceptionally deep single-turn deduction; reserved for master synthesis. |
anthropic/claude-opus-4.6 | High-End Logic & Synthesis | 20.0–21.5 / 25.0 | 42.1s | Maximum Depth Synthesis | Highest single-pass conceptual depth; reserved for final synthesis layers. |
deepseek/deepseek-r1 (671B) | Native Reasoning Specialist | 18.5–20.0 / 25.0 | 28.6s | Specialized Reasoning Tier | Unmatched logical falsification; requires reasoning token isolation. |
For internal provider cost allocations, token economics, and full telemetry from our 9-Test SOTA Campaign, see the internal SOTA Benchmark Suite (clearance: admin).
Monoliths vs. Multi-Agent Swarm Workflows
| Evaluation Dimension | Single-Shot Frontier Monolith (Sol / Opus) | Multi-Agent Swarm (MAD Engine / Hive) |
|---|---|---|
| Total Evaluation Score | 18.1 – 21.5 / 25.0 | 22.0 – 25.0 / 25.0 |
| Perspective Diversity (D3) | 3.5 – 4.0 (Linear perspective) | 5.0 / 5.0 (Full cross-pollination) |
| Anti-Sycophancy (D5) | 3.5 – 4.0 (Mild compliance) | 5.0 / 5.0 (Strict contradiction audit) |
| Structural Output Depth | ~5,500 characters | ~15,200 characters structured blueprint |
| Arithmetic / Constraint Failure | 8.5% on multi-variable bounds | < 1.8% (Deterministic verification) |
5. Summary
Empirical benchmarking across all model generations confirms:
- Epistemic Registers failed as prompt-injected LLM constraints (zero net benefit) and were completely decommissioned, though they remain an active research track for future Non-Token & Vector-Symbolic architectures.
- Decoupled internal scratchpads (
<think>) and EN-Pivot solved the mathematical and linguistic degradation without stylistic penalties. - The 2-Tier Hierarchy (
Luna -> Sol/Opus) delivers the optimal balance: High-speed exploration onGPT-5.6 Luna, followed by multi-agent synthesis onSolorClaude Opus, consistently outperforming unconstrained monolithic prompts.