From Golden Gate Bridge to Broken JSON: Why Anthropic's SAE Steering Fails for Structured Output
text
From Golden Gate Bridge to Broken JSON: Why Anthropic's SAE Steering Fails for Structured Output
new_line
new_line
I ran 6 experiments trying to use Anthropic's SAE steering for JSON generation.
text
I ran 6 experiments trying to use Anthropic's SAE steering for JSON generation.
new_line
new_line
- Base model: 86.8% valid JSON
text
- Base model: 86.8% valid JSON
new_line
- Steering only: 24.4%
text
- Steering only: 24.4%
new_line
- Fine-tuned: 96.6%
text
- Fine-tuned: 96.6%
new_line
- FSM constrained: 100%
text
- FSM constrained: 100%
new_line
new_line
Steering is for semantics, not syntax.
text
Steering is for semantics, not syntax.
new_line
new_line
https://huggingface.co/blog/MaziyarPanahi/sae-steering-json
https://huggingface.co/blog/MaziyarPanahi/sae-steering-json
link
new_line
From Golden Gate Bridge to Broken JSON: Why Anthropic's SAE Steering Fails for Structured Output

I ran 6 experiments trying to use Anthropic's SAE steering for JSON generation.

- Base model: 86.8% valid JSON
- Steering only: 24.4%
- Fine-tuned: 96.6%
- FSM constrained: 100%

Steering is for semantics, not syntax.

https://huggingface.co/blog/MaziyarPanahi/sae-steering-json

👀
John6666 jeffcookio
🚀
devops724