HNHacker News·
Archived topic · source no longer tracked
PSSA: A non-transformer language model written from scratch in Rust
PSSA, a plastic state-space architecture, is a non-transformer language model written in Rust. It demonstrates superior performance compared to transformers on a held-out slice of 198,939 unseen tokens, achieving a cross-entropy of 3.997 versus 4.429, a perplexity of 54.4 versus 83.8, and a next-token accuracy of 24.1% versus 18.0%. This indicates better generalization rather than harder memorization. Contributions are welcome, particularly for kernel performance and recurrent baselines.
Time & source
Times shown in UTC
Display time zone: UTC
Local time zone unavailable; showing UTC.
IngestedOffset at this time: UTC+0Sep 30, 2026, 04:00 UTC
- Ingested
- Sep 30, 2026, 04:00
- Source type
- Dev community
Full text isn't available here.
Read at source →