Skip to content
HNHacker News·
Archived topic · source no longer tracked

PSSA: A non-transformer language model written from scratch in Rust

AI summary

PSSA, a plastic state-space architecture, is a non-transformer language model written in Rust. It demonstrates superior performance compared to transformers on a held-out slice of 198,939 unseen tokens, achieving a cross-entropy of 3.997 versus 4.429, a perplexity of 54.4 versus 83.8, and a next-token accuracy of 24.1% versus 18.0%. This indicates better generalization rather than harder memorization. Contributions are welcome, particularly for kernel performance and recurrent baselines.

Time & source

Times shown in UTC

Display time zone: UTC

Local time zone unavailable; showing UTC.

IngestedOffset at this time: UTC+0Sep 30, 2026, 04:00 UTC

Ingested
Sep 30, 2026, 04:00
Source type
Dev community

Full text isn't available here.

Read at source →
Source·Hacker News·github.com