What comes after attention? This startup says it already knows.
· frederic lardinois
AI Briefing
- • Subquadratic launched a sparse-attention model for 12-million token context window.
- • The startup claims it knows what comes after attention in AI.
- • Subquadratic's model surpasses current attention mechanisms in efficiency and accuracy.
Context
Subquadratic launched earlier this year with a sparse-attention model. The model could handle a 12-million token context window.
The company's capabilities may indicate what comes next after attention, as suggested by its launch and model specifications. Subquadratic's model is a key part of its offerings, and its context window size is a significant aspect of its technology.
Advertisement