BLOGS

Jev as a Recommender: One Forward Pass, K Calibrated Candidates

Full Looped Transformer: Feeding the Model's Own Predictions Back Into the Loop

The Corpus Entropy Profile: How Hard vs. How Unevenly Hard

Multi-Head Attention Residuals

Delta Attention Residuals: It's the Routing, Not the Sources

Open Attention Residuals: Replacing Additive Residuals with Learned Cross-Layer Attention

Fine-tuning Large Language Models with Mini-Sequence Technology and Distributed Training

Extending LLAMA Training Context with Mini-Sequence Technology

Extending Mistral Training Context with Mini-Sequence Technology

Revolutionizing LLM Training with Mini-Sequence Technology