ORPO: Monolithic Preference Optimization without Reference Model (Paper Explained)

Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

TransformerFAM: Feedback attention is working memory

Gemini has a Diversity Problem

Google turned the anti-bias dial up to 11 on their new Gemini Pro model. References: ...

Text Embeddings Reveal (Almost) As Much As Text

What is Q-Learning (back to basics)

Attention Is All You Need