---

Read more

---

Apr 22, 2026 | 12 min read

Using group theory to explore the space of positional encodings for attention

Attention is a computational primitive at the core of modern language models, allowing internal representations to reference and influence each other. It’s how these models...

By: Alok Puranik

---

Read more

---

Feb 28, 2019 | 3 min read

Accelerating Self-Play Learning in Go

At Jane Street, over the last few years, we’ve been increasingly exploring machine learning to improve our models. Many of us are fascinated by the...

By: David Wu

---

Read more

---

Jan 29, 2019 | 9 min read

L2 Regularization and Batch Norm

This blog post is about an interesting detail about machine learning that I came across as a researcher at Jane Street - that of the...

By: David Wu

---

Read more

---

Oct 31, 2017 | 12 min read

Does batch size matter?

This post is aimed at readers who are already familiar with stochastic gradient descent (SGD) and terms like “batch size”. For an introduction to these...

By: Chris Hardin