Upcoming Paper Jam: Attention Is All You Need

We'll be meeting for Paper Jam #23 on Friday, November 20 at 1pm UTC, and we'll discuss the following paper:

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, Illia Polosukhin
Attention Is All You Need (2017) [link]

This one is an exception. Paper Jams is about the human factors of making software, and this is a machine learning paper. But it is the paper behind every AI tool we have discussed this year, and it is one of those papers everyone cites and few have read.

Reading it together is a lot more fun than doing so alone. Believe that some of the math might be beyond you? Don't worry. We'll support each other, and in any case the point is to come out with a clearer picture of how LLMs work – not with a complete understanding of all their intricate details.

Paper Jams is a monthly one-hour video call where a small group discusses an academic paper on the human factors of making software. We follow the Chatham House Rule, and the conversation goes wherever the group takes it.

Interested? Subscribe to Paper Jams to join the call.