{"id":"02db3f03-fc46-42f7-aced-5691e1d510dc","kind":"sos","name":"Discovering Transformer Internals (Part 2) - Exploring what Grokking is and how it works?","slug":"discovering-transformer-internals-part-2-exploring","url":"https://api.events.ccc.de/congress/2025/event/02db3f03-fc46-42f7-aced-5691e1d510dc/?format=json","track":null,"assembly":"sos","room":null,"location":"Stairway here https://39c3.c3nav.de/l/c:3:191.49:143.11/","language":"de, en","description":"We will explore what happend in \"[Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets](https://arxiv.org/abs/2201.02177)\".\r\n\r\nYou can find Part 1 [here](https://events.ccc.de/congress/2025/hub/en/event/detail/building-a-simple-transformer-part-1-how-to-make-y).\r\nIf you have any questions you can contact me on DECT 9560.\r\n\r\nAny updates on location and time will be written here. Also more information in the [Repository](https://github.com/DerDennisOP/39c3-transformer-workshop).\r\n\r\n\r\n**UPDATE ORT:** [Near Workshopspace 1](https://39c3.c3nav.de/l/c:3:191.49:143.11/)","schedule_start":"2025-12-29T18:00:00+01:00","schedule_duration":"01:00:00","schedule_end":"2025-12-29T19:00:00+01:00"}