Event: | ccnw23 2023 |
---|---|
Type: | Discussion |
Title: | Understanding Transformers: Intuition and mathematics of attention |
is_program_session: | True |
Description: | We give a thorough introduction to the intuition and equations of self-attention and transformers. No prior experience needed. This discussion serves to get us on the same page for further discussions on large language models (hardware implementations, new algorithm design, few-shot learning, is it AGI?). |
Speaker: | Mark Schoene, |
Moderators: | Mihai Petrovici, Mark Schoene, Jens Egholm Pedersen, |
Schedule ID | start time | end time | location |
---|---|---|---|
375 | May 05 2023, 15:00 | May 05 2023, 17:00 | Lecture room |
362 | May 04 2023, 17:00 | May 04 2023, 18:00 | Lecture room |