In this AI Warmup, I walk us through “Transformers – Attention Is All You Need” – the architecture at the heart of Chat GPT. This will go beyond hand-waving, shallow descriptions, and dive into what is really happening.
We
study the transformer architecture start training a transformer to translate (for example) english to german
While preparing this journey, I have collected excellent material in the “AI Warmup Attention Is All You Need” Path in our Crowdsourced Upskilling page.
At the end of this you will:
understand the basics of how Transformers really work be able to build, train and use a Transformer yourself in pythonbe ready to absorb the excellent material from Ajay-Halthor’s CodeEmporium and Andrej Karpathy’s Neural Networks: Zero to Hero
Ken Lomax – C&CI Garage – ken.lomax@sap.com – See here for other C&CI Garage Initiatives
In this AI Warmup, I walk us through “Transformers – Attention Is All You Need” – the architecture at the heart of Chat GPT. This will go beyond hand-waving, shallow descriptions, and dive into what is really happening.Westudy the transformer architecture start training a transformer to translate (for example) english to germanWhile preparing this journey, I have collected excellent material in the “AI Warmup Attention Is All You Need” Path in our Crowdsourced Upskilling page.At the end of this you will:understand the basics of how Transformers really work be able to build, train and use a Transformer yourself in pythonbe ready to absorb the excellent material from Ajay-Halthor’s CodeEmporium and Andrej Karpathy’s Neural Networks: Zero to HeroKen Lomax – C&CI Garage – ken.lomax@sap.com – See here for other C&CI Garage Initiatives Read More Technology Blogs by SAP articles
#SAP
#SAPTechnologyblog
