Mesa Optimization Algorithms in Transformers

This video shares this research paper which is trying to find out reason behind superior performance of LLMs. It mentions mesa-optimization which is a learned process running within the forward pass of a model.

#mesaoptimization

PLEASE FOLLOW ME:
▶ LinkedIn: https://www.linkedin.com/in/fahdmirza/
▶ YouTube: https://www.youtube.com/@fahdmirza
▶ Blog: https://www.fahdmirza.com

RELATED VIDEOS:

▶ Prompt Engineering 101 for Beginners https://youtu.be/qN-mUfrgBDk
▶ Introduction to AWS Bedrock https://youtu.be/tvsRAtZZ_Sc
▶ Paper https://arxiv.org/abs/2309.05858

All rights reserved © 2021 Fahd Mirza

Скачать видео