Transformer from Scratch

Last updated on Jan 1, 0001
Go to Project Site

This project implements a Transformer model from scratch for a machine translation task. The goal is to build a functional Transformer model starting from the basic principles and gradually developing it into a full-fledged model capable of translating text between languages.

Transformer LLM Python PyTorch
Yuangang Li
Yuangang Li
Research Assistant

My research targets the nexus of ML Systems, AutoML, and Security of AI(LLMs).