I am an undergraduate student at Sungkyunkwan University interested in language models, retrieval-augmented generation, preference optimization,autonomous data agents. I use this blog to organize paper reviews, math notes, and implementation-oriented study logs.
Background
NLP task를 수행하기 위해서는 하나의 large scale pretrained Language model을 downstream task 에 특화되도록 finetuning 해야 한다. Parameter가 $\Phi$ 인 pretrained Autoregre...