e=mc²9 min read
Instruction Tuning From Scratch: Turn a Story Generator Into a Prompt Follower
Lesson 05: teach a 5.9M-parameter story model to follow a request, with two special tokens, a chat template and prompt masking. On 50 held-out requests, the share of stories with the right character and place went from 12% to 44%. Here is what it learned and what it did not.
2 views
Read