Hmm we might need to look into the instruct training data. Which is mostly based... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		pico_creator on May 23, 2023 \| parent \| context \| favorite \| on: RWKV: Reinventing RNNs for the Transformer Era Hmm we might need to look into the instruct training data. Which is mostly based on gpt4all filtered and mixed with others (You are using raven right? That’s the instruct trained varient) Btw ping the discord if ur looking into finetuning for your usecase

anon291 on May 24, 2023 [–]

Yeah I'm using raven. Raven does work better. And I'm on the discord.

Unfortunately I really would like machine readable responses and raven is a bit too verbose.

Looking at fine-tuning right now.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact