ConicCat/Gemma4-GarnetV2-31B

A finetune primarily focused on improving the prose and writing capabilities of Gemma 4. This does generalize strongly to roleplay and most other creative domains as well.

Features:

• Improved longform writing capabilites; output context extension allows for prompting for up to 4000 words of text in one go.
• Markedly less AI slop and identifiable Gemini-isms in writing.
• Improved swipe or output diversity.
• Fewer 'soft' refusals in writing.

Difference from V1

More / better roleplay data as well as shifting to using more primarily fantasy and sci fi books for training over literary fiction.

Datasets

• internlm/Condor-SFT-20K for instruct; even though instruct capabilities are not the primary focus, adding some instruct data helps mitigate forgetting and maintains general intellect and instruction following capabilites.
• ConicCat/Gutenberg-SFT. A reformatted version of the original Gutenberg DPO dataset by jondurbin for SFT with some slight augmentation to address many of the samples being overly long.
• A dataset of backtranslated books. Unfortunately, I am unable to release this set as all of the data is under copyright.
• A dash of a certain third owned archive.