talkie-1930-13b-base

talkie-1930-13b-base is a 13B vintage language model trained on 260B tokens of pre-1931 English-language text. An instruction-tuned version of the model is available at talkie-lm/talkie-1930-13b-it.

Read more about talkie in our report.

Reference code to run talkie is available on GitHub.