Bart- A vintage llm [R]

Excerpt

after 3 months and $800 burned... Unbounded Labs is proud to introduce Bart, our vintage LLM: 2.82B parameters trained from scratch on 20.1B tokens of English written before 1931. You can talk to it right now! Demo: https://www.unboundedlab.com/chat/bart Article: https://www.unboundedlab.com/blog/bart Huggingface: https://huggingface.co/jbduran/bart-sft Why even make a vintage llm? As proposed by Demis Hassabis, could LLMs reach the same conclusions that the great scientists of the past did? Whi