#fyp
ToolResources
MiniMind
An open-source project that shows you how to train a small language model from scratch, in a couple of hours.
MiniMind trains a language model of about 64 million parameters from scratch. It is small on purpose, so you can see every step of how a model is built, rather than relying on a large one someone else trained.
There are sister projects for vision (minimind-v) and for speech and sight (minimind-o) if you want to go further.