← Back to all articles
Reddit r/MachineLearningOctober 5, 2026

Distilling Stockfish on a Billion Positions, Full 3.9B Dataset Available [P]

Excerpt

In this project, I distilled the Stockfish value function into a ResNet/ViT model using 1 billion positions from the Gigafish dataset. The 3.9 billion position dataset is available on huggingface: https://huggingface.co/datasets/lukesalamone/gigafish-3.8b-d10 . It is built from the positions from 37 months of Lichess games. I was interested in the idea that at depth-limited search, the value function attempts to approximate the tree underneath it, and if we could create some function to approxim