I Trained a Tiny Network to Compress Data. It Drew a Pentagon.

Excerpt

Reproducing Anthropic's "Toy Models of Superposition" from scratch in NumPy, with hand-derived gradients and no borrowed numbers. The post I Trained a Tiny Network to Compress Data. It Drew a Pentagon. appeared first on Towards Data Science .