Posts : 358 Reputation : 1185 Join date : 2012-11-08 Location : Ten men waiting for me at the door? Send Rabbi Mordecai home, I'm tired of kosher pork Moslem meats Richer
Subject: rofChade version 3.0 By Ronald Friederich. Fri Sep 30, 2022 11:38 am
I’ve been doing a lot of NN training for TCEC season 22, which eventually resulted in an unbelievable 4th place in the premier division! The infra final for 3th place against Lc0 showed that there is still a mayor gap between the top 3 engines and the rest including rofChade, but still an amazing result. After the tournament I didn’t have much time to work on rofChade anymore, so it took some time to release the first NN version of rofChade, but here it is! The current NN network architecture is HALFKA (2×256)x32x32x1. For now, this still gives the best results for rofChade. The network is trained with 2.8B by rofChade generated positions. Around 600M of them are FRC positions. The positions have been rescored a few times with intermediate networks to simulate Reinforcement learning. The NN code is implemented from scratch, the matrix calculations are heavily influenced by the Cfish implementation. For the training of the networks an older version of the nnue-pytorch trainer from Stockfish is used as base.