If anyone is looking to get into chess neural nets, I highly recommend this repo - https://github.com/sgrvinod/chess-transformers
It uses paradigmatic PyTorch with easy to read code, and the architecture is similar to the current best performing chess neural nets.