A lot has been said above, so I’ll just pile on one additional thing: https://game2text.com/
This software helped me enjoy games with story a lot more, although much slower than normal.
But to answer your question: I think covering N5, N4 and maybe N3 grammar is a minimum for gaming in Japanese.