Honestly, this is something you’ll naturally stop doing over time, because you get subconsciously used to the different appearances for different prompts (black or white header for the question, prompt says “Answer” in English or “答え” in Japanese).
I know this for a fact because when I switched to a different color scheme using [Userstyle] WaniKani Breeze Dark, I suddenly found myself making this kind of mistake a lot. I had several hundred reviews per day back then though, and noticed that I stopped making those mistakes after just a couple days.