This is also what happens to me all the time. My brain doesn’t connet the color difference with what to do. That is why I use the Override script and its beautiful lol
([OBSOLETE] Wanikani Override ("ignore answer button"))
That being said, I don’t recommend using it if you’re likely to cheat yourself. I really only use it when I make a typo or when I mistake reading for meaning.