You just have to train yourself out of it. It’s natural. If you can find Japanese material appropriate for (or just harder than appropriate for) your learning level, as far as grammar and vocabulary, read it, and force yourself to look that the kanji. It’s okay if it feels like it takes conscious effort for the time being. And force yourself to actually read the kanji you know in your head, too, so that you’re connecting them with sound as well as meaning. If you can start to make them feel like actual letters to be read, it’ll go a long way toward making them seem more approachable when encountered in text.
It can and will change, though. Even at my sub-elementary school level of kanji knowledge, and with only an overall intermediate level of language knowledge, I already tend to gravitate toward kanji over kana while reading, since it offers much better footing. The more Japanese you force yourself to read, the more you realize that a bunch of kana grouped together is just a big mess. As you accumulate more kanji just from doing WK and other study, too, you’ll also start to have enough so that the ones you don’t know will stick out rather than the ones you do, and that makes training yourself to read-kanji first and deduce unknown kanji through context much easier.
This didn’t change for me until I started reading Japanese regularly though–both through living in the country and through study material/attempts at reading manga, prose, etc.–and I’m not sure I know another way around it. You just have to start on the process of getting your brain to treat them like letters instead of a sudden trivia pop quiz (which is what a lot of them will be as you learn them on WK, until you see them in context), and the only way through that is reading.
So, yeah. Time and practice. : )