You are talking about the reviews I guess, and if we think or just translate automatically.
My answer is “yes but only if necessary”: I will think about it, unless it’s so clear in my mind that I could call myself ‘fluent’ with that word (no sense in overthinking お母さん …).
First recognize the single kanji used, then try to remember the meaning/reading (more or less at the same time).
Sometime the jukugo reading will suggest the meaning, usually for words learned before WK, I’m looking at words like 沢山 (たくさん) .
Otherwise I’ll try to remember if there was some mnemonic etc. I think of it as digging a canal by taking away 1 cm every time. Also, when both kanji have the same meaning, the vocab will have that too.
I’m not sure if mnemonics for vocab survive long term. I think lately I’m starting to simply recognize the words or guess the meaning because i can read them naturally, even for words that I had learned through mnemonics. Either way, until you learn it in the wild, and it becomes natural, the mnemonic will make it usable.
I also check if the reading “sounds well”. I always focus on the hearing aspect because it reinforces the word and makes it possible for me to recognize it in real speech (making it reach a level closer to what I called ‘fluency’).
But don’t overthink. 10 seconds for a word should be enough. If it takes you 40 seconds, it means there’s something wrong, maybe mark it wrong and find a different way/mnemonic to remember it. (There’s even a script that marks them wrong if you take too much)