You should go at the pace that is most comfortable for you. But if you’re bothered by your current speed, increasing it a little for a while just to test how it goes can’t hurt. You can always go back to taking it slow if you don’t enjoy it.
It is completely normal to forget words. Heck, people even forget words in their native tongue. But I do think one of the things you may be “missing on” (or more correctly, delaying – and this is just a hypothesis) by going so slow is the extra reinforcement provided by the higher WK levels.
((Also postponing your ability to immerse in native content, which is arguably the most important form of reinforcement)).
I’m sure you have noticed that vocabulary, radicals and kanji using content you’ve already learnt keep appearing as you advance in levels – and what they’re doing (aside from teaching you brand new content) ends up also giving you more context and opportunities to cement the old in your memory. You could even say that they’re almost acting as new SRS substages.
Here’s an example. While Enlightened to Burn for, say, ‘ground’ may take 6 months, you are guaranteed to see it again over and over again in new lessons and their mnemonics. If you keep going at a decent (albeit not overwhelming) pace, you’re bound to see ‘ground’ in many more contexts and mnemonics than if you were to wait until you have mastered it – casually reinforcing the item in your memory without overburdening it.
That being said… Ultimately, everyone needs to find their own personal, manageable balance to strike between quantity and quality. Just don’t dismiss quantity as something that will solely make your life harder and experiment a bit to see if a slightly faster pace will better suit you.