You’ve probably already taken a look and discovered all this already, but just for the benefit of anyone else reading:
KaniWani has a settings page which allows you to control various aspects of how words appear. As acm2010 said, lessons do not directly become reviews, either. There is a setting called ‘only review items at or above’ which lets you restrict items such that they only unlock once they’ve reached a particular status in WK, such as apprentice, guru, burned, etc.
Based on your level you are probably just starting to burn some words, so I would recommend setting it to ‘burned’. This way you will be able to do a sensible number of lessons per day without getting overwhelmed. If you’d like to start covering the words faster you could set it to enlightened (these settings can always be changed later) and do a set number each day - perhaps enough to gradually ‘catch up’ and let you change it to master and so on.
You can lock and unlock individual levels on top of this by going to the ‘Vocabulary’ tab, so you could also lock particular levels to keep the number of lessons sensible, or just do it by level.