This is possible with the settings that are already implemented. Under the advanced lesson settings you can set the desired number of items per type per lesson session. If you set the max number of kana only vocab to 0, you will only be shown them if you already did all other available lessons.