If remembering the mnemonic feels harder than the kanji, you should skip it. Some of them are really off as well and may hurt your retention. For kanjis, try to get used to semantic-phonetic compounds so that you can guess onyomi easier.
WaniKani only occasionally acknowledges this in words like 購 but the script does a good job in helping you see the pattern.
