Hey so this is two things, or maybe one thing on two levels: a one-time curiosity question, and a suggestion.
The question: What are the (top10 | top 100 | ranked complete list of) most-failed items in all of WaniKani (yesterday | last week | last month | ever) (as computational resources reasonably permit)? I think it would be fun to see. We could discuss strategies people have for remembering them, and have a good ol’ time griping about how it’s all WaniKani’s fault for having terrible mnemonics. (But seriously though, some items ARE harder than others). It should be possible to figure out with the reviews database (no longer available through the API), NOT filtered by user-id.
The suggestion: That would be a cool page to have on the site, updated weekly or monthly or something like that.
It would probably have to be fails per attempt I guess, or else the early levels would be way over-represented compared to levels way fewer people even get to before dropping out.
Think of all the add-ons people could make with that information. A pop-up during lessons that says Hey watch out! This one is statistically very difficult to remember! A filter for self-study quiz that only reviews the most-difficult. Just a couple of examples off the top of my head.
It would also be super-useful for the content team to be a flag to look at why those are sticky ones and evaluate if there IS a way to help. So useful, in fact, that now that I think of it, I’d be surprised if they don’t already have that information.
The closest script I can think of is [Userscript] Item Difficulty Indicator 🟢🟡🟠🔴 And I definitely agree that the WK team should be looking at the most failed items and redoing the mnemonics for them.
That seems pretty um… well that would be one indicator for sure, and it’s probably the best or only way to get that info without access to the whole database. It’s clever.
I was thinking of some kind of opt-in script that reported participant’s review results to a central location where a second process could crunch the numbers and report it. Seems impractical though, and it would be much easier if WK just shared the report. Like I said, if I was them I’d already have it, it would just be a matter of deciding to share. If not a page on the site, then a periodic post in the announcements category, I think that would be a popular one.
It scrapes every user’s profile page? That seems… inefficient
