Manga Kotoba: Manga Frequency Lists and Stats

That’s quite the dense pixel resolution!

I’ve made updates to the layout that should account for it, but since I don’t have the device myself I’m unable to test it.

Can you check and see if the issue is resolved or still showing the incorrect layout?

Seems to have slightly changed, I should be able to use it now. This first screenshot is from using Kimi browser, which I use because I have the JPDBReader extension installed so I usually like to have it “scan” the page and I can mark words in both systems with a single click.
Just for experimenting, I opened the same page in Ecosia which is the mobile browser I use for literally everything else and it gave me this layout:


Which seems to be the very first old one?
Also words marked seem to still reappear when reloading the page (or it maybe takes a bit the register the edits?)

Before I knew it, Manga Kotoba reached 60 61 pages:


To celebrate, I have finally implemented a “forgot password?” option. It’s been on my to-do list for over a year and a half.


On the backend, I’ve streamlined the processing for adding series/volumes, going from minutes to seconds to add volumes for a series to the site.

Now when I have volumes ready to be added, my mindset won’t be “do I really want to go through all the steps per series right now?” but instead “I can click a few buttons”.

(Maybe I should also streamline updating the list of series with time-restricted volume freebies on BookWalker.)


I’ll have to look into this further.

Vocabulary pages are cached in the browser, so reloading a page loads quickly. But marking a word as known invalidates the cache, which should prompt the server to send a new copy of the page on the next request.

Yay! Thanks so much :glowing_star::partying_face:

The “Contribute” page has finally been added to the menu:

Previously, you could only contribute if you purchased manga from Kobo.

I’ve updated the page, so any source is fine (legally obtained only, please!) so long as you’re using a version of Mokuro that generates .mokuro files.

You can also contribute multiple volumes at a time now.

If you have a ton of manga from Kindle or BookWalker that you’ve been wanting to see added to Manga Kotoba, there’s never been a better time.

You can optionally send me the .mokuro files on Discord if you’d like.

That’s great!!
If I can figure out how to get some volumes I have in Bookwalker parsed by Mokuro, I will gladly help little by little.
Are you also accepting freely available mangas? There’s a series of edutainment manga for kids available here and in other places that I’ve had fun reading these years. (Unfortunately not all issues seem to be available, which will never not bug me)
I’ve already set up a little python script to pull one volume and bundle it up with Mokuro in the past, I should just quickly rewrite it on my new pc since it got lost and set it to work little by little as I read them.

These would be a great to generate frequency lists for. Looks a bit tricky to save auto-save images for processing in Mokuro, so if you have something already able to do that, all the better. (Or if site’s reader has changed such that your script no longer works, I can also look into getting something together.)

I’m curious what assortment of vocabulary is used in manga that 1) targets younger readers, while 2) not aiming so young to avoid using more difficult kanji, and 3) is educational.

hey hey, i went on a freebie scraping spree from ebookjapan.yahoo.co.jp and im uploading a few of my mokuro files in there: when i attempt multi-select of mokuro files, the dropdown window for selecting files fails, and uploading them manually one by one will take time: would it be possible to update the contribute dropdown to accept an entire folder of files at the same time?

I’ll check into it and see what I can implement.

also i uploaded 4 files and there’s a 502 now, hopefully i didn’t break anything xddd

thanks for the quick answer though!

@ChristopherFritz: okay, for now dropped all that i had scraped in good quality one by one, because multi-upload didn’t work for me properly, but tell me if the quality of the scans is good enough for mokuro to have picked up on the correct works, looks good from my perspective :eyes:

if it’s good quality, i can try to scrape more manga tomorrow and just drop the mokuro files, I also played around for a bit and made my own custom version of mokuro that’s accelerated for my specific mac laptop config by running 32 pages at the same time with 8 workers through mps and it makes me analyze ~1.7 pages a second on average and the results are 100% equivalent, so I could get some really quick scans going :eyes:

let me know if anything would be useful!

I was wondering what caused that…

Actually, I had a minor update hiccup take down the whole server (all my sites; my fault). Bad timing that it happened just as you were doing the uploading. Sorry about that!

Looking over the .mokuro files, it looks like there may be a few issues with the 転生[etc] titles missing large number of pages. The volumes are temp free on Kobo, so I can grab there from there to run through Mokuro. (Maybe I should add a feature to request any volume that’s temp free on BookWalker, so people can get requests in without the effort + Mokuro requirement.)

The other volumes look good, so I’ll see about getting them run through Ichiran and added to the site.

i scraped over your upload mechanism as well and added it at the end of my script, so what it does now is it takes over a list of URLs from ebookjapan.yahoo.co.jp, it scrapes each one of those in a parallel puppeteer session, then it runs mokuro on each of those volumes and as soon as mokuro is done, it automatically sends a new request to your backend with the mokuro file scraped

i’ve added some fallback mechanics for whether the scraping is of a poor quality (loading screen went in, didn’t scrape enough pages), it doesn’t send it to you

please, let me know if at any time the spam becomes too much, i probably might stop after today because the cookie i’ve put into the script is going to be invalidated tomorrow, but you miiight be seeing a few .mokuro files flying into your servers until i get bored

for now im uploading the titles that personally stood out to me, for example im uploading サターンリターン 3巻 because i considered it rEEEEALLY DIFFICULT to read at the time when i was going through it ^^

also, as of today, ebookjapan.yahoo.co.jp has 10000+ series with a free volume and 3139 series (free/timed free) that have 3+ volumes available for free… up from below 2700 yesterday, i’m really curious how their business model is going, it’s so much more than Bookwalker, which only has 1694… free volumes overall :eyes:

EDIT: I found a tag for yuri on ebookjapan, im on a mission to misrepresent the popularity of yuri manga on manga kotoba by scraping anything i find interesting xddd

EDIT: okay im off to play new kirby hope nothing blows up xdd
image

I don’t typically post about minor site feature additions, but today’s is worth mentioning.

When viewing a frequency list and selecting the usage icon, which brings up the word usage page, there is a new link added:

image

image

Following this link brings up a list of all occurrences of this word in manga you own (reading, paused, finished, and owned statuses):

The goal is to make it easier to find a word in multiple contexts, which I personally find helpful when learning new words.

The site doesn’t store sentences from manga, so it can’t show the sentence itself. It’s still up to you to pull up your copy of the manga and flip to the appropriate page.

Is there a way to take my library from natively (delimited file, csv, etc)… or some other form of that table and import that into MK directly (matching the books owned to what’s already in MK?)

doing that manually for as many books as there are … seems not fun :laughing:

Let me see what I can get together. No promises, but I might be able to come up with something.

Do you know if Natively has an export option? (I’ll check for myself, as well.) Edit: I see there is a Data Download option. Looking into it now.

yeah it does… I exported a csv already

but realize that not everything in the library is in MK and naming (could be an issue) for matching…if the manga naming is every so slightly different matching could fail

seems easy on paper but may not be so easy in reality… happy to be a guinea pig though if you want/need something like this…

The good news is matching will be effortless…so long as Manga Kotoba knows there is a Natively entry for it. (I should implement an option for users to provide external links for me to review/add.)

For example, Manga Kotoba sees this one series as on Natively, with a specific ID in the URL:

image
image

And from the export:

image

Utilizing the matching Series ID, and the Series Order which hopefully matches Manga Kotoba’s internal database, I’m hoping it’ll be an easy import.

Then there are questions such as:

  • If there is already a reading status on Manga Kotoba, and the status from Natively differs, which one should be kept?

But that can be a radio button selection before import.

right now mine would be zero .. my MK library is empty but yeah radio button important…

as libraries grow and want to import newer stuff… def an important feature to have

it’s probably a lot more of hassle but it could even be a short list of ok which of these to be kept option…but that ultimately would probably end up messy