You are not alone! There are difficult parts for me too. How do you feel about the parts where action is happening, as opposed to the ones explaining lore or past events? The former are much easier for me, while the latter take more time and are difficult to grasp. I’m not sure it’ll happen, but I really hope that the latter will become less frequent when the world is completely built up for us.
We discussed it just a little bit on the week 6:
If you feel like the story-telling parts are not too big of a hurdle, I would give it a try, but ultimately, it is for you to decide. Also, since it’ll take you a couple of weeks to finish the first half of the book, you can ask again if there are many difficult world-building sections in the second half.