If you keep learning kanji and practicing to read manga and books it may not be as long as you think. Last year I stopped reading ご注文はうさぎですか a few chapters into volume 3 because it was so hard. It was by far the most challenging thing I was reading, even compared to some children’s books I had read / was reading. Fast forward 9 months (and a dozen volumes of manga and a light novel later) to when I picked up volume 3 again and it was so much easier. For volumes 4-6, ご注文はうさぎですか has become one of my pleasure manga that I pick up to read when I don’t feel like thinking too hard.
In short, if I can do it so can you. 