YUYU is intermediate level and uses a lot of N3 grammar. I’m currently studying Quartet and I hear a lot of Quartet grammar in his podcast. So if you’re struggling with it, don’t feel bad!
At your level I mostly listened to conversation podcasts like Teppei and Noriko. There’s also a podcast club on the forums here that just chose this podcast which has estimated jlpt levels for every level and might be easier.