Books that show how handwritten characters look without the flourishes/print fonts?

I don’t know of any books, but I think YouTube or Google image search will serve you better here so give that a try as everyone will, of course, have variation in their handwriting.

Here is a video about writing kanji particles. It’s in Japanese, but you can at least see how someone would write them. And here are the Japanese 2nd grader kanji being written (same guy, also in Japanese). Both are using a pen, but he has some other videos using a pencil, but it’s pretty similar. Don’t know if that helps at all (he has neat writing since he is a calligrapher).

Edit:
Here are some playlists on YouTube (same guy) with other learning to write videos:
2nd grader kanji (3 videos total)

Lots of videos that cover the kana, grade school kanji, and some names, etc.

If a book is really what you want they have workbooks for kanji for Japanese school kids that you can sometimes find on Amazon. There are some workbooks for kanji for learners as well, but not many and they will likely use the brush font for you to trace followed by blank spaces.

Maybe this book is what you’re looking for? (AMZ US link)

This one and this one use the brush font, but are similar.