I’ll give it a shot.

I tried something similar a year or so ago with my own script. What I found was, the longer the book, the harder the ai has on having the same voice.

I eventually got around this limitation by using piper. https://github.com/rhasspy/piper

It was good enough for my purposes. But it definitely sounded mechanical.