Hi, just recently it’s foss had an article about homelabs. Of course I digged in, since there is a small nuc working tirelessly in the corner of my routers closet. So far it just crawls some web pages for me and sends emails accordingly to my filters. So I hoped to find new exciting stuff to let it crunch through. The articles content did not spark my interest though.
Well, I’d like to know what you are using on your homelab. In hope you’ll do something I’d like to follow. Cheers
What do you use to crawl webpages and email them to you?
One possibility would be Huginn I guess https://github.com/huginn/huginn
That looks very neat. It is also a great resource for more inspiration. I will definitely try it out. Thank you.
To crawl I use playwright and cheerio to traverse through the html. I startet with another library, but playwright is more stable in my opinion (or just in my use Case). After the crawl I use nodecron to send Mails with nodemailer to myself, on a daily basis. All together it is a node.js app I wrote, inside a docker container.