seandotexe

Launched a new spin-off product from our crawler, using the index we store to offer way cheaper and fast site search (dogfooding on crawlie.co)

Literally just add your URL and you get a search widget. Great for doc sites etc.

Currently totally free while we're building it out, reading all feedback (smash the feedback button in app sidebar) :)

We had a bunch of success from posting on here from you lovely people for Crawlie's open source technical SEO audit tool that runs locally in Rust. Thank you for the 88+ stars!

We now offer a hosted edition that allows for large-scale crawls & automatic monitoring (with much more to come), for those who don't want to melt their laptop with local crawls :)

Appreciate it Dave! Excited for you to try it out

Thank you for catching! The docs were a bit too eager on the package simplifying I worked on (oops!).. "npm i -g crawlie" is now correct

we're shipping fast, will break less things now though I promise ;)

Thank you!! Lots more to come

Honestly, the industry is half-torn on whether llms.txt does anything... we're in such a new world. But the same ol' SEO tricks still apply for AI engines for sure.

I wanted to see what's possible with having fully autonomous 1:1 personalised newsletters thanks to AI, so cooked up this lil' research project. You sign up and get your own newsletter on your competitors every Monday and how that applies to your biz. that's the whole thing. Very much an MVP but thoughts & ideas would be amazing. Ty!