Crowl

Thanks @juandastic for this user guide in 🇪🇸 juandastic.co/seo-tecnico/co…

Am I the only one who needs more time to write the documentation than to dev the feature? 😅

Quick update today to resolve a bug with blank pages that send HTTP 200 rescodes, and to update some outdated dependencies. To upgrade: #upgrade-crowl" target="_blank" rel="nofollow noopener">crowl.tech/documentation/…

Super update, je pense surtout pour la détection de langue avec Fasttext. Je pique l'idée, j'avais pas vu que dans la doc il avait mis en place un model tout prêt. Je m'emmerdais pour rien 😂 En tout cas super ajout sur le crawler allez voir ça 👍

ICYMI: new release of the #opensource #seo #crawler

You can also support this project with a few cups of coffee buymeacoffee.com/crowltech ❤️

New features (and old ones too) are described in the docs. See config options here: crowl.tech/documentation/…

v0.3 is finally here! Exclusion patterns, custom XPath extractors, proxies, language detection... See the full list of new features here: crowl.tech/releases/

Support Crowl on @buymeacoffee ! buymeacoffee.com/crowltech/supp…

Currently writing release note and updating documentation 😎

@DataChaz @diije Coming soon ;)

@crowltech @diije Looking forward to this Julien! 🙌

Currently testing the next release of #crowl with some great new features. Still a bit of debug to do, but quite sure you'll like it!

No release tag because some other features are coming quick!

A quick update this evening to add a parameter to exclude a pattern of URLs. Checkout gitlab.com/crowltech/crow… and #exclusion_pattern" target="_blank" rel="nofollow noopener">crowl.tech/documentation/…

A client of ours brought up this SEO-focused crawl library that I wasn't aware of (@crowltech) bit.ly/2ZixEY1 It abstracts some of the stuff you'll likely need to build if you're scraping. Sharing because it was new to me.

@iPullRank Thanks for sharing! Minor release coming soon! (well, hopefully)

Crowl v0.2 is out! Config files & CSV export are the main features. Check out the release notes: gitlab.com/crowltech/crow… And the new docs: crowl.tech/docs/ Feedback is welcome!

A few example of using #cURL for #SEO databulle.com/blog/seo/curl-…

Crowl: un crawler SEO opensource linuxfr.org/news/crowl-un-… via @linuxfrorg

A few technical updates are coming soon, too ;-)