Releases Notes

Here are the detailed release notes for each versions of Crowl.

v0.2 (2020-02-25)

New features
Configuration file: old global configuration file has been replaced with project-scoped files, and settings are now changed using these project files. See
CSV export: a new pipeline to export data into CSV files. See

Additional data
More data is scraped during crawl:

  • number of title tags
  • number of meta robots tags
  • number of h1 tags
  • number of h2 tags
  • http date (from headers)
  • file size
  • link rel prev & next
  • html lang
  • hreflang tags (exported as JSON)
  • microdata & json-ld markup (using extruct lib)

v0.1 (2018-08-05)

First release

Get Connected