check-reviews.nl
robots.txt

Robots Exclusion Standard data for check-reviews.nl

Resource Scan

Scan Details

Site Domain check-reviews.nl
Base Domain check-reviews.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-01T15:22:43+00:00
Next Scan 2025-12-30T15:22:43+00:00

Last Successful Scan

Scanned2021-10-21T16:12:38+00:00
URL https://check-reviews.nl/robots.txt
Redirect http://check-reviews.nl/robots.txt
Found Yes
Hash 8fb765f885908f2c715054c4f35abeae23631d4efff0945fffe243a84a8e6855
SimHash 2920393077b3

Groups

*

Rule Path
Disallow /new.html
Disallow /search
Disallow /update/
Disallow /directions/
Disallow /add-review/
Disallow /pages/

Comments

  • www.robotstxt.org/
  • Allow crawling of all content