qennel.nl
robots.txt

Robots Exclusion Standard data for qennel.nl

Resource Scan

Scan Details

Site Domain qennel.nl
Base Domain qennel.nl
Scan Status Ok
Last Scan2024-11-15T20:29:58+00:00
Next Scan 2024-11-22T20:29:58+00:00

Last Scan

Scanned2024-11-15T20:29:58+00:00
URL https://qennel.nl/robots.txt
Redirect https://www.qennel.nl/robots.txt
Redirect Domain www.qennel.nl
Redirect Base qennel.nl
Domain IPs 104.21.10.8, 172.67.189.217, 2606:4700:3032::6815:a08, 2606:4700:3033::ac43:bdd9
Redirect IPs 104.21.10.8, 172.67.189.217, 2606:4700:3032::6815:a08, 2606:4700:3033::ac43:bdd9
Response IP 104.21.10.8
Found Yes
Hash 63d21bcc635333be3eba12c6fcde4d3b8b28d91d0a79080383f10132de746d9e
SimHash 0910cd866b91

Groups

*

Rule Path
Disallow /admin/
Disallow /*?w*

Comments

  • Crawlers Setup