inruiltaxatie.nl
robots.txt

Robots Exclusion Standard data for inruiltaxatie.nl

Resource Scan

Scan Details

Site Domain inruiltaxatie.nl
Base Domain inruiltaxatie.nl
Scan Status Ok
Last Scan2025-03-11T15:20:09+00:00
Next Scan 2025-03-18T15:20:09+00:00

Last Scan

Scanned2025-03-11T15:20:09+00:00
URL https://inruiltaxatie.nl/robots.txt
Redirect https://www.inruiltaxatie.nl/robots.txt
Redirect Domain www.inruiltaxatie.nl
Redirect Base inruiltaxatie.nl
Domain IPs 104.21.48.117, 172.67.151.13, 2606:4700:3030::6815:3075, 2606:4700:3033::ac43:970d
Redirect IPs 104.21.48.117, 172.67.151.13, 2606:4700:3030::6815:3075, 2606:4700:3033::ac43:970d
Response IP 104.21.48.117
Found Yes
Hash bca1b5ebff075951ec83c0b6bd92459627281c5df5b751c50e6d21ece81a86d3
SimHash cd364838e711

Groups

*

Rule Path
Disallow /api/
Disallow /include/
Disallow /modules/
Disallow /templates/
Disallow /logs/
Disallow /php/
Disallow /json/

Other Records

Field Value
crawl-delay 5

petalbot

Rule Path
Disallow /