makelaardijsinnema.nl
robots.txt
Robots Exclusion Standard data for makelaardijsinnema.nl
Resource Scan
Scan Details
Site Domain | makelaardijsinnema.nl |
Base Domain | makelaardijsinnema.nl |
Scan Status | Ok |
Last Scan | 2024-11-02T22:35:37+00:00 |
Next Scan | 2024-11-16T22:35:37+00:00 |
Last Scan
Scanned | 2024-11-02T22:35:37+00:00 |
URL | https://makelaardijsinnema.nl/robots.txt |
Redirect | https://www.makelaardijsinnema.nl/robots.txt |
Redirect Domain | www.makelaardijsinnema.nl |
Redirect Base | makelaardijsinnema.nl |
Domain IPs | 194.109.157.64 |
Redirect IPs | 194.109.157.64 |
Response IP | 194.109.157.64 |
Found | Yes |
Hash | f936d6ea51029959353b87c0d4aca077eba7dc3224ba370179502e4d8ef05e38 |
SimHash | 6858c042c5c1 |
Groups
*
Rule | Path |
---|---|
Disallow | /tag- |
Disallow | /aantal- |
Disallow | /servlets/websitestatistics |
Disallow | /servlets/websiteobjectstatistics |
Disallow | /servlets/websitedurationstats |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |