belperdirectory.uk
robots.txt
Robots Exclusion Standard data for belperdirectory.uk
Resource Scan
Scan Details
Site Domain | belperdirectory.uk |
Base Domain | belperdirectory.uk |
Scan Status | Ok |
Last Scan | 4/6/2025, 8:57:44 PM |
Next Scan | 4/13/2025, 8:57:44 PM |
Last Scan
Scanned | 4/6/2025, 8:57:44 PM |
URL | https://belperdirectory.uk/robots.txt |
Domain IPs | 149.255.58.142 |
Response IP | 149.255.58.142 |
Found | Yes |
Hash | 0a216255af93cbe36782e4610817c5549f36a3d2443e45454732c8712d56d092 |
SimHash | e4664c70e3fb |
Groups
*
Rule | Path |
---|---|
Disallow | /calendar/action~posterboard/ |
Disallow | /calendar/action~agenda/ |
Disallow | /calendar/action~oneday/ |
Disallow | /calendar/action~month/ |
Disallow | /calendar/action~week/ |
Disallow | /calendar/action~stream/ |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |