databox.pt
robots.txt
Robots Exclusion Standard data for databox.pt
Resource Scan
Scan Details
| Site Domain | databox.pt |
| Base Domain | databox.pt |
| Scan Status | Ok |
| Last Scan | 2025-05-21T11:41:18+00:00 |
| Next Scan | 2025-06-20T11:41:18+00:00 |
Last Scan
| Scanned | 2025-05-21T11:41:18+00:00 |
| URL | https://databox.pt/robots.txt |
| Domain IPs | 195.23.61.72 |
| Response IP | 195.23.61.72 |
| Found | Yes |
| Hash | 3e96bcb060d0f2cec0db7390e93c98916e968f37228b9315360d92181c13a1d9 |
| SimHash | 5f1642684488 |
Groups
facebookexternalhit/1.1
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 120 |
facebookexternalhit/*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 120 |
*
| Rule | Path |
|---|---|
| Disallow | /umbraco/ |
| Disallow | /views/ |
| Disallow | /config/ |
| Disallow | /bin/ |
| Disallow | /App_Plugins/ |
| Disallow | /App_Code/ |
| Disallow | /App_Data/ |
| Disallow | /Umbraco_Client/ |
| Disallow | /configurations/ |
| Disallow | /Views_Plugins/ |
| Disallow | /Media/ |
| Disallow | /lib/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |