dgs.pt
robots.txt
Robots Exclusion Standard data for dgs.pt
Resource Scan
Scan Details
| Site Domain | dgs.pt |
| Base Domain | dgs.pt |
| Scan Status | Ok |
| Last Scan | 2024-11-17T22:43:02+00:00 |
| Next Scan | 2024-12-17T22:43:02+00:00 |
Last Scan
| Scanned | 2024-11-17T22:43:02+00:00 |
| URL | https://www.dgs.pt/robots.txt |
| Domain IPs | 13.107.246.59, 2620:1ec:bdf::59 |
| Response IP | 13.107.246.59 |
| Found | Yes |
| Hash | c92391e53c235ea3b7bdfc594265c9a5e7842919687b9d9bb5bf78a7d5c5e138 |
| SimHash | 6a3c984083c5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /upload/ |
| Disallow | /processos/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 120 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.dgs.pt/sitemap.xml |