uwalls.it
robots.txt
Robots Exclusion Standard data for uwalls.it
Resource Scan
Scan Details
Site Domain | uwalls.it |
Base Domain | uwalls.it |
Scan Status | Ok |
Last Scan | 2024-06-10T02:59:58+00:00 |
Next Scan | 2024-07-10T02:59:58+00:00 |
Last Scan
Scanned | 2024-06-10T02:59:58+00:00 |
URL | https://uwalls.it/robots.txt |
Domain IPs | 104.26.10.190, 104.26.11.190, 172.67.69.23, 2606:4700:20::681a:abe, 2606:4700:20::681a:bbe, 2606:4700:20::ac43:4517 |
Response IP | 172.67.69.23 |
Found | Yes |
Hash | c2970502b3bb4269f5322e1e46ddfe8c4431df502c154a65b32f98a216181d07 |
SimHash | 6458fdd7ff80 |
Groups
*
Rule | Path |
---|---|
Disallow | /order/* |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Other Records
Field | Value |
---|---|
sitemap | https://uwalls.it/sitemap-auto/sitemap.xml |
Warnings
- `useragent` is not a known field.
Comments