raspil76.ru
robots.txt
Robots Exclusion Standard data for raspil76.ru
Resource Scan
Scan Details
Site Domain | raspil76.ru |
Base Domain | raspil76.ru |
Scan Status | Ok |
Last Scan | 2024-06-23T00:54:17+00:00 |
Next Scan | 2024-07-23T00:54:17+00:00 |
Last Scan
Scanned | 2024-06-23T00:54:17+00:00 |
URL | https://raspil76.ru/robots.txt |
Domain IPs | 104.21.30.48, 172.67.150.149, 2606:4700:3030::6815:1e30, 2606:4700:3034::ac43:9695 |
Response IP | 172.67.150.149 |
Found | Yes |
Hash | 77addb9209f39c11c562765a7d97b47793b5edcfa7b82a7721327b173fccb34d |
SimHash | 4c08dac29ff3 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /noindex/ |
Disallow | /offsite.html |
Disallow | /404.html |
Other Records
Field | Value |
---|---|
sitemap | https://raspil76.ru/sitemap.xml |