domains.google.com
robots.txt
Robots Exclusion Standard data for domains.google.com
Resource Scan
Scan Details
| Site Domain | domains.google.com |
| Base Domain | google.com |
| Scan Status | Ok |
| Last Scan | 2024-05-14T15:20:49+00:00 |
| Next Scan | 2024-06-13T15:20:49+00:00 |
Last Scan
| Scanned | 2024-05-14T15:20:49+00:00 |
| URL | https://domains.google.com/robots.txt |
| Domain IPs | 142.251.12.100, 142.251.12.101, 142.251.12.102, 142.251.12.113, 142.251.12.138, 142.251.12.139, 2404:6800:4003:c1c::64, 2404:6800:4003:c1c::65, 2404:6800:4003:c1c::66, 2404:6800:4003:c1c::8a |
| Response IP | 172.217.194.102 |
| Found | Yes |
| Hash | 1a3012b1e762ba13a5928de32d72ef2332ef7eb69c11b54d560cc39d0e574d78 |
| SimHash | 7901fa543d93 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /registrar |
| Allow | /tos |
| Disallow | /contactus |
| Disallow | /elt |
| Disallow | /npr |
| Disallow | /thepitch |
| Disallow | /thumb |
| Disallow | /unsupportedbrowser |
| Disallow | /webhosting/ |
| Disallow | /whois |
Other Records
| Field | Value |
|---|---|
| sitemap | https://domains.google.com/sitemap.xml |