googlefiber.com
robots.txt
Robots Exclusion Standard data for googlefiber.com
Resource Scan
Scan Details
| Site Domain | googlefiber.com |
| Base Domain | googlefiber.com |
| Scan Status | Ok |
| Last Scan | 2024-06-10T08:26:54+00:00 |
| Next Scan | 2024-07-10T08:26:54+00:00 |
Last Scan
| Scanned | 2024-06-10T08:26:54+00:00 |
| URL | https://googlefiber.com/robots.txt |
| Redirect | https://fiber.google.com/robots.txt |
| Redirect Domain | fiber.google.com |
| Redirect Base | google.com |
| Domain IPs | 2404:6800:4003:c02::67, 2404:6800:4003:c02::68, 2404:6800:4003:c02::69, 2404:6800:4003:c02::6a, 64.233.170.103, 64.233.170.104, 64.233.170.105, 64.233.170.106, 64.233.170.147, 64.233.170.99 |
| Redirect IPs | 2404:6800:4003:c01::65, 2404:6800:4003:c01::71, 2404:6800:4003:c01::8a, 2404:6800:4003:c01::8b, 74.125.24.100, 74.125.24.101, 74.125.24.102, 74.125.24.113, 74.125.24.138, 74.125.24.139 |
| Response IP | 142.251.10.102 |
| Found | Yes |
| Hash | b778d448b5f74e209d7fce635f1aefcaedb6dbe16f2ecdb30d4f69def9ba5f2c |
| SimHash | e00098048993 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /blog/search/ |
| Disallow | /careers/job/ |
| Disallow | /move/success/ |
| Disallow | /internet/fiber/ |
| Disallow | /internet/gigabit/ |
| Disallow | /internet/speed/ |
| Disallow | /intl/es/careers/job/ |
| Disallow | /intl/es/internet/fiber/ |
| Disallow | /intl/es/internet/gigabit/ |
| Disallow | /intl/es/internet/speed/ |
| Disallow | /cities/testing/lg/here/ |
| Disallow | /legal/terms/electroniccommunications/ |
| Disallow | /r/ |
| Disallow | /intl/es/r/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://fiber.google.com/sitemap.xml |