centurylink.com
robots.txt
Robots Exclusion Standard data for centurylink.com
Resource Scan
Scan Details
Site Domain | centurylink.com |
Base Domain | centurylink.com |
Scan Status | Ok |
Last Scan | 2024-11-16T06:35:03+00:00 |
Next Scan | 2024-11-23T06:35:03+00:00 |
Last Scan
Scanned | 2024-11-16T06:35:03+00:00 |
URL | https://centurylink.com/robots.txt |
Redirect | https://www.centurylink.com/robots.txt |
Redirect Domain | www.centurylink.com |
Redirect Base | centurylink.com |
Domain IPs | 155.70.44.25, 155.70.55.25, 2001:428:b20:16:155:70:118:11, 2001:428:b21:16:155:70:66:11 |
Redirect IPs | 2001:428:b20:16:155:70:118:11, 2001:428:b21:16:155:70:66:11, 45.154.183.34 |
Response IP | 45.154.183.34 |
Found | Yes |
Hash | fcbfb186577bcf133627cf7e840795d0562d952e5673137f5b6db27513936fb9 |
SimHash | 6110e957cfb0 |
Groups
*
Rule | Path |
---|---|
Disallow | */popups/* |
Disallow | */common/* |
Disallow | /local/hidden/* |
Disallow | /business/login/* |
Disallow | /disclosures/* |
Disallow | /help/privacy/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.centurylink.com/sitemap-index.xml |
Comments