careers.godaddy
robots.txt
Robots Exclusion Standard data for careers.godaddy
Resource Scan
Scan Details
Site Domain | careers.godaddy |
Base Domain | careers.godaddy |
Scan Status | Ok |
Last Scan | 2024-11-15T00:06:37+00:00 |
Next Scan | 2024-12-15T00:06:37+00:00 |
Last Scan
Scanned | 2024-11-15T00:06:37+00:00 |
URL | https://careers.godaddy/robots.txt |
Domain IPs | 108.157.254.26, 108.157.254.67, 108.157.254.73, 108.157.254.81 |
Response IP | 108.157.254.81 |
Found | Yes |
Hash | 72cb75f31b4012dccd6b80ae66a09eba755b1946a6d9179c4355dd95e0443630 |
SimHash | 6dad9e664151 |
Groups
*
Rule | Path |
---|---|
Disallow | |
Disallow | /v1/candidate_details |
Disallow | /me/ |
Disallow | /api/ |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | https://careers.godaddy/sitemap.xml |
Comments