developer.apple.com
robots.txt
Robots Exclusion Standard data for developer.apple.com
Resource Scan
Scan Details
Site Domain | developer.apple.com |
Base Domain | apple.com |
Scan Status | Ok |
Last Scan | 2024-09-23T08:37:46+00:00 |
Next Scan | 2024-10-07T08:37:46+00:00 |
Last Scan
Scanned | 2024-09-23T08:37:46+00:00 |
URL | https://developer.apple.com/robots.txt |
Domain IPs | 17.253.61.196, 17.253.61.205, 2600:1413:b000:13::b857:c18c, 2600:1413:b000:13::b857:c18e |
Response IP | 17.253.118.202 |
Found | Yes |
Hash | d03e7506285172d45bd51ec7bdd099f94ab9ae34e4edaf0f76cf037bb627fe0a |
SimHash | ccc21de897d2 |
Groups
*
Rule | Path |
---|---|
Disallow | /click/ |
Disallow | /cgi-bin/ |
Disallow | /survey/ |
Disallow | /temp/ |
Disallow | /search/ |
Disallow | /unsubscribe/ |
Disallow | /reference/ |
Disallow | /forums/create/question |
Disallow | /forums/login |
Disallow | /forums/preferences |
Disallow | /forums/profile |
Disallow | /forums/*?view |
Comments