gamefaqs.gamespot.com
robots.txt
Robots Exclusion Standard data for gamefaqs.gamespot.com
Resource Scan
Scan Details
Site Domain | gamefaqs.gamespot.com |
Base Domain | gamespot.com |
Scan Status | Ok |
Last Scan | 2024-11-09T09:05:18+00:00 |
Next Scan | 2024-11-16T09:05:18+00:00 |
Last Scan
Scanned | 2024-11-09T09:05:18+00:00 |
URL | https://gamefaqs.gamespot.com/robots.txt |
Domain IPs | 199.232.208.194, 199.232.212.194 |
Response IP | 199.232.44.194 |
Found | Yes |
Hash | bfcbfedef6e2ac461b1309847866c74b2794471baa238d5b5446000add43de35 |
SimHash | d00ed962ec98 |
Groups
*
Rule | Path |
---|---|
Disallow | /search |
Disallow | /search_advanced |
Disallow | /user/ |
Disallow | /community/* |
Comments