games2win.com
robots.txt
Robots Exclusion Standard data for games2win.com
Resource Scan
Scan Details
Site Domain | games2win.com |
Base Domain | games2win.com |
Scan Status | Ok |
Last Scan | 2024-05-07T20:45:17+00:00 |
Next Scan | 2024-05-14T20:45:17+00:00 |
Last Scan
Scanned | 2024-05-07T20:45:17+00:00 |
URL | https://games2win.com/robots.txt |
Domain IPs | 15.197.142.173, 3.33.152.147, 52.21.238.249 |
Response IP | 52.21.238.249 |
Found | Yes |
Hash | 720bdbb5fa297212f4c2c2ed99dcb3c88b4053beda7c856c31daf2f2fa1995ff |
SimHash | 203a1e22cd73 |
Groups
*
Rule | Path | Comment |
---|---|---|
Disallow | /msn/ | Do not crawl any of the MSN related content as ours |
Disallow | /demo/ | Do not crawl any of the Games2win demo folder content as ours |
Disallow | /*.swf$ | Do not crawl any of the Games2win flash content |
Disallow | /promos/ | Do not crawl any of the Games2win promos folder content as ours (BZ:58) |
Disallow | /includes/ | Do not crawl any of the Games2win includes folder content as ours (BZ:74) |
Disallow | /localization/ | - |
Disallow | /en/naughtycity2/ | - |
Disallow | /en/naughty2/ | - |
Disallow | /services/ | - |
Disallow | /admin/ | - |
Disallow | /UGC/ | - |
Disallow | /en/demo/ | Do not crawl any of the Games2win /en/demo folder content as ours (BZ:571) |
Other Records
Field | Value |
---|---|
sitemap | http://www.games2win.com/sitemap.xml |
Comments