smallgames.ws
robots.txt
Robots Exclusion Standard data for smallgames.ws
Resource Scan
Scan Details
| Site Domain | smallgames.ws |
| Base Domain | smallgames.ws |
| Scan Status | Ok |
| Last Scan | 2024-11-08T21:17:58+00:00 |
| Next Scan | 2024-11-15T21:17:58+00:00 |
Last Scan
| Scanned | 2024-11-08T21:17:58+00:00 |
| URL | https://smallgames.ws/robots.txt |
| Domain IPs | 104.26.8.68, 104.26.9.68, 172.67.73.7, 2606:4700:20::681a:844, 2606:4700:20::681a:944, 2606:4700:20::ac43:4907 |
| Response IP | 104.26.9.68 |
| Found | Yes |
| Hash | ab272d6d2d3362071e7030bb52859ca4a80698f7a1ea95cfe3d59b3f57856608 |
| SimHash | 734bc4d54e81 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /backup/ |
| Disallow | /language/ |
| Disallow | /goforum/ |
| Disallow | /?do=tag |
| Disallow | /tag/ |
| Disallow | /2010/ |
| Disallow | /2011/ |
| Disallow | /2012/ |
| Disallow | /2013/ |
| Disallow | /user/ |
| Disallow | /favorites/ |
| Disallow | /newposts/ |
| Disallow | /xfsearch/ |
| Disallow | /index.php?do=addnews |
| Disallow | /index.php?do=feedback |
| Disallow | /index.php?do=lostpassword |
| Disallow | /index.php?do=stats |
| Disallow | /index.php?subaction=newposts |
| Disallow | /index.php?do=feedback&user |
| Disallow | /index.php?do=pm |
| Disallow | /index.php?cstart= |
| Disallow | /?do=lastcomments |
| Disallow | /statistics.html |
| Disallow | /redirect.html |
| Disallow | /admin.php |
| Disallow | /find.htm |
Other Records
| Field | Value |
|---|---|
| sitemap | https://smallgames.ws/sitemap.xml |
Warnings
- `host` is not a known field.