rawg.io
robots.txt
Robots Exclusion Standard data for rawg.io
Resource Scan
Scan Details
| Site Domain | rawg.io |
| Base Domain | rawg.io |
| Scan Status | Ok |
| Last Scan | 2025-08-09T16:34:39+00:00 |
| Next Scan | 2025-08-16T16:34:39+00:00 |
Last Scan
| Scanned | 2025-08-09T16:34:39+00:00 |
| URL | https://rawg.io/robots.txt |
| Domain IPs | 104.26.12.166, 104.26.13.166, 172.67.75.230, 2606:4700:20::681a:ca6, 2606:4700:20::681a:da6, 2606:4700:20::ac43:4be6 |
| Response IP | 104.26.13.166 |
| Found | Yes |
| Hash | d805f676e95a27561e748572d45ab36c2c21aac251aee1654206a79d6a42184f |
| SimHash | ca918d04df52 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /signup |
| Disallow | /login |
| Disallow | /import |
| Disallow | /search |
| Disallow | /collections/create |
| Disallow | /reviews/create |
| Disallow | /amp/ |
| Disallow | /settings/ |
| Disallow | /discover/* |
| Disallow | /developers/* |
| Disallow | /publishers/* |
| Disallow | /tags/* |
| Disallow | /games/*/reddit* |
| Disallow | /games/*/twitch* |
| Disallow | /games/*/updates* |
| Disallow | /games/*/imgur* |
| Disallow | /games/*/edit* |
| Disallow | /%40* |
| Disallow | /*filter%3D* |
| Disallow | /*filters%3D* |
| Disallow | /*tldr%3D* |
| Disallow | /*cache_off%3D |
Other Records
| Field | Value |
|---|---|
| sitemap | https://rawg.io/sitemap.xml |