steamdb.info
robots.txt
Robots Exclusion Standard data for steamdb.info
Resource Scan
Scan Details
| Site Domain | steamdb.info |
| Base Domain | steamdb.info |
| Scan Status | Ok |
| Last Scan | 2024-10-09T09:18:34+00:00 |
| Next Scan | 2024-11-08T09:18:34+00:00 |
Last Scan
| Scanned | 2024-10-09T09:18:34+00:00 |
| URL | https://steamdb.info/robots.txt |
| Domain IPs | 104.22.72.111, 104.22.73.111, 172.67.21.93, 2606:4700:10::6816:486f, 2606:4700:10::6816:496f, 2606:4700:10::ac43:155d |
| Response IP | 104.22.72.111 |
| Found | Yes |
| Hash | 1bb788072f4e1aec7d7e6160f805ae7a0d8c67936d7487bf08b9f440c0caeaa7 |
| SimHash | fdc594d0f692 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /calculator/$ |
| Allow | /instantsearch/$ |
| Allow | /login/$ |
| Allow | /search/$ |
| Disallow | /*?cc=* |
| Disallow | /api/PatchnotesRSS/ |
| Disallow | /api/Preview/ |
| Disallow | /api/RenderAppHover/ |
| Disallow | /app/*.jpg |
| Disallow | /app/*.png |
| Disallow | /app/*/depots/?branch=* |
| Disallow | /app/*/history/?changeid=* |
| Disallow | /blog/?q=* |
| Disallow | /bundle/*/?changeid=* |
| Disallow | /calculator/ |
| Disallow | /changelist/ |
| Disallow | /charts/?compare=* |
| Disallow | /depot/*/history/?changeid=* |
| Disallow | /embed/ |
| Disallow | /graph/?compare=* |
| Disallow | /instantsearch/ |
| Disallow | /login/ |
| Disallow | /patchnotes/*.png |
| Disallow | /search/ |
| Disallow | /sub/*/history/?changeid=* |
| Disallow | /topsellers/*.png |
| Disallow | /user/ |
| Disallow | /watching/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://steamdb.info/sitemap.xml |