search.roblox.com
robots.txt
Robots Exclusion Standard data for search.roblox.com
Resource Scan
Scan Details
| Site Domain | search.roblox.com |
| Base Domain | roblox.com |
| Scan Status | Ok |
| Last Scan | 2024-11-13T22:08:05+00:00 |
| Next Scan | 2024-11-20T22:08:05+00:00 |
Last Scan
| Scanned | 2024-11-13T22:08:05+00:00 |
| URL | https://search.roblox.com/robots.txt |
| Redirect | https://www.roblox.com/robots.txt |
| Redirect Domain | www.roblox.com |
| Redirect Base | roblox.com |
| Domain IPs | 13.33.88.108, 13.33.88.123, 13.33.88.85, 13.33.88.88 |
| Redirect IPs | 3.165.82.100, 3.165.82.119, 3.165.82.18, 3.165.82.49 |
| Response IP | 3.165.102.44 |
| Found | Yes |
| Hash | 743817ea4431e1e4ca3f248102cb8429cd59e7e5e1ed5c572bdaa6de55243639 |
| SimHash | ecc3ff0dc954 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *.ashx |
| Disallow | /abusereport/ |
| Disallow | /*/abusereport/ |
| Disallow | /admi/ |
| Disallow | /ads/ |
| Disallow | /catalog/contents |
| Disallow | /catalog/html |
| Disallow | /client-status |
| Disallow | /data/ |
| Disallow | /error/ |
| Disallow | /forum/ |
| Disallow | /Forum/ |
| Disallow | /game/report-event |
| Disallow | /game/report-stats |
| Disallow | /ide/clienttoolbox |
| Disallow | /javascript/ |
| Disallow | /reports/ |
| Disallow | /thumbnail/remove-asset-media |
| Disallow | /thumbnail/resolve-hash |
| Disallow | /thumbnail_holder/g |
| Disallow | /viewapp/ |
| Disallow | /error.html |
| Disallow | /offline.html |
| Disallow | /badges/ |
| Disallow | /*/badges/ |
| Disallow | /*.aspx$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.roblox.com/sitemap.xml |