devforum.roblox.com
robots.txt
Robots Exclusion Standard data for devforum.roblox.com
Resource Scan
Scan Details
| Site Domain | devforum.roblox.com |
| Base Domain | roblox.com |
| Scan Status | Ok |
| Last Scan | 2024-05-24T12:43:52+00:00 |
| Next Scan | 2024-06-23T12:43:52+00:00 |
Last Scan
| Scanned | 2024-05-24T12:43:52+00:00 |
| URL | https://devforum.roblox.com/robots.txt |
| Domain IPs | 184.51.97.9, 2600:1413:b000:382::1c3d, 2600:1413:b000:394::1c3d |
| Response IP | 184.51.97.9 |
| Found | Yes |
| Hash | 9099ba9005bfaf6e63df5a97d2cdaeff965d7b18868454ba13280a77b89b148b |
| SimHash | 289d1d857770 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /auth/ |
| Disallow | /assets/browser-update*.js |
| Disallow | /email/ |
| Disallow | /session |
| Disallow | /user-api-key |
| Disallow | /*?api_key* |
| Disallow | /*?*api_key* |
| Disallow | /badges |
| Disallow | /u/ |
| Disallow | /my |
| Disallow | /search |
| Disallow | /tag/*/l |
| Disallow | /g |
| Disallow | /t/*/*.rss |
| Disallow | /c/*.rss |
| Disallow | /staff/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://devforum.roblox.com/sitemap.xml |
Comments