roosterteeth.com
robots.txt
Robots Exclusion Standard data for roosterteeth.com
Resource Scan
Scan Details
| Site Domain | roosterteeth.com |
| Base Domain | roosterteeth.com |
| Scan Status | Ok |
| Last Scan | 2024-11-03T21:25:03+00:00 |
| Next Scan | 2024-11-10T21:25:03+00:00 |
Last Scan
| Scanned | 2024-11-03T21:25:03+00:00 |
| URL | https://roosterteeth.com/robots.txt |
| Domain IPs | 3.81.237.184, 34.227.118.118, 35.169.149.209, 44.217.77.201 |
| Response IP | 35.169.149.209 |
| Found | Yes |
| Hash | f6c2106e4e92b8bcf6d850da8b7dd6bcc142bbfb161db62e4cb56fa7fec687bc |
| SimHash | 3c8cea8cc0d0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /oembed$ |
| Disallow | /oembed/$ |
| Disallow | /about |
| Disallow | /my-library |
| Disallow | /settings |
| Disallow | /api/ |
| Disallow | /g/user/ |
| Disallow | /show/ |
| Disallow | /sitemap.xml |
Other Records
| Field | Value |
|---|---|
| sitemap | https://svod-be.roosterteeth.com/sitemap.xml |
Comments