giantbomb.com
robots.txt
Robots Exclusion Standard data for giantbomb.com
Resource Scan
Scan Details
| Site Domain | giantbomb.com |
| Base Domain | giantbomb.com |
| Scan Status | Ok |
| Last Scan | 2024-10-10T14:52:45+00:00 |
| Next Scan | 2024-10-17T14:52:45+00:00 |
Last Scan
| Scanned | 2024-10-10T14:52:45+00:00 |
| URL | https://giantbomb.com/robots.txt |
| Redirect | https://www.giantbomb.com/robots.txt |
| Redirect Domain | www.giantbomb.com |
| Redirect Base | giantbomb.com |
| Domain IPs | 199.232.208.194, 199.232.212.194 |
| Redirect IPs | 199.232.208.194, 199.232.212.194 |
| Response IP | 199.232.44.194 |
| Found | Yes |
| Hash | aa6cc85e6871887661c103676937509dfb9853626b01c9a32a6b6359ad003228 |
| SimHash | d35c99517380 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /api/$ |
| Disallow | /api/* |
| Disallow | /notifications/ |
| Disallow | /search/ |
| Disallow | *login%3D* |
| Disallow | /videos/embed |
| Disallow | /videos/feed/ |
| Disallow | /podcast-xml/*premium* |
| Disallow | /wiki/moderation/ |
| Disallow | /postRender |
| Disallow | /forums/*/flag/ |
| Disallow | /forums/*/delete/ |
| Disallow | /forums/*/edit/ |
| Disallow | /forums/*/lock/ |
| Disallow | /forums/*/anchor/ |
| Disallow | /forums/*/add-to-favorite/ |
| Disallow | /forums/*/best-answer/*/ |
| Disallow | /jsonsearch/ |
| Disallow | /chat/ |
Comments