the-chaser.com
robots.txt
Robots Exclusion Standard data for the-chaser.com
Resource Scan
Scan Details
| Site Domain | the-chaser.com |
| Base Domain | the-chaser.com |
| Scan Status | Ok |
| Last Scan | 2024-11-01T10:46:18+00:00 |
| Next Scan | 2024-11-08T10:46:18+00:00 |
Last Scan
| Scanned | 2024-11-01T10:46:18+00:00 |
| URL | https://the-chaser.com/robots.txt |
| Domain IPs | 27.133.241.70 |
| Response IP | 27.133.241.70 |
| Found | Yes |
| Hash | e02e2d4803496fe25c9b0f6d7c916076abd2da89d8735b5955fa363a22390fe1 |
| SimHash | 2f5881228312 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /* |
| Allow | /$ |
| Allow | /app-ads.txt$ |
| Allow | /*.gif$ |
| Allow | /*.jpg$ |
| Allow | /*.png$ |
| Allow | /tw$ |
| Allow | /tw_lp$ |
| Allow | /tw_lp_kale$ |
| Allow | /tw_lp_ld$ |
| Allow | /tw_lp_lb$ |
| Allow | /tw_lp_sf$ |
| Allow | /tw_lp_vb$ |
| Allow | /tw_lp_ht$ |
| Allow | /tw_lp_lily$ |
| Allow | /tw_lp_ngr$ |
| Allow | /tw_lp_wd$ |