the-boys.cc
robots.txt
Robots Exclusion Standard data for the-boys.cc
Resource Scan
Scan Details
| Site Domain | the-boys.cc |
| Base Domain | the-boys.cc |
| Scan Status | Ok |
| Last Scan | 2025-09-04T14:58:27+00:00 |
| Next Scan | 2025-09-11T14:58:27+00:00 |
Last Scan
| Scanned | 2025-09-04T14:58:27+00:00 |
| URL | https://the-boys.cc/robots.txt |
| Domain IPs | 104.21.53.48, 172.67.209.2, 2606:4700:3032::6815:3530, 2606:4700:3035::ac43:d102 |
| Response IP | 104.21.53.48 |
| Found | Yes |
| Hash | d6c699bdf8034205b6f7ef399279e4f19f7c615ee555d5c0c1e70d8a04c97b41 |
| SimHash | 2375d76224fc |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /cast/ |
| Disallow | /network/ |
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /xmlrpc.php |
| Disallow | /template.html |
| Disallow | /search |
| Disallow | */trackback/ |
| Disallow | */feed/ |
| Disallow | */feed |
| Disallow | /wp-json/ |
| Disallow | */comments/ |
| Disallow | /?feed= |
| Disallow | /?s= |
| Disallow | /?wp-subscription-manager* |
| Disallow | */comment |
| Disallow | */attachment/* |
| Disallow | */page/* |
| Disallow | /account |
| Disallow | /author |
| Disallow | /genre |
| Disallow | /category |
| Disallow | /trending |
| Disallow | /contact |
| Disallow | /imdb |
| Disallow | /ratings |
| Disallow | /jwplayer |
| Disallow | /movies |
| Allow | /wp-content/uploads/ |
googlebot
| Rule | Path |
|---|---|
| Disallow | /cast |
| Disallow | /network |
| Disallow | /wp-admin |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /xmlrpc.php |
| Disallow | /search |
| Disallow | /wp-json/ |
| Disallow | */trackback/ |
| Disallow | */feed/ |
| Disallow | */feed |
| Disallow | */comments/ |
| Disallow | /?feed= |
| Disallow | *?* |
| Disallow | /?wp-subscription-manager* |
| Disallow | */comment |
| Disallow | */attachment/* |
| Disallow | /wp-includes/ |
| Disallow | */page/* |
| Disallow | /account |
| Disallow | /author |
| Disallow | /genre |
| Disallow | /category |
| Disallow | /trending |
| Disallow | /contact |
| Disallow | /imdb |
| Disallow | /ratings |
| Disallow | /jwplayer |
| Disallow | /movies |
| Disallow | /index |
| Allow | */uploads |
| Allow | */wp-content/cache/ |
| Allow | /*/*.js |
| Allow | /*/*.css |
| Allow | /wp-*.png |
| Allow | /wp-*.jpg |
| Allow | /wp-*.jpeg |
| Allow | /wp-*.gif |
| Allow | /wp-*.woff |
| Allow | /wp-*.ttf |
| Allow | */wp-content/plugins/ |
| Allow | /wp-content/uploads/2017/09/logo-1.png |
| Allow | /wp-content/themes/dooplay-child/ |
| Allow | /wp-admin/admin-ajax.php |
| Allow | /wp-includes/css/ |
| Allow | /wp-includes/js/ |
| Allow | /wp-includes/images/ |
| Allow | /wp-content/themes/*.css |
| Allow | /wp-content/themes/*.js |
| Allow | /wp-content/plugins/*.css |
| Allow | /wp-content/plugins/*.js |
| Allow | /wp-content/uploads/*.css |
| Allow | /wp-content/uploads/*.js |
| Allow | /wp-content/themes/dooplay/assets/css/*.css |
| Allow | /wp-content/themes/dooplay/assets/js/*.js |
*
| Rule | Path |
|---|---|
| Disallow | /cast |
| Disallow | /network |
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /xmlrpc.php |
| Disallow | /template.html |
| Disallow | /search |
| Disallow | */trackback/ |
| Disallow | */feed/ |
| Disallow | */feed |
| Disallow | */comments/ |
| Disallow | /?feed= |
| Disallow | /?s= |
| Disallow | /?wp-subscription-manager* |
| Disallow | */comment |
| Disallow | */attachment/* |
| Disallow | */page/* |
| Disallow | /account |
| Disallow | /author |
| Disallow | /genre |
| Disallow | /category |
| Disallow | /trending |
| Disallow | /contact |
| Disallow | /imdb |
| Disallow | /ratings |
| Disallow | /jwplayer |
| Disallow | /movies |
| Allow | /wp-content/uploads/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://the-boys.cc/sitemap_index.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.