agents-shield.com
robots.txt
Robots Exclusion Standard data for agents-shield.com
Resource Scan
Scan Details
| Site Domain | agents-shield.com |
| Base Domain | agents-shield.com |
| Scan Status | Ok |
| Last Scan | 2025-09-03T00:44:43+00:00 |
| Next Scan | 2025-09-10T00:44:43+00:00 |
Last Scan
| Scanned | 2025-09-03T00:44:43+00:00 |
| URL | https://agents-shield.com/robots.txt |
| Domain IPs | 82.202.161.171 |
| Response IP | 82.202.161.171 |
| Found | Yes |
| Hash | 3731b20988ea743e1799ffbfdce370833fe7aa3e0734722450040fe523acc6b9 |
| SimHash | 637557672c7c |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /cast |
| Disallow | /network |
| Disallow | /tvshows |
| Disallow | /wp-admin |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /xmlrpc.php |
| Disallow | /search |
| Disallow | /wp-json/ |
| Disallow | */trackback/ |
| Disallow | */feed/ |
| Disallow | */feed |
| Disallow | */comments/ |
| Disallow | /?feed= |
| Disallow | *?* |
| Disallow | /?wp-subscription-manager* |
| Disallow | */comment |
| Disallow | */attachment/* |
| Disallow | /wp-includes/ |
| Disallow | */page/* |
| Disallow | /account |
| Disallow | /author |
| Disallow | /genre |
| Disallow | /category |
| Disallow | /trending |
| Disallow | /contact |
| Disallow | /imdb |
| Disallow | /ratings |
| Disallow | /jwplayer |
| Disallow | /movies |
| Disallow | /index |
| Allow | */uploads |
| Allow | */wp-content/cache/ |
| Allow | /*/*.js |
| Allow | /*/*.css |
| Allow | /wp-*.png |
| Allow | /wp-*.jpg |
| Allow | /wp-*.jpeg |
| Allow | /wp-*.gif |
| Allow | /wp-*.woff |
| Allow | /wp-*.ttf |
| Allow | */wp-content/plugins/ |
| Allow | /wp-content/uploads/2017/09/logo-1.png |
| Allow | /wp-content/themes/dooplay-child/ |
| Allow | /wp-admin/admin-ajax.php |
| Allow | /wp-includes/css/ |
| Allow | /wp-includes/js/ |
| Allow | /wp-includes/images/ |
| Allow | /wp-content/themes/*.css |
| Allow | /wp-content/themes/*.js |
| Allow | /wp-content/plugins/*.css |
| Allow | /wp-content/plugins/*.js |
| Allow | /wp-content/uploads/*.css |
| Allow | /wp-content/uploads/*.js |
| Allow | /wp-content/themes/dooplay/assets/css/*.css |
| Allow | /wp-content/themes/dooplay/assets/js/*.js |
*
| Rule | Path |
|---|---|
| Disallow | /cast |
| Disallow | /network |
| Disallow | /tvshows |
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /xmlrpc.php |
| Disallow | /template.html |
| Disallow | /search |
| Disallow | */trackback/ |
| Disallow | */feed/ |
| Disallow | */feed |
| Disallow | */comments/ |
| Disallow | /?feed= |
| Disallow | /?s= |
| Disallow | /?wp-subscription-manager* |
| Disallow | */comment |
| Disallow | */attachment/* |
| Disallow | */page/* |
| Disallow | /account |
| Disallow | /author |
| Disallow | /genre |
| Disallow | /category |
| Disallow | /trending |
| Disallow | /contact |
| Disallow | /imdb |
| Disallow | /ratings |
| Disallow | /jwplayer |
| Disallow | /movies |
| Allow | /wp-content/uploads/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://agents-shield.com/sitemap_index.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.