thebrag.com
robots.txt
Robots Exclusion Standard data for thebrag.com
Resource Scan
Scan Details
| Site Domain | thebrag.com |
| Base Domain | thebrag.com |
| Scan Status | Ok |
| Last Scan | 2024-05-12T19:01:48+00:00 |
| Next Scan | 2024-05-19T19:01:48+00:00 |
Last Scan
| Scanned | 2024-05-12T19:01:48+00:00 |
| URL | https://thebrag.com/robots.txt |
| Domain IPs | 104.26.8.170, 104.26.9.170, 172.67.70.18, 2606:4700:20::681a:8aa, 2606:4700:20::681a:9aa, 2606:4700:20::ac43:4612 |
| Response IP | 172.67.70.18 |
| Found | Yes |
| Hash | 1eadbeb9c6a4a4f91c92a8557c7299e317ddfcb155ec8e99efc82d78475e5284 |
| SimHash | 282019054fe4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /beta/ |
googlebot
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Allow | /wp-includes/js/jquery/jquery.js |
mediapartners-google
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Allow | /wp-includes/js/jquery/jquery.js |
adsbot-google
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Allow | /wp-includes/js/jquery/jquery.js |
bingbot
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Allow | /wp-includes/js/jquery/jquery.js |
msnbot
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Allow | /wp-includes/js/jquery/jquery.js |
msnbot-media
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Allow | /wp-includes/js/jquery/jquery.js |
Comments