theindustryobserver.com.au
robots.txt
Robots Exclusion Standard data for theindustryobserver.com.au
Resource Scan
Scan Details
| Site Domain | theindustryobserver.com.au |
| Base Domain | theindustryobserver.com.au |
| Scan Status | Ok |
| Last Scan | 2024-09-26T16:44:39+00:00 |
| Next Scan | 2024-10-03T16:44:39+00:00 |
Last Scan
| Scanned | 2024-09-26T16:44:39+00:00 |
| URL | https://theindustryobserver.com.au/robots.txt |
| Redirect | https://themusicnetwork.com/robots.txt |
| Redirect Domain | themusicnetwork.com |
| Redirect Base | themusicnetwork.com |
| Domain IPs | 104.21.16.130, 172.67.212.183, 2606:4700:3035::6815:1082, 2606:4700:3036::ac43:d4b7 |
| Redirect IPs | 104.21.76.183, 172.67.198.230, 2606:4700:3033::ac43:c6e6, 2606:4700:3036::6815:4cb7 |
| Response IP | 104.21.76.183 |
| Found | Yes |
| Hash | df655fb3f35eafcf45c1ee5f85c2b0c8bf9e813ad6eae914380af90844eea028 |
| SimHash | 21211a0047b4 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Allow | /wp-includes/js/jquery/jquery.js |
mediapartners-google
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Allow | /wp-includes/js/jquery/jquery.js |
adsbot-google
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Allow | /wp-includes/js/jquery/jquery.js |
bingbot
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Allow | /wp-includes/js/jquery/jquery.js |
msnbot
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Allow | /wp-includes/js/jquery/jquery.js |