crbjbizwire.com
robots.txt
Robots Exclusion Standard data for crbjbizwire.com
Resource Scan
Scan Details
Site Domain | crbjbizwire.com |
Base Domain | crbjbizwire.com |
Scan Status | Ok |
Last Scan | 2024-10-04T10:26:02+00:00 |
Next Scan | 2024-10-11T10:26:02+00:00 |
Last Scan
Scanned | 2024-10-04T10:26:02+00:00 |
URL | https://crbjbizwire.com/robots.txt |
Redirect | https://charlestonbusiness.com/robots.txt |
Redirect Domain | charlestonbusiness.com |
Redirect Base | charlestonbusiness.com |
Domain IPs | 104.21.92.161, 172.67.195.175, 2606:4700:3033::6815:5ca1, 2606:4700:3033::ac43:c3af |
Redirect IPs | 104.21.89.225, 172.67.165.186, 2606:4700:3030::6815:59e1, 2606:4700:3036::ac43:a5ba |
Response IP | 104.21.89.225 |
Found | Yes |
Hash | c8f74ed9ff346489e2e66fe5e519ee8ee725311e755957ee55ee92d37082af4a |
SimHash | 292a48415671 |
Groups
*
Rule | Path | Comment |
---|---|---|
Disallow | /cgi-bin/ | - |
Disallow | /wp-admin/ | - |
Disallow | /wp-includes/ | - |
Disallow | /wp-content/plugins/ | - |
Disallow | /wp-content/cache/ | - |
Disallow | /wp-content/themes/ | - |
Allow | /wp-content/uploads/ | - |
Disallow | /feed/ | - |
Disallow | /trackback/ | - |
Disallow | /print/ | wp-print block |
Disallow | /index.php | separate directive for the main script file of WP |
Disallow | /*.php$ | - |
Disallow | /*.js$ | - |
Disallow | /*.inc$ | - |
Disallow | /*.css$ | - |
Disallow | */feed/ | - |
Disallow | */trackback/ | - |
Disallow | */print/ | - |