Log In Sign Up

lawofficer.com
robots.txt

Robots Exclusion Standard data for lawofficer.com

Resource Scan

Scan Details

Site Domain lawofficer.com
Base Domain lawofficer.com
Scan Status Ok
Last Scan2024-09-29T16:40:10+00:00
Next Scan 2024-10-06T16:40:10+00:00

Last Scan

Scanned2024-09-29T16:40:10+00:00
URL https://lawofficer.com/robots.txt
Domain IPs 104.21.69.195, 172.67.212.201, 2606:4700:3033::6815:45c3, 2606:4700:3035::ac43:d4c9
Response IP 172.67.212.201
Found Yes
Hash 2d064ead3f6d17ada7e3424258178c7d468e7023204f2fd206ca273b9f484215
SimHash 06e8fa820db7

Groups

*

Rule Path
Disallow /wp-content/plugins/
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 20

mediapartners-google*

Rule Path
Allow /
Back to top

Comments

  • BEGIN xmlrpc.php BLOCK
  • RewriteEngine On
  • ErrorDocument 403 "Forbidden"
  • RewriteCond %{THE_REQUEST} "^POST /xmlrpc.php"
  • RewriteCond %{HTTP_USER_AGENT} "!^Jetpack by WordPress.com" [NC]
  • RewriteRule .* - [R=403,L]
  • END xmlrpc.php BLOCK
  • Block empty user agents and http referers
  • Aggressive Bots
Back to top

Warnings

  • 20 invalid lines.
Back to top