thebatorblog.com
robots.txt

Robots Exclusion Standard data for thebatorblog.com

Resource Scan

Scan Details

Site Domain thebatorblog.com
Base Domain thebatorblog.com
Scan Status Ok
Last Scan2026-03-18T19:37:37+00:00
Next Scan 2026-04-17T19:37:37+00:00

Last Scan

Scanned2026-03-18T19:37:37+00:00
URL https://thebatorblog.com/robots.txt
Domain IPs 104.26.4.110, 104.26.5.110, 172.67.68.107, 2606:4700:20::681a:46e, 2606:4700:20::681a:56e, 2606:4700:20::ac43:446b
Response IP 172.67.68.107
Found Yes
Hash 9a7663ef45838abc7d765fb959391e709b6bf4697d7eaff8dc837d1d22b7bdb5
SimHash e908de50c657

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /wp-content/uploads/wp-import-export-lite/

Other Records

Field Value
sitemap http://www.thebatorblog.com/index.php/sitemap.xml

Comments

  • WP Import Export Rule