bcraftmath.com
robots.txt

Robots Exclusion Standard data for bcraftmath.com

Resource Scan

Scan Details

Site Domain bcraftmath.com
Base Domain bcraftmath.com
Scan Status Ok
Last Scan2025-09-01T10:51:03+00:00
Next Scan 2025-09-08T10:51:03+00:00

Last Scan

Scanned2025-09-01T10:51:03+00:00
URL https://bcraftmath.com/robots.txt
Redirect https://www.bcraftmath.com/robots.txt
Redirect Domain www.bcraftmath.com
Redirect Base bcraftmath.com
Domain IPs 199.36.158.100
Redirect IPs 199.36.158.100, 2620:0:890::100
Response IP 199.36.158.100
Found Yes
Hash 67f21513c5bb6623aba8a0404a5a56702d43281d4a575c15628dcc36600daad3
SimHash 6086dd53a235

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.bcraftmath.com/sitemap.xml

Comments

  • Sitemap location
  • Crawl delay (optional, helps with server load)