calculatorr.com
robots.txt

Robots Exclusion Standard data for calculatorr.com

Resource Scan

Scan Details

Site Domain calculatorr.com
Base Domain calculatorr.com
Scan Status Ok
Last Scan2025-09-24T00:59:08+00:00
Next Scan 2025-10-01T00:59:08+00:00

Last Scan

Scanned2025-09-24T00:59:08+00:00
URL https://calculatorr.com/robots.txt
Domain IPs 104.21.37.201, 172.67.212.227, 2606:4700:3032::6815:25c9, 2606:4700:3033::ac43:d4e3
Response IP 104.21.37.201
Found Yes
Hash 427082deac2ec0093315262822c04e0597654c7d516fd1428f1aca8e24dd61f5
SimHash 425cdd454632

Groups

*

Rule Path
Allow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://calculatorr.com/sitemap.xml

Comments

  • -------------------------------------
  • General rules for all bots
  • -------------------------------------
  • -------------------------------------
  • Sitemaps (use absolute URLs)
  • -------------------------------------
  • -------------------------------------
  • Crawl-delay for aggressive bots
  • -------------------------------------