comparehearingaids.org
robots.txt

Robots Exclusion Standard data for comparehearingaids.org

Resource Scan

Scan Details

Site Domain comparehearingaids.org
Base Domain comparehearingaids.org
Scan Status Ok
Last Scan2025-12-27T18:53:57+00:00
Next Scan 2026-01-26T18:53:57+00:00

Last Scan

Scanned2025-12-27T18:53:57+00:00
URL https://comparehearingaids.org/robots.txt
Redirect https://www.comparehearingaids.org/robots.txt
Redirect Domain www.comparehearingaids.org
Redirect Base comparehearingaids.org
Domain IPs 104.21.60.95, 172.67.195.129, 2606:4700:3032::6815:3c5f, 2606:4700:3032::ac43:c381
Redirect IPs 104.21.60.95, 172.67.195.129, 2606:4700:3032::6815:3c5f, 2606:4700:3032::ac43:c381
Response IP 172.67.195.129
Found Yes
Hash 0bf5fa44364fabe664a93b8c7196cb88b8ad34fe7f8c39a52151c6e5b5becb32
SimHash 494cc890e693

Groups

scrapy

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.comparehearingaids.org/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK