farzohair.com
robots.txt

Robots Exclusion Standard data for farzohair.com

Resource Scan

Scan Details

Site Domain farzohair.com
Base Domain farzohair.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-08-01T00:48:28+00:00
Next Scan 2025-10-30T00:48:28+00:00

Last Successful Scan

Scanned2024-12-12T00:46:07+00:00
URL https://farzohair.com/robots.txt
Redirect https://www.farzohair.com/robots.txt
Redirect Domain www.farzohair.com
Redirect Base farzohair.com
Domain IPs 54.183.102.22
Redirect IPs 18.176.133.53, 54.95.115.3
Response IP 54.95.115.3
Found Yes
Hash 96f22b21a568398d37441e14c64a6674934e9fc8aaa1bc4616cbcc41ed12213d
SimHash aa8d6fad6440

Groups

semrushbot

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.farzohair.com/sitemap.xml

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-Agent: *
  • Disallow: /