hairsalonaventura.com
robots.txt

Robots Exclusion Standard data for hairsalonaventura.com

Resource Scan

Scan Details

Site Domain hairsalonaventura.com
Base Domain hairsalonaventura.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-08-09T08:48:34+00:00
Next Scan 2024-11-07T08:48:34+00:00

Last Successful Scan

Scanned2022-08-21T01:16:09+00:00
URL https://hairsalonaventura.com/robots.txt
Response IP 172.67.182.226
Found Yes
Hash 0006370e5d5ebcfeb59e35f41a8601aa1aae0d16539116bbdac53837d7f3fd1f
SimHash 48449c5027d0

Groups

*

Rule Path
Disallow

googlebot

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

pirst

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /

embedly

Rule Path
Disallow /

flaxcrawler

Rule Path
Disallow /

faraday

Rule Path
Disallow /

Other Records

Field Value
sitemap https://hr.hairsalonaventura.com/sitemap.xml

Warnings

  • 2 invalid lines.
  • `host` is not a known field.