alentoor.fr
robots.txt

Robots Exclusion Standard data for alentoor.fr

Resource Scan

Scan Details

Site Domain alentoor.fr
Base Domain alentoor.fr
Scan Status Ok
Last Scan2024-11-15T07:34:24+00:00
Next Scan 2024-11-22T07:34:24+00:00

Last Scan

Scanned2024-11-15T07:34:24+00:00
URL https://alentoor.fr/robots.txt
Redirect https://www.alentoor.fr/robots.txt
Redirect Domain www.alentoor.fr
Redirect Base alentoor.fr
Domain IPs 31.15.27.35
Redirect IPs 31.15.27.35
Response IP 31.15.27.35
Found Yes
Hash ab0562da3181b77d605c17c2d9a7b5920557070fece1c10108c42a2dc697785e
SimHash b26c38e8a971

Groups

*

Rule Path
Disallow *?offer=
Disallow *%26offer%3D
Disallow */inscription
Disallow /contact-email/
Disallow /abus-annonce/
Disallow *location%3D
Disallow *q%3D
Disallow *term%3D
Disallow *category%3D
Disallow *categories%5B%5D%3D
Disallow *date%5Bstart%5D%3D
Disallow *date%5Bend%5D%3D
Disallow */ajax/
Disallow */profil/
Disallow *sort%3D
Disallow *job-type%3D
Disallow /js/obf/
Disallow /connect/
Disallow /connection

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449

Warnings

  • `noindex` is not a known field.