fermenet.com
robots.txt

Robots Exclusion Standard data for fermenet.com

Resource Scan

Scan Details

Site Domain fermenet.com
Base Domain fermenet.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-10-12T12:41:37+00:00
Next Scan 2025-10-26T12:41:37+00:00

Last Successful Scan

Scanned2025-09-27T08:35:16+00:00
URL http://fermenet.com/robots.txt
Redirect http://www.fermenet.com/robots.txt
Redirect Domain www.fermenet.com
Redirect Base fermenet.com
Domain IPs 185.153.8.201
Redirect IPs 185.153.8.201
Response IP 185.153.8.201
Found Yes
Hash f0de1d3fc50914f1df7f913508715e34c5fdcc71cba6b6d58ddda7a195b2fb7f
SimHash a11686d2c793

Groups

*

Rule Path
Disallow /ajax/
Disallow /*?illicite=
Disallow /*?faq=
Disallow /*?s=
Disallow /*?ref=
Disallow /cdn-cgi/

mj12bot
geedobot
seekportbot
imagesiftbot

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.fermenet.com/sitemap.xml

Comments

  • Blocage de bots
  • Sitemap