jeromeweb.net
robots.txt

Robots Exclusion Standard data for jeromeweb.net

Resource Scan

Scan Details

Site Domain jeromeweb.net
Base Domain jeromeweb.net
Scan Status Ok
Last Scan2025-09-30T16:54:09+00:00
Next Scan 2025-10-07T16:54:09+00:00

Last Scan

Scanned2025-09-30T16:54:09+00:00
URL https://jeromeweb.net/robots.txt
Domain IPs 91.121.46.82
Response IP 91.121.46.82
Found Yes
Hash b934c243829544ff765cf3ba15c410e33cf1b0c6f39c083b47dda16361146ecd
SimHash 6dc2c884e2b1

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-login.php

Comments

  • Disallow: /2011/
  • Disallow: /2012/
  • Disallow: /2013/
  • Disallow: /2014/
  • Disallow: /page/
  • Disallow: autorisartion du crawl
  • Disallow: /tag/
  • Disallow: /category/
  • Disallow: /category/*/page/*
  • Disallow: /*/feed
  • Disallow: /*/comments