octobre-editions.com
robots.txt

Robots Exclusion Standard data for octobre-editions.com

Resource Scan

Scan Details

Site Domain octobre-editions.com
Base Domain octobre-editions.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-18T17:07:20+00:00
Next Scan 2024-06-01T17:07:20+00:00

Last Successful Scan

Scanned2024-04-12T16:50:57+00:00
URL https://octobre-editions.com/robots.txt
Domain IPs 216.137.52.113, 216.137.52.32, 216.137.52.54, 216.137.52.91
Response IP 18.165.171.41
Found Yes
Hash 0714d3699b9cd189b90498a758873c5ce8c7ead13c40831b40b1aa523b896d90
SimHash 595cdc18c7b0

Groups

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

mj12bot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

*

Rule Path
Disallow /paiement/
Disallow /*/quickshop
Disallow /*/popin/
Disallow /*/popins/
Disallow /*/popin/ajout-rapide-panier
Disallow /*displayMode%3Dcolumn
Disallow /*/wishlist/
Disallow /*displayMode%3Dedito
Disallow /*?s%5B0%5D=
Disallow /*/footer

Other Records

Field Value
sitemap https://www.octobre-editions.com/sitemap.xml

Comments

  • Pinterest
  • Majestic bot
  • Barkrowler bot
  • BLEXBot Webmeup bot
  • Other crawlers