olivierdesforges.fr
robots.txt

Robots Exclusion Standard data for olivierdesforges.fr

Resource Scan

Scan Details

Site Domain olivierdesforges.fr
Base Domain olivierdesforges.fr
Scan Status Ok
Last Scan2024-10-29T01:42:09+00:00
Next Scan 2024-11-28T01:42:09+00:00

Last Scan

Scanned2024-10-29T01:42:09+00:00
URL https://www.olivierdesforges.fr/robots.txt
Domain IPs 18.155.68.31, 18.155.68.54, 18.155.68.67, 18.155.68.7
Response IP 18.155.68.67
Found Yes
Hash 2b7f4311ed461aaf3eaa4ea7517fbd9ad510d65aeb1c4f28831af769ad0a4e1b
SimHash 719c21e4bf05

Groups

adsbot-google

Rule Path
Disallow
Allow /catalogsearch
Allow /*LGWCODE

*

Rule Path
Disallow /plugincompany
Disallow /*LGWCODE
Disallow /?p=*&t=*
Disallow /mynewsletter/
Disallow /catalogsearch/
Disallow /*.html?*limit=*
Disallow /filtre-de-menu/*
Disallow /landing-page-test
Disallow /liste.php
Disallow /*tendance_couleur%3D*
Disallow /*category_id%3D*
Disallow /p/s/
Disallow /shop-connection
Disallow /shop-connection
Disallow /*_taille*
Disallow /*dh_yd_matiere*
Disallow /*manufacturer*
Disallow *utm_*
Disallow /?amp
Disallow *amp%3Bp
Disallow *p%3D*p%3D
Disallow *dir%3D*
Disallow *order%3D*
Disallow /*p%3D1
Disallow /js/*digitalhome-*js
Disallow /f-*p%3D*
Disallow /*yandex
Disallow /checkout/
Disallow /*ajax
Disallow /checkout/
Disallow *digital*
Disallow /*ajax
Disallow *dir%3D
Disallow *limit%3D
Disallow *order%3D
Disallow /dhcat*
Disallow /checko*
Disallow *?___store=

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

openai-crawler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

chatgpt-user

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

claudebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10