lareclame.fr
robots.txt

Robots Exclusion Standard data for lareclame.fr

Resource Scan

Scan Details

Site Domain lareclame.fr
Base Domain lareclame.fr
Scan Status Ok
Last Scan2025-11-02T16:08:58+00:00
Next Scan 2025-11-09T16:08:58+00:00

Last Scan

Scanned2025-11-02T16:08:58+00:00
URL https://lareclame.fr/robots.txt
Domain IPs 104.26.4.66, 104.26.5.66, 172.67.73.23, 2606:4700:20::681a:442, 2606:4700:20::681a:542, 2606:4700:20::ac43:4917
Response IP 104.26.5.66
Found Yes
Hash 469d30bd02572ef89a477e6a9d9bac1cea6c2d19a0bca35d54632af753f6aa8a
SimHash e3140dc0e24e

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /xmlrpc.php
Disallow /wp-*.php
Disallow /trackback/
Disallow /?wptheme=
Disallow /?comments=
Disallow /?replytocom
Disallow /?s=
Disallow /comment-page-
Disallow /wp-json/
Disallow /feed/
Disallow /search
Disallow /wp-content/cache/min/1/wp-content/themes/la-reclame/js/algolia-search.js

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /feed/
Disallow /wp-json/

Other Records

Field Value
crawl-delay 5

googlebot-image

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow /wp-json/
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 10

amazonbot
applebot
petalbot
meta-externalagent
oai-searchbot
gptbot
claudebot
perplexitybot
bytespider
duckassistbot
ccbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://lareclame.fr/?feed=sitemap-news
sitemap https://lareclame.fr/sitemap.xml

Comments

  • Ralentissement des bots IA et assistants conversationnels