riffx.fr
robots.txt

Robots Exclusion Standard data for riffx.fr

Resource Scan

Scan Details

Site Domain riffx.fr
Base Domain riffx.fr
Scan Status Ok
Last Scan2026-02-07T21:24:21+00:00
Next Scan 2026-03-09T21:24:21+00:00

Last Scan

Scanned2026-02-07T21:24:21+00:00
URL https://riffx.fr/robots.txt
Redirect https://www.riffx.fr/robots.txt
Redirect Domain www.riffx.fr
Redirect Base riffx.fr
Domain IPs 217.147.199.226
Redirect IPs 217.147.199.225
Response IP 217.147.204.82
Found Yes
Hash 1ba43e871e73e62a125d77d229c26a521e87b32bd4d2d2eebb096fd1db0d4c79
SimHash 2ae5ea78d0b1

Groups

*

Rule Path
Disallow /secupress-725adc16/
Disallow /wp-content/uploads/riffx-festivals-apps/*
Disallow /*type-events%3D
Disallow /*events-categories%3D
Disallow /*events-styles%3D
Disallow /*redirect_to%3D
Disallow /*roles-artistes%3D
Disallow /*talents-styles%3D
Disallow /*styles%3D
Disallow /*styles-podcasts%3D
Disallow /*tags%5B%5D%3D
Disallow /*regions%3D
Disallow /*s%3D

baiduspider

Rule Path
Disallow /

yahoo! slurp china

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

archive.org_bot
semrushbot
yandeximages

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

noxtrumbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

url_spider_pro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

web image collector

Rule Path
Disallow /

xenu's link sleuth 1.1c

Rule Path
Disallow /

xenu's

Rule Path
Disallow /

zeus

Rule Path
Disallow /

zeus link scout

Rule Path
Disallow /

erocrawler

Rule Path
Disallow /

linkscan/8.1a unix

Rule Path
Disallow /

keyword density/0.9

Rule Path
Disallow /

webcopier v3.2a

Rule Path
Disallow /

webcapture 2.0

Rule Path
Disallow /

webcopier v.2.2

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

black hole

Rule Path
Disallow /

xenu\\\'s link sleuth 1.1c

Rule Path
Disallow /

xenu\\\'s

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.riffx.fr/post-sitemap.xml
sitemap https://www.riffx.fr/post-sitemap2.xml
sitemap https://www.riffx.fr/post-sitemap3.xml
sitemap https://www.riffx.fr/page-sitemap.xml
sitemap https://www.riffx.fr/conseils-sitemap.xml

Comments

  • SPECIFIC BOTS SETTINGS
  • VALIDATED SITEMAPS

Warnings

  • 1 invalid line.
  • `visit-time` is not a known field.