forums.cnetfrance.fr
robots.txt

Robots Exclusion Standard data for forums.cnetfrance.fr

Resource Scan

Scan Details

Site Domain forums.cnetfrance.fr
Base Domain cnetfrance.fr
Scan Status Ok
Last Scan2024-08-29T14:19:46+00:00
Next Scan 2024-09-28T14:19:46+00:00

Last Scan

Scanned2024-08-29T14:19:46+00:00
URL https://forums.cnetfrance.fr/robots.txt
Domain IPs 91.220.85.88
Response IP 91.220.85.88
Found Yes
Hash c066dd75802d2bd4a98812dc9c3d2a8dcdd376d60c828572f5ea8cf15d0596b6
SimHash 7b59d8d0c692

Groups

*

Rule Path
Disallow /memberlist
Disallow /calendar
Disallow /member/*
Disallow /?sort=
Disallow /search
Disallow /newreply
Disallow /printthread
Disallow /sendmessage
Disallow /subscription
Disallow /newthread.php
Disallow /index.php
Disallow /showthread
Disallow /membres/
Disallow /archive/
Disallow /user/
Disallow /ajax/

blexbot
trendictionbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10