csedgo.fr
robots.txt

Robots Exclusion Standard data for csedgo.fr

Resource Scan

Scan Details

Site Domain csedgo.fr
Base Domain csedgo.fr
Scan Status Ok
Last Scan2025-11-02T19:24:10+00:00
Next Scan 2025-11-16T19:24:10+00:00

Last Scan

Scanned2025-11-02T19:24:10+00:00
URL https://csedgo.fr/robots.txt
Redirect https://www.csedgo.fr/robots.txt
Redirect Domain www.csedgo.fr
Redirect Base csedgo.fr
Domain IPs 178.32.112.217
Redirect IPs 178.32.112.217
Response IP 178.32.112.217
Found Yes
Hash 5daa5f3c04656b6ab28d6734bff72377009daed5aa30b234c7651e5a8723351a
SimHash 489f22b1e202

Groups

amazonbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

bingbot

Rule Path
Disallow /public/
Disallow /admin/
Disallow /classes/
Disallow /controllers/
Disallow /functions/
Disallow /modeles/
Disallow /tools/
Disallow /private/
Disallow /cron/
Disallow /acl/
Disallow /api/

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /public/
Disallow /admin/
Disallow /classes/
Disallow /controllers/
Disallow /functions/
Disallow /modeles/
Disallow /tools/
Disallow /private/
Disallow /cron/
Disallow /acl/
Disallow /api/