cienum.fr
robots.txt

Robots Exclusion Standard data for cienum.fr

Resource Scan

Scan Details

Site Domain cienum.fr
Base Domain cienum.fr
Scan Status Ok
Last Scan2024-10-28T09:18:44+00:00
Next Scan 2024-11-27T09:18:44+00:00

Last Scan

Scanned2024-10-28T09:18:44+00:00
URL http://cienum.fr/robots.txt
Redirect http://www.cienum.fr/robots.txt
Redirect Domain www.cienum.fr
Redirect Base cienum.fr
Domain IPs 91.103.233.82
Redirect IPs 91.103.233.82
Response IP 91.103.233.82
Found Yes
Hash 6bbe4ea9313ee5112702be1f960f3a93a2ac62a3691f82244d94c426002b191f
SimHash 091c98d0cbe3

Groups

*

Rule Path
Allow /
Disallow /autoload
Disallow /bin
Disallow /cronjobs
Disallow /extension
Disallow /kernel
Disallow /lib
Disallow /packages
Disallow /php-spec
Disallow /pub
Disallow /schemas
Disallow /settings
Disallow /share
Disallow /support
Disallow /update
Disallow /var

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

Other Records

Field Value
sitemap http://www.cienum.fr/sitemap.xml