remi-centrevaldeloire.fr
robots.txt

Robots Exclusion Standard data for remi-centrevaldeloire.fr

Resource Scan

Scan Details

Site Domain remi-centrevaldeloire.fr
Base Domain remi-centrevaldeloire.fr
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-21T23:47:04+00:00
Next Scan 2024-09-28T23:47:04+00:00

Last Successful Scan

Scanned2024-08-21T20:12:55+00:00
URL https://remi-centrevaldeloire.fr/robots.txt
Redirect https://www.remi-centrevaldeloire.fr/robots.txt
Redirect Domain www.remi-centrevaldeloire.fr
Redirect Base remi-centrevaldeloire.fr
Domain IPs 217.70.184.55
Redirect IPs 185.91.37.71
Response IP 185.91.37.71
Found Yes
Hash ba556e2bf839e159958aeaee2c5f86e780031f87013ff34a25b6c59e43cb7a47
SimHash 89555e834260

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-login.php
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /v1
Disallow /v2
Disallow /wp-snapshots
Disallow /category/*/*
Disallow */trackback
Disallow */feed
Disallow */comments
Disallow /*?
Disallow /*.js$
Disallow /*.inc$

googlebot

Rule Path
Disallow /*.css$
Disallow /*.gz$
Disallow /*.swf$
Disallow /*.wmv$
Disallow /*.cgi$
Disallow /*.xhtml$
Disallow /*.pdf$

googlebot-image

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

updownerbot

Rule Path
Disallow /