actualitesdudroit.fr
robots.txt
Robots Exclusion Standard data for actualitesdudroit.fr
Resource Scan
Scan Details
| Site Domain | actualitesdudroit.fr |
| Base Domain | actualitesdudroit.fr |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-28T16:34:34+00:00 |
| Next Scan | 2024-10-27T16:34:34+00:00 |
Last Successful Scan
| Scanned | 2022-10-07T17:08:36+00:00 |
| URL | https://www.actualitesdudroit.fr/robots.txt |
| Response IP | 185.86.171.89 |
| Found | Yes |
| Hash | 178611a10761c77dfc62b38c3bb37a215eb244c81416a5b6a2bb625ff69569ab |
| SimHash | 2c108282d5f5 |
Groups
googlebot
googlebot-news
googlebot-image
googlebot-video
googlebot-mobile
adsbot-google-mobile-apps
adsbot-google
mediapartners-google
bingbot
bingpreview
msnbot
msnbot-media
adidxbot
applebot
applenewsbot
teoma
duckduckbot
duckduckgo-favicons-bot
lycos
orangebot
qwantify
slurp
facebot
linkedinbot
twitterbot
pinterest
ccbot
dazoobot
euripbot
feedly
findxbot
netvibes
wotbox
yioopbot
| Rule | Path |
|---|---|
| Disallow | /account |
| Disallow | /admin |
| Disallow | /api |
| Disallow | /*?DATA= |
| Disallow | /*?usertoken= |
*
| Rule | Path |
|---|---|
| Disallow | / |