epilation-definitive-toulouse.fr
robots.txt

Robots Exclusion Standard data for epilation-definitive-toulouse.fr

Resource Scan

Scan Details

Site Domain epilation-definitive-toulouse.fr
Base Domain epilation-definitive-toulouse.fr
Scan Status Ok
Last Scan2024-11-13T07:43:42+00:00
Next Scan 2024-12-13T07:43:42+00:00

Last Scan

Scanned2024-11-13T07:43:42+00:00
URL https://epilation-definitive-toulouse.fr/robots.txt
Redirect https://www.epilation-definitive-toulouse.fr/robots.txt
Redirect Domain www.epilation-definitive-toulouse.fr
Redirect Base epilation-definitive-toulouse.fr
Domain IPs 78.40.9.66
Redirect IPs 78.40.9.66
Response IP 78.40.9.66
Found Yes
Hash f3783e5489e7ac26def1a6391166d154afb627a716081a7aeaaea93c4d16d7f9
SimHash 0d5053b1d711

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Allow /

apis-google

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

adsbot-google-mobile-apps

Rule Path
Allow /

bingbot

Rule Path
Allow /

adidxbot

Rule Path
Allow /

bingpreview

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

baiduspider-image

Rule Path
Allow /

baiduspider-video

Rule Path
Allow /

baiduspider-news

Rule Path
Allow /

baiduspider-favo

Rule Path
Allow /

baiduspider-cpro

Rule Path
Allow /

baiduspider-ads

Rule Path
Allow /

yandexbot

Rule Path
Allow /

exabot

Rule Path
Allow /

facebot

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

msnbot

Rule Path
Allow /

voilabot

Rule Path
Allow /

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449