universcience.fr
robots.txt

Robots Exclusion Standard data for universcience.fr

Resource Scan

Scan Details

Site Domain universcience.fr
Base Domain universcience.fr
Scan Status Ok
Last Scan2024-05-23T07:14:23+00:00
Next Scan 2024-06-22T07:14:23+00:00

Last Scan

Scanned2024-05-23T07:14:23+00:00
URL https://universcience.fr/robots.txt
Redirect https://www.universcience.fr/robots.txt
Redirect Domain www.universcience.fr
Redirect Base universcience.fr
Domain IPs 194.199.143.9, 83.118.219.16
Redirect IPs 184.27.122.163, 184.27.122.67
Response IP 184.27.123.123
Found Yes
Hash 3980ec4e4ca2d9147f8ebf17b42b2a0f11c38118bd3b3feed2bbafe8fe1efad1
SimHash e94548627730

Groups

*

Rule Path
Disallow /uploads/
Disallow /typo3temp/
Disallow /typo3conf/
Allow /uploads/media/

flamingo_searchengine (+http://www.flamingosearch.com/bot)

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

mozilla/5.0 (compatible; megaindex.ru/2.0; +https://www.megaindex.ru/?tab=linkanalyze)

Rule Path
Disallow /

Comments

  • User-agent: *
  • Disallow: /
  • 2015-03-25
  • 2015-03-30