euroinvestor.com
robots.txt

Robots Exclusion Standard data for euroinvestor.com

Resource Scan

Scan Details

Site Domain euroinvestor.com
Base Domain euroinvestor.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-08-30T11:20:21+00:00
Next Scan 2024-11-28T11:20:21+00:00

Last Successful Scan

Scanned2024-02-03T09:31:28+00:00
URL https://euroinvestor.com/robots.txt
Redirect https://www.euroinvestor.dk/robots.txt
Redirect Domain www.euroinvestor.dk
Redirect Base euroinvestor.dk
Domain IPs 18.202.75.72, 52.30.82.76, 99.81.43.218
Redirect IPs 96.17.96.28, 96.17.96.6
Response IP 104.88.70.139
Found Yes
Hash 95bd6ed910ceab972eb4834d67927848880f095826f9f5c9225c6d077a0a2f3e
SimHash 6e80fc002a32

Groups

*

Rule Path
Disallow /api
Disallow /reset_password
Disallow /logout
Disallow /login
Disallow /showMore
Disallow /image_gallery/
Disallow /tracking/image_gallery/
Disallow /search

Other Records

Field Value
crawl-delay 10

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449