avonex.com
robots.txt

Robots Exclusion Standard data for avonex.com

Resource Scan

Scan Details

Site Domain avonex.com
Base Domain avonex.com
Scan Status Ok
Last Scan2025-12-06T03:05:27+00:00
Next Scan 2026-01-05T03:05:27+00:00

Last Scan

Scanned2025-12-06T03:05:27+00:00
URL https://avonex.com/robots.txt
Redirect https://www.avonex.com/robots.txt
Redirect Domain www.avonex.com
Redirect Base avonex.com
Domain IPs 3.94.239.194, 35.170.228.20
Redirect IPs 13.35.202.104, 13.35.202.57, 13.35.202.6, 13.35.202.93, 2600:9000:2078:1200:18:bebb:b800:93a1, 2600:9000:2078:3000:18:bebb:b800:93a1, 2600:9000:2078:9400:18:bebb:b800:93a1, 2600:9000:2078:9600:18:bebb:b800:93a1, 2600:9000:2078:e200:18:bebb:b800:93a1, 2600:9000:2078:e600:18:bebb:b800:93a1, 2600:9000:2078:ee00:18:bebb:b800:93a1, 2600:9000:2078:fe00:18:bebb:b800:93a1
Response IP 13.35.202.104
Found Yes
Hash 83a32354c1df5827038fc6fc23c50769e731c56992e4c3f6e84b2c3d0f24abe6
SimHash d092fcd64582

Groups

*

Rule Path
Disallow /en_us/home/sign-in.html
Disallow /en_us/home/sign-up.html
Disallow /en_us/home/forgot-password.html
Disallow /en_us/home/edit-profile.html
Disallow /en_us/cookies.html
Disallow /*?cid=
Disallow /*?lightbox=
Disallow /search.html?*

Other Records

Field Value
sitemap http://www.avonex.com/sitemap.xml

Comments

  • Updated 05/12/23
  • Disallow modals, error, search, utility and ? pages
  • Make sure to check for en_us vs. en-us