michiganstateuniversityonline.com
robots.txt

Robots Exclusion Standard data for michiganstateuniversityonline.com

Resource Scan

Scan Details

Site Domain michiganstateuniversityonline.com
Base Domain michiganstateuniversityonline.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-05T23:53:51+00:00
Next Scan 2024-12-04T23:53:51+00:00

Last Successful Scan

Scanned2024-01-17T23:01:25+00:00
URL https://michiganstateuniversityonline.com/robots.txt
Redirect https://www.michiganstateuniversityonline.com:443/robots.txt
Redirect Domain www.michiganstateuniversityonline.com
Redirect Base michiganstateuniversityonline.com
Domain IPs 23.22.35.241, 44.205.195.7
Redirect IPs 13.33.88.10, 13.33.88.49, 13.33.88.51, 13.33.88.96
Response IP 52.222.174.29
Found Yes
Hash 3fe6982e533653e28920461c83cf71eb4cb9223aea9f9fdccf699251c720676c
SimHash 69119d028fb4

Groups

googlebot

Rule Path
Disallow /feed/
Disallow /_Incapsula_Resource*

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.michiganstateuniversityonline.com/sitemap.xml
sitemap https://www.michiganstateuniversityonline.com/news-sitemap.xml