millennialstateofmind.com
robots.txt

Robots Exclusion Standard data for millennialstateofmind.com

Resource Scan

Scan Details

Site Domain millennialstateofmind.com
Base Domain millennialstateofmind.com
Scan Status Ok
Last Scan2025-09-22T03:08:20+00:00
Next Scan 2025-10-22T03:08:20+00:00

Last Scan

Scanned2025-09-22T03:08:20+00:00
URL https://millennialstateofmind.com/robots.txt
Redirect https://www.millennialstateofmind.com/robots.txt
Redirect Domain www.millennialstateofmind.com
Redirect Base millennialstateofmind.com
Domain IPs 199.34.228.143
Redirect IPs 199.34.228.143
Response IP 199.34.228.143
Found Yes
Hash fac811fb867401587b6f0d937193f00ca472aa6465e00efa96b035088c571d06
SimHash a954d8a46f93

Groups

nerdybot

Rule Path
Disallow /

*

Rule Path
Disallow /ajax/
Disallow /apps/

Other Records

Field Value
sitemap http://www.millennialstateofmind.com/sitemap.xml