meetmrnerd.com
robots.txt

Robots Exclusion Standard data for meetmrnerd.com

Resource Scan

Scan Details

Site Domain meetmrnerd.com
Base Domain meetmrnerd.com
Scan Status Ok
Last Scan2025-08-26T23:41:32+00:00
Next Scan 2025-09-09T23:41:32+00:00

Last Scan

Scanned2025-08-26T23:41:32+00:00
URL https://meetmrnerd.com/robots.txt
Redirect https://www.meetmrnerd.com/robots.txt
Redirect Domain www.meetmrnerd.com
Redirect Base meetmrnerd.com
Domain IPs 216.198.79.193
Redirect IPs 216.198.79.1, 64.29.17.1
Response IP 64.29.17.1
Found Yes
Hash f441fa0f3e2103d5a9196280bb2cf156608e6473bc1647c864d7832709f6211b
SimHash 0c09505d8723

Groups

*

Rule Path
Allow /
Disallow /dashboard/
Disallow /auth/
Disallow /api/
Allow /
Allow /about
Allow /contact
Allow /help
Allow /docs
Allow /privacy
Allow /terms

Other Records

Field Value
sitemap https://your-domain.vercel.app/sitemap.xml

Comments

  • Sitemap
  • Disallow admin and private areas
  • Allow important pages