nears.me
robots.txt

Robots Exclusion Standard data for nears.me

Resource Scan

Scan Details

Site Domain nears.me
Base Domain nears.me
Scan Status Ok
Last Scan2026-03-02T09:21:11+00:00
Next Scan 2026-03-09T09:21:11+00:00

Last Scan

Scanned2026-03-02T09:21:11+00:00
URL https://nears.me/robots.txt
Domain IPs 104.21.26.8, 172.67.135.28, 2606:4700:3032::6815:1a08, 2606:4700:3036::ac43:871c
Response IP 104.21.26.8
Found Yes
Hash 9de2fdedfcf49f6be77a7fcaccf958d03c5c680aa4a666d75781b26da6cd9cb7
SimHash 084c1a80e5d2

Groups

googlebot

Rule Path
Allow /

*

Rule Path
Allow /

gptbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://nears.me/sitemap_index.xml

Comments

  • Allow search engines
  • Block AI training crawlers
  • Yoast SEO sitemap