Log In Sign Up

guru.me
robots.txt

Robots Exclusion Standard data for guru.me

Resource Scan

Scan Details

Site Domain guru.me
Base Domain guru.me
Scan Status Ok
Last Scan2025-04-19T22:20:54+00:00
Next Scan 2025-05-19T22:20:54+00:00

Last Scan

Scanned2025-04-19T22:20:54+00:00
URL https://guru.me/robots.txt
Redirect https://www.guru.me/robots.txt
Redirect Domain www.guru.me
Redirect Base guru.me
Domain IPs 104.21.59.76, 172.67.218.162, 2606:4700:3031::ac43:daa2, 2606:4700:3035::6815:3b4c
Redirect IPs 104.21.59.76, 172.67.218.162, 2606:4700:3031::ac43:daa2, 2606:4700:3035::6815:3b4c
Response IP 172.67.218.162
Found Yes
Hash 62fee1c480db495b31a97dd244d29328103c4b996348056dbcbb7c31a9f19e69
SimHash 6254dc742793

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Back to top

Other Records

Field Value
sitemap http://www.guru.me/sitemap.xml
Back to top