Log In Sign Up

biggerminds.io
robots.txt

Robots Exclusion Standard data for biggerminds.io

Resource Scan

Scan Details

Site Domain biggerminds.io
Base Domain biggerminds.io
Scan Status Ok
Last Scan2025-10-03T09:26:47+00:00
Next Scan 2025-11-02T09:26:47+00:00

Last Scan

Scanned2025-10-03T09:26:47+00:00
URL https://biggerminds.io/robots.txt
Domain IPs 146.190.168.130, 2604:a880:4:1d0::668:4000
Response IP 146.190.168.130
Found Yes
Hash 4116e59b123dc973139b5ce0fd54a99d1841c35db8cf9fc436cc988e21a49875
SimHash 1010ddc6fa18

Groups

*

Rule Path
Allow /

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Allow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

megaindexbot

Rule Path
Disallow /

seo-powersuite-bot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

seplinkbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

rankactivelinkbot

Rule Path
Disallow /

accuranker

Rule Path
Disallow /

siteanalyzerbot

Rule Path
Disallow /

similarweb

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

netcraftsurveyagent

Rule Path
Disallow /
Back to top