mimemo.io
robots.txt

Robots Exclusion Standard data for mimemo.io

Resource Scan

Scan Details

Site Domain mimemo.io
Base Domain mimemo.io
Scan Status Ok
Last Scan2024-11-15T02:53:25+00:00
Next Scan 2024-11-22T02:53:25+00:00

Last Scan

Scanned2024-11-15T02:53:25+00:00
URL https://mimemo.io/robots.txt
Domain IPs 13.248.144.105, 13.248.241.119, 3.33.148.61, 35.71.131.46
Response IP 13.248.241.119
Found Yes
Hash a176f7d349f8127b06c80c336bdc26435e51913754fcde19acbd9c6e51243746
SimHash 483cdc40f618

Groups

*

Rule Path
Disallow /admin/
Disallow /api/
Disallow /auth/

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /