mimemo.io
robots.txt

Robots Exclusion Standard data for mimemo.io

Resource Scan

Scan Details

Site Domain mimemo.io
Base Domain mimemo.io
Scan Status Ok
Last Scan2024-06-20T13:30:39+00:00
Next Scan 2024-06-27T13:30:39+00:00

Last Scan

Scanned2024-06-20T13:30:39+00:00
URL https://mimemo.io/robots.txt
Domain IPs 3.220.57.224, 3.232.242.170, 52.20.78.240, 54.91.59.199
Response IP 3.220.57.224
Found Yes
Hash a176f7d349f8127b06c80c336bdc26435e51913754fcde19acbd9c6e51243746
SimHash 483cdc40f618

Groups

*

Rule Path
Disallow /admin/
Disallow /api/
Disallow /auth/

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /