mimi4d1.mom
robots.txt

Robots Exclusion Standard data for mimi4d1.mom

Resource Scan

Scan Details

Site Domain mimi4d1.mom
Base Domain mimi4d1.mom
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer redirected incorrectly.
Last Scan2024-09-28T01:03:01+00:00
Next Scan 2024-11-27T01:03:01+00:00

Last Successful Scan

Scanned2024-07-08T00:43:22+00:00
URL https://mimi4d1.mom/robots.txt
Redirect https://mimi4d1.website/robots.txt
Redirect Domain mimi4d1.website
Redirect Base mimi4d1.website
Domain IPs 104.21.84.137, 172.67.193.88, 2606:4700:3031::ac43:c158, 2606:4700:3036::6815:5489
Redirect IPs 104.21.85.86, 172.67.203.251, 2606:4700:3031::6815:5556, 2606:4700:3037::ac43:cbfb
Response IP 104.21.85.86
Found Yes
Hash 10b8d0aca5e50d16a1fb2cd43a13dd72ef623ef573235ed26b40d616b7c52947
SimHash 295291b74791

Groups

*

Rule Path
Allow /

dmca.com page protection crawling service

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

yahoo pipes 1.0

Rule Path
Allow /

yahoo! slurp

Rule Path
Allow /

yandexbot

Rule Path
Allow /

yandeximages

Rule Path
Allow /

yandexnews

Rule Path
Allow /

yandexwebmaster

Rule Path
Allow /

yandexpagechecker

Rule Path
Allow /

zyborg

Rule Path
Allow /

exabot

Rule Path
Allow /

facebot

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

archive.org_bot

Rule Path
Allow /

architextspider

Rule Path
Allow /

feedfetcher-google

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://mimi4dpro.com/sitemap.xml

Warnings

  • 2 invalid lines.