mixrank.com
robots.txt

Robots Exclusion Standard data for mixrank.com

Resource Scan

Scan Details

Site Domain mixrank.com
Base Domain mixrank.com
Scan Status Ok
Last Scan2025-03-19T17:09:12+00:00
Next Scan 2025-04-18T17:09:12+00:00

Last Scan

Scanned2025-03-19T17:09:12+00:00
URL https://mixrank.com/robots.txt
Domain IPs 154.3.62.35
Response IP 154.3.62.35
Found Yes
Hash 64d08dee1a9a03d8da9d89791caf80afdd1411df3e523b447a88f2a334040cde
SimHash 439e194b4eb2

Groups

turnitinbot

Rule Path
Disallow /

better uptime bot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 3

easouspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

adsbot-google

Rule Path
Allow /

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

prtg network monitor

Rule Path
Disallow /

site24x7

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

adsbot

Rule Path
Allow /

domain re-animator bot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0.5

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0.5

spbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0.5

*

Rule Path
Disallow /account
Disallow /terms
Disallow /privacy
Disallow /corp
Disallow /appstore/apps/*/rankings
Disallow /apps/*
Disallow /sites/*
Disallow /web/tags/*
Disallow /sdks/*
Disallow /a/*
Disallow /p/*
Allow /
Allow /solutions/*
Allow /datasets/*
Allow /pricing
Allow /get-started
Allow /about
Allow /careers
Allow /top-sdks

Other Records

Field Value
sitemap http://mixrank.com/sitemap.xml

Comments

  • http://openlinkprofiler.org/bot

Warnings

  • 1 invalid line.