Log In Sign Up

misenategop.com
robots.txt

Robots Exclusion Standard data for misenategop.com

Resource Scan

Scan Details

Site Domain misenategop.com
Base Domain misenategop.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-24T07:16:22+00:00
Next Scan 2024-11-22T07:16:22+00:00

Last Successful Scan

Scanned2023-04-10T05:03:44+00:00
URL https://misenategop.com/robots.txt
Domain IPs 104.21.7.74, 172.67.135.201, 2606:4700:3033::ac43:87c9, 2606:4700:3034::6815:74a
Response IP 104.21.7.74
Found Yes
Hash abff96bd7a1210a319e32fa444e55f615380aa4ea29248d77ca5960536ba6248
SimHash 12166b466a02

Groups

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

alphaseobot-sa

Rule Path
Disallow /

awariorssbot
awariosmartbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

bubing

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image
baiduspider/2.0

Rule Path
Disallow /

deusu

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

extlinksbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

jooble-bot

Rule Path
Disallow /
Disallow /

megaindex

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

sogou

Rule Path
Disallow /

spbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /
Back to top

Comments

  • Baiduspider
Back to top

Warnings

  • `linkdexbot` is not a known field.
Back to top