Log In Sign Up

mark-to-win.com
robots.txt

Robots Exclusion Standard data for mark-to-win.com

Resource Scan

Scan Details

Site Domain mark-to-win.com
Base Domain mark-to-win.com
Scan Status Ok
Last Scan2024-09-09T16:54:08+00:00
Next Scan 2024-10-09T16:54:08+00:00

Last Scan

Scanned2024-09-09T16:54:08+00:00
URL http://mark-to-win.com/robots.txt
Domain IPs 104.199.128.152, 34.96.197.253, 35.220.231.231, 47.239.18.79
Response IP 34.96.197.253
Found Yes
Hash 4d794e8c03e2cff4b83893e168593a76d9084ac74441effaae58677845134a91
SimHash 533247e0f21a

Groups

amazonbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /

petalbot/1.0

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

applebot/0.1

Rule Path
Disallow /

applebot

Rule Path
Disallow /

ahrefsbot/7.0

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

dotbot/1.2

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

linkdexbot/2.0

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

duckduckgo-favicons-bot/1.0

Rule Path
Disallow /

duckduckgo-favicons-bot

Rule Path
Disallow /

mj12bot/v1.4.8

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /
Back to top