coke2home.com
robots.txt

Robots Exclusion Standard data for coke2home.com

Resource Scan

Scan Details

Site Domain coke2home.com
Base Domain coke2home.com
Scan Status Ok
Last Scan2024-06-22T22:55:56+00:00
Next Scan 2024-07-22T22:55:56+00:00

Last Scan

Scanned2024-06-22T22:55:56+00:00
URL https://coke2home.com/robots.txt
Redirect https://www.coke2home.com/robots.txt
Redirect Domain www.coke2home.com
Redirect Base coke2home.com
Domain IPs 52.14.144.171
Redirect IPs 108.157.254.116, 108.157.254.36, 108.157.254.61, 108.157.254.74, 2600:9000:2753:1400:1f:60f0:b740:93a1, 2600:9000:2753:1c00:1f:60f0:b740:93a1, 2600:9000:2753:2400:1f:60f0:b740:93a1, 2600:9000:2753:2c00:1f:60f0:b740:93a1, 2600:9000:2753:6c00:1f:60f0:b740:93a1, 2600:9000:2753:bc00:1f:60f0:b740:93a1, 2600:9000:2753:c200:1f:60f0:b740:93a1, 2600:9000:2753:e00:1f:60f0:b740:93a1
Response IP 108.157.254.116
Found Yes
Hash 799cbaf84727d3b7e309458e79dd08ad2eead79c07f04d716cabda0d86453da6
SimHash b5db5b80c6f5

Groups

*

Rule Path
Disallow /assets/
Disallow /cgi-bin/
Disallow /system/
Disallow /uploads/
Disallow /admin/

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

Comments

  • Block crawling software