aikanbot.com
robots.txt

Robots Exclusion Standard data for aikanbot.com

Resource Scan

Scan Details

Site Domain aikanbot.com
Base Domain aikanbot.com
Scan Status Ok
Last Scan2024-10-03T14:41:55+00:00
Next Scan 2024-10-10T14:41:55+00:00

Last Scan

Scanned2024-10-03T14:41:55+00:00
URL https://aikanbot.com/robots.txt
Redirect https://v.aikanbot.com/robots.txt
Redirect Domain v.aikanbot.com
Redirect Base aikanbot.com
Domain IPs 104.21.7.38, 172.67.135.180, 2606:4700:3030::6815:726, 2606:4700:3036::ac43:87b4
Redirect IPs 104.21.7.38, 172.67.135.180, 2606:4700:3030::6815:726, 2606:4700:3036::ac43:87b4
Response IP 104.21.7.38
Found Yes
Hash 668c86d67593b5ced07e7cdf2dbdfe1579720133b345f816a6e42e637e7ea9ad
SimHash 177d49f06a90

Groups

ahrefsbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

ev-crawler

Rule Path
Disallow /

ioncrawl

Rule Path
Disallow /

tchelebi

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

tinytestbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /