zutobi.com
robots.txt

Robots Exclusion Standard data for zutobi.com

Resource Scan

Scan Details

Site Domain zutobi.com
Base Domain zutobi.com
Scan Status Ok
Last Scan2025-03-08T20:59:17+00:00
Next Scan 2025-03-15T20:59:17+00:00

Last Scan

Scanned2025-03-08T20:59:17+00:00
URL https://zutobi.com/robots.txt
Domain IPs 104.26.14.22, 104.26.15.22, 172.67.74.242, 2606:4700:20::681a:e16, 2606:4700:20::681a:f16, 2606:4700:20::ac43:4af2
Response IP 172.67.74.242
Found Yes
Hash 030f1cd94a3c6324a2050ba5d4e9bef9e22eb67a44172cab694b6a62b3431cf3
SimHash 59050bf70893

Groups

*

Rule Path
Disallow /us/request/
Disallow /us/request
Disallow /us/instructor
Disallow /us/instructor/
Disallow /instructor
Disallow /instructor/

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandexvideo

Rule Path
Disallow /

yandexmedia

Rule Path
Disallow /

yandexblogs

Rule Path
Disallow /

yandexfavicons

Rule Path
Disallow /

yandexwebmaster

Rule Path
Disallow /

yandexmetrika

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

yandexscreenshotbot

Rule Path
Disallow /

yandexverticals

Rule Path
Disallow /

yandexvertis

Rule Path
Disallow /

yandexmarket

Rule Path
Disallow /

yandexantivirus

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mail.ru_bot/2.0

Rule Path
Disallow /

mailrubot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

mailruconnect

Rule Path
Disallow /

rambler

Rule Path
Disallow /

ramblerbot

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

sputnikimagebot

Rule Path
Disallow /

gogo

Rule Path
Disallow /

webalta

Rule Path
Disallow /

webaltacrawler

Rule Path
Disallow /

dolphin

Rule Path
Disallow /

aportworm

Rule Path
Disallow /

aport

Rule Path
Disallow /

nigma

Rule Path
Disallow /

qip

Rule Path
Disallow /

wroom

Rule Path
Disallow /
Allow /

Other Records

Field Value
sitemap https://zutobi.com/sitemap_index.xml