rezekitoto.com
robots.txt

Robots Exclusion Standard data for rezekitoto.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	rezekitoto.com
Base Domain	rezekitoto.com
Scan Status	Ok
Last Scan	2026-04-01T03:06:25+00:00
Next Scan	2026-05-01T03:06:25+00:00

Last Scan

Scanned	2026-04-01T03:06:25+00:00
URL	https://rezekitoto.com/robots.txt
Domain IPs	104.21.66.45, 172.67.201.25, 2606:4700:3031::6815:422d, 2606:4700:3035::ac43:c919
Response IP	172.67.201.25
Found	Yes
Hash	4dd10a89c277ca24c15834702ce58666db09e9fd836413155e02e48e16303ff9
SimHash	551473f5f591

Groups

googlebot

Rule	Path
Disallow

Rule

Path

Disallow

adsense

Rule	Path
Disallow

Rule

Path

Disallow

inspection

Rule	Path
Disallow

Rule

Path

Disallow

telegrambot

Rule	Path
Disallow

Rule

Path

Disallow

yandexbot

Rule	Path
Disallow

Rule

Path

Disallow

googlebot-image

Rule	Path
Disallow

Rule

Path

Disallow

googlebot-news

Rule	Path
Disallow

Rule

Path

Disallow

googlebot-video

Rule	Path
Disallow

Rule

Path

Disallow

adsbot-google

Rule	Path
Disallow

Rule

Path

Disallow

bingbot

Rule	Path
Disallow

Rule

Path

Disallow

adidxbot

Rule	Path
Disallow

Rule

Path

Disallow

slurp

Rule	Path
Disallow

Rule

Path

Disallow

duckduckbot

Rule	Path
Disallow

Rule

Path

Disallow

baiduspider

Rule	Path
Disallow

Rule

Path

Disallow

yandex

Rule	Path
Disallow

Rule

Path

Disallow

sogou

Rule	Path
Disallow

Rule

Path

Disallow

exabot

Rule	Path
Disallow

Rule

Path

Disallow

facebot

Rule	Path
Disallow

Rule

Path

Disallow

ia_archiver

Rule	Path
Disallow

Rule

Path

Disallow

applebot

Rule	Path
Disallow

Rule

Path

Disallow

petalbot

Rule	Path
Disallow

Rule

Path

Disallow

linkedinbot

Rule	Path
Disallow

Rule

Path

Disallow

amazonbot

Rule	Path
Disallow

Rule

Path

Disallow

amazonbot-image

Rule	Path
Disallow

Rule

Path

Disallow

gptbot

Rule	Path
Disallow

Rule

Path

Disallow

chatgpt-user

Rule	Path
Disallow

Rule

Path

Disallow

ccbot

Rule	Path
Disallow

Rule

Path

Disallow

claudebot

Rule	Path
Disallow

Rule

Path

Disallow

claude-web

Rule	Path
Disallow

Rule

Path

Disallow

perplexitybot

Rule	Path
Disallow

Rule

Path

Disallow

oai-searchbot

Rule	Path
Disallow

Rule

Path

Disallow

oai-search

Rule	Path
Disallow

Rule

Path

Disallow

magpie-crawler

Rule	Path
Disallow

Rule

Path

Disallow

cohere-ai

Rule	Path
Disallow

Rule

Path

Disallow

youbot

Rule	Path
Disallow

Rule

Path

Disallow

anthropic-ai

Rule	Path
Disallow

Rule

Path

Disallow

bytedancespider

Rule	Path
Disallow

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow

Rule

Path

Disallow

dataforseobot

Rule	Path
Disallow

Rule

Path

Disallow

diffbot

Rule	Path
Disallow

Rule

Path

Disallow

scrapy

Rule	Path
Disallow

Rule

Path

Disallow

serpstatbot

Rule	Path
Disallow

Rule

Path

Disallow

dotbot

Rule	Path
Disallow

Rule

Path

Disallow

archive.org_bot

Rule	Path
Disallow

Rule

Path

Disallow

wayback-machine

Rule	Path
Disallow

Rule

Path

Disallow

commoncrawl

Rule	Path
Disallow

Rule

Path

Disallow

Comments

======================================
Robots.txt - Allow All Listed Crawlers
======================================
======================================
END
======================================

rezekitoto.comrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

googlebot

adsense

inspection

telegrambot

yandexbot

googlebot-image

googlebot-news

googlebot-video

adsbot-google

bingbot

adidxbot

slurp

duckduckbot

baiduspider

yandex

sogou

exabot

facebot

ia_archiver

applebot

petalbot

linkedinbot

amazonbot

amazonbot-image

gptbot

chatgpt-user

ccbot

claudebot

claude-web

perplexitybot

oai-searchbot

oai-search

magpie-crawler

cohere-ai

youbot

anthropic-ai

bytedancespider

ahrefsbot

semrushbot

mj12bot

dataforseobot

diffbot

scrapy

serpstatbot

dotbot

archive.org_bot

wayback-machine

commoncrawl

Comments

rezekitoto.com
robots.txt