redsun.design
robots.txt

Robots Exclusion Standard data for redsun.design

Resource Scan

Scan Details

Site Domain redsun.design
Base Domain redsun.design
Scan Status Ok
Last Scan2024-09-13T11:24:35+00:00
Next Scan 2024-10-13T11:24:35+00:00

Last Scan

Scanned2024-09-13T11:24:35+00:00
URL http://redsun.design/robots.txt
Domain IPs 208.113.190.109
Response IP 208.113.190.109
Found Yes
Hash 388214b7131b07e485e43875c973e88286afc840bc525176dfd16cea8d81c852
SimHash 2a1adda2c281

Groups

a6-indexer

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

alphaseobot-sa

Rule Path
Disallow /

applebot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

blackboard safeassign

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

jeeves

Rule Path
Disallow /

liebaofast

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mqqbrowser

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow /

sogou

Rule Path
Disallow /

sputnikbot/2.3

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

ucbrowser

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

*

Rule Path
Disallow /*.gif$
Disallow /*.Gif$
Disallow /*.GIF$
Disallow /*.jpg$
Disallow /*.Jpg$
Disallow /*.JPG$
Disallow /*.jpeg$
Disallow /*.Jpeg$
Disallow /*.JPEG$
Disallow /*.pdf$
Disallow /*.Pdf$
Disallow /*.PDF$
Disallow /*.zip$
Disallow /*.Zip$
Disallow /*.ZIP$

Other Records

Field Value
crawl-delay 10.0