adequate.com
robots.txt

Robots Exclusion Standard data for adequate.com

Resource Scan

Scan Details

Site Domain adequate.com
Base Domain adequate.com
Scan Status Ok
Last Scan2025-05-29T08:42:11+00:00
Next Scan 2025-06-05T08:42:11+00:00

Last Scan

Scanned2025-05-29T08:42:11+00:00
URL https://adequate.com/robots.txt
Domain IPs 104.21.53.200, 172.67.218.118, 2606:4700:3035::ac43:da76, 2606:4700:3037::6815:35c8
Response IP 104.21.53.200
Found Yes
Hash 82bd30cd82e906db66374ec9ec7110a300e10cfce5abf49dca4b2b757cf679db
SimHash d20ed2826a39

Groups

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

charlotte

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yeti

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

bytespider | byte spider | bytedance | bytedance

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

ias_crawler

Rule Path
Disallow /

ias_wombles

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

moget

Rule Path
Disallow /

proximic

Rule Path
Disallow /

voyager

Rule Path
Disallow /

*

Rule Path
Disallow /cgi
Disallow /cgi-bin
Disallow /logs
Disallow /mov
Disallow /snd
Disallow /torpe
Disallow /*.DOC$
Disallow /*.M4V$
Disallow /*.MP3$
Disallow /*.MPEG$
Disallow /*.MPG$
Disallow /*.XLS$
Disallow /*.doc$
Disallow /*.gif$
Disallow /*.Gif$
Disallow /*.GIF$
Disallow /*.jpg$
Disallow /*.Jpg$
Disallow /*.JPG$
Disallow /*.jpeg$
Disallow /*.Jpeg$
Disallow /*.JPEG$
Disallow /*.m4v$
Disallow /*.mov$
Disallow /*.mp3$
Disallow /*.mpeg$
Disallow /*.mpg$
Disallow /*.pdf$
Disallow /*.Pdf$
Disallow /*.PDF$
Disallow /*.png$
Disallow /*.xls$
Disallow /*.zip$
Disallow /*.Zip$
Disallow /*.ZIP$

Other Records

Field Value
crawl-delay 0.5