adequate.com
robots.txt

Robots Exclusion Standard data for adequate.com

Resource Scan

Scan Details

Site Domain adequate.com
Base Domain adequate.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-13T08:23:25+00:00
Next Scan 2026-01-27T08:23:25+00:00

Last Successful Scan

Scanned2025-12-29T06:00:58+00:00
URL https://adequate.com/robots.txt
Domain IPs 104.21.53.200, 172.67.218.118, 2606:4700:3035::ac43:da76, 2606:4700:3037::6815:35c8
Response IP 172.67.218.118
Found Yes
Hash 4a0b5cca55e349529a66e535f8205210650cfec452ec4439fac6819f1361055f
SimHash 720edb00e222

Groups

ai2bot

Rule Path
Disallow /

ai2bot-dolma

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

charlotte

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

cotoyogi

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

duckassistbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

factset_spyderbot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

firecrawlagent

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-cloudvertexbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

kangaroo bot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

meltwater

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

pangubot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

serankingbacklinksbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

seekr

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-ocob

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

tiktokspider

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

youbot

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

byte dance

Rule Path
Disallow /

byte spider

Rule Path
Disallow /

bytedance

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

cohere-training-data-crawler

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

ias_crawler

Rule Path
Disallow /

ias_wombles

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

img2dataset

Rule Path
Disallow /

meta-externalads

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-webindexer

Rule Path
Disallow /

moget

Rule Path
Disallow /

peer39_crawler

Rule Path
Disallow /

proximic

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

voyager

Rule Path
Disallow /

webzio-extended

Rule Path
Disallow /

*

Rule Path
Disallow /cgi
Disallow /cgi-bin
Disallow /logs
Disallow /mov
Disallow /snd
Disallow /torpe
Disallow /*.DOC$
Disallow /*.M4V$
Disallow /*.MP3$
Disallow /*.MPEG$
Disallow /*.MPG$
Disallow /*.XLS$
Disallow /*.doc$
Disallow /*.gif$
Disallow /*.Gif$
Disallow /*.GIF$
Disallow /*.jpg$
Disallow /*.Jpg$
Disallow /*.JPG$
Disallow /*.jpeg$
Disallow /*.Jpeg$
Disallow /*.JPEG$
Disallow /*.m4v$
Disallow /*.mov$
Disallow /*.mp3$
Disallow /*.mpeg$
Disallow /*.mpg$
Disallow /*.pdf$
Disallow /*.Pdf$
Disallow /*.PDF$
Disallow /*.png$
Disallow /*.xls$
Disallow /*.zip$
Disallow /*.Zip$
Disallow /*.ZIP$

Other Records

Field Value
crawl-delay 2.0