agijima.ti-da.net
robots.txt

Robots Exclusion Standard data for agijima.ti-da.net

Resource Scan

Scan Details

Site Domain agijima.ti-da.net
Base Domain ti-da.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonRequest timed out.
Last Scan2025-09-02T21:48:00+00:00
Next Scan 2025-09-16T21:48:00+00:00

Last Successful Scan

Scanned2025-07-25T18:24:51+00:00
URL https://agijima.ti-da.net/robots.txt
Domain IPs 106.184.98.198
Response IP 106.184.98.198
Found Yes
Hash 53b6f0c4385979fa1b24a0a06693229e57504700f6cedcc5e58125120fa6070e
SimHash 6b942902c2b1

Groups

*

Rule Path
Disallow /admin/

mediapartners-google

Rule Path
Allow /admin/

ai2bot

Rule Path
Disallow /

amazon-kendra

Rule Path
Disallow /

amazonadbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

deepseek

Rule Path
Disallow /

deepseekbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

discordbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

grokbot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mappy

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

mistralbot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

xai-bot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://blog.ti-da.net/sitemap.xml