sage.moe
robots.txt

Robots Exclusion Standard data for sage.moe

Resource Scan

Scan Details

Site Domain sage.moe
Base Domain sage.moe
Scan Status Ok
Last Scan2025-10-03T22:33:31+00:00
Next Scan 2025-11-02T22:33:31+00:00

Last Scan

Scanned2025-10-03T22:33:31+00:00
URL https://sage.moe/robots.txt
Redirect https://old.sage.moe/robots.txt
Redirect Domain old.sage.moe
Redirect Base sage.moe
Domain IPs 5.161.142.133
Redirect IPs 5.161.142.133
Response IP 5.161.142.133
Found Yes
Hash b7c0fd088d76f0382856bea4cebdcca581d93bf0b20af6097a9c626c419dc4eb
SimHash 549a29f8f2be

Groups

imagesiftbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

googlebot-extended

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

facebookcatalog

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-wed

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

*

Rule Path
Disallow /_/search
Disallow /a/search
Disallow /adv/search
Disallow /an/search
Disallow /anime/search
Disallow /b/search
Disallow /book/search
Disallow /c/search
Disallow /carcom/search
Disallow /cgl/search
Disallow /ck/search
Disallow /cm/search
Disallow /co/search
Disallow /comp/search
Disallow /con1/search
Disallow /con2/search
Disallow /con3/search
Disallow /con4/search
Disallow /d/search
Disallow /dissci/search
Disallow /disvip/search
Disallow /diy/search
Disallow /e/search
Disallow /fa/search
Disallow /fit/search
Disallow /food/search
Disallow /g/search
Disallow /games/search
Disallow /gif/search
Disallow /h/search
Disallow /hc1/search
Disallow /hc2/search
Disallow /hm/search
Disallow /hr/search
Disallow /i/search
Disallow /ib/search
Disallow /ic/search
Disallow /img/search
Disallow /ip/search
Disallow /jp/search
Disallow /k/search
Disallow /lang/search
Disallow /lit/search
Disallow /lounge/search
Disallow /m/search
Disallow /mlp/search
Disallow /mu/search
Disallow /music/search
Disallow /n1/search
Disallow /n2/search
Disallow /newnew/search
Disallow /newpol/search
Disallow /o/search
Disallow /p/search
Disallow /po/search
Disallow /prog/search
Disallow /r/search
Disallow /r9k1/search
Disallow /r9k2/search
Disallow /s/search
Disallow /sci/search
Disallow /sjis/search
Disallow /soc/search
Disallow /sp1/search
Disallow /sp2/search
Disallow /sports/search
Disallow /t/search
Disallow /tech/search
Disallow /tele/search
Disallow /tg/search
Disallow /toy/search
Disallow /trv/search
Disallow /tv/search
Disallow /u/search
Disallow /v/search
Disallow /vg/search
Disallow /vp/search
Disallow /w/search
Disallow /wg/search
Disallow /wsg/search
Disallow /x/search
Disallow /y/search