soychef.today
robots.txt

Robots Exclusion Standard data for soychef.today

Resource Scan

Scan Details

Site Domain soychef.today
Base Domain soychef.today
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-01T01:05:25+00:00
Next Scan 2025-10-15T01:05:25+00:00

Last Successful Scan

Scanned2025-09-15T22:00:07+00:00
URL https://soychef.today/robots.txt
Domain IPs 13.226.2.104, 13.226.2.13, 13.226.2.26, 13.226.2.62, 2600:9000:2247:3a00:f:33bd:cb40:93a1, 2600:9000:2247:ae00:f:33bd:cb40:93a1, 2600:9000:2247:b200:f:33bd:cb40:93a1, 2600:9000:2247:c000:f:33bd:cb40:93a1, 2600:9000:2247:e00:f:33bd:cb40:93a1, 2600:9000:2247:e800:f:33bd:cb40:93a1, 2600:9000:2247:ec00:f:33bd:cb40:93a1, 2600:9000:2247:fc00:f:33bd:cb40:93a1
Response IP 18.66.218.60
Found Yes
Hash 3dafce77e6911fc0accab931a926c4c5590f1b9d2ed59e768c2d71b35e3c1d67
SimHash 2c16539155f5

Groups

applebot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

bingbot

Rule Path
Disallow /contenidos/
Disallow /vipcontent
Allow /

discordbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

facebookbot

Rule Path
Allow /

googlebot

Rule Path
Disallow /contenidos/
Disallow /vipcontent
Allow /

googlebot-news

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

adsbot-google-mobile-apps

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

storebot-google

Rule Path
Allow /

apis-google

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

naverbot

Rule Path
Allow /

pinterestbot

Rule Path
Allow /

petalbot

Rule Path
Disallow /contenidos/
Disallow /vipcontent
Allow /

seznambot

Rule Path
Allow /

slurp

Rule Path
Allow /

teoma

Rule Path
Allow /

telegrambot

Rule Path
Allow /

twitterbot

Rule Path
Allow /

yeti

Rule Path
Allow /

exabot

Rule Path
Allow /

criteobot/0.1

Rule Path
Allow /

duckduckbot

Rule Path
Disallow /contenidos/
Disallow /vipcontent
Allow /

amazonbot

Rule Path
Allow /

amazonadbot

Rule Path
Allow /

adidxbot

Rule Path
Allow /

bingpreview

Rule Path
Allow /

microsoftpreview

Rule Path
Allow /

googleother

Rule Path
Allow /

googleother-image

Rule Path
Allow /

googleother-video

Rule Path
Allow /

google-inspectiontool

Rule Path
Allow /

oai-searchbot

Rule Path
Disallow /contenidos/
Disallow /vipcontent
Allow /

*

Rule Path
Disallow /