Log In Sign Up

totoframe.com
robots.txt

Robots Exclusion Standard data for totoframe.com

Resource Scan

Scan Details

Site Domain totoframe.com
Base Domain totoframe.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-06-08T23:47:35+00:00
Next Scan 2025-08-07T23:47:35+00:00

Last Successful Scan

Scanned2025-01-25T22:50:28+00:00
URL https://totoframe.com/robots.txt
Domain IPs 104.21.41.160, 172.67.148.56, 2606:4700:3034::ac43:9438, 2606:4700:3035::6815:29a0
Response IP 104.21.41.160
Found Yes
Hash 7a0c1d7dfe8344d8871a8bf8b95c6064c10707c11940856bd1ddd3dbf52e116b
SimHash 5053bd00e8c0

Groups

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

bdcbot

Rule Path
Disallow /

businessbot

Rule Path
Disallow /

dataprovider.com

Rule Path
Disallow /

dialogsearch.com bot

Rule Path
Disallow /

digincore crawler bot

Rule Path
Disallow /

domainsigmacrawler

Rule Path
Disallow /

kisabot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mediavbot

Rule Path
Disallow /

memorybot

Rule Path
Disallow /

mfibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

msnbot-media

Rule Path
Disallow /

neumobbot

Rule Path
Disallow /

pageanalyzer

Rule Path
Disallow /

pagesinventory

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

roboto

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

rsnbot

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

semanticbot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

uxcrawlerbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

omgili

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

adsbot-naver

Rule Path
Allow

bingbot

Rule Path
Allow

daum

Rule Path
Allow

googlebot

Rule Path
Allow

googlebot-mobile

Rule Path
Allow

yeti

Rule Path
Allow

zumbot

Rule Path
Allow

archive.org_bot

Rule Path
Allow
Disallow /adm/
Disallow /backup/
Disallow /extend/
Disallow /install/
Disallow /js/
Disallow /lib/
Disallow /m3cron/
Disallow /nariya/
Disallow /plugin/
Disallow /skin/
Back to top

Other Records

Field Value
sitemap https://totoframe.com/sitemap.xml
Back to top