myvalue.id
robots.txt

Robots Exclusion Standard data for myvalue.id

Resource Scan

Scan Details

Site Domain myvalue.id
Base Domain myvalue.id
Scan Status Ok
Last Scan2025-11-13T16:20:39+00:00
Next Scan 2025-12-13T16:20:39+00:00

Last Scan

Scanned2025-11-13T16:20:39+00:00
URL https://myvalue.id/robots.txt
Redirect https://www.myvalue.id/robots.txt
Redirect Domain www.myvalue.id
Redirect Base myvalue.id
Domain IPs 104.21.49.235, 172.67.195.149, 2606:4700:3031::ac43:c395, 2606:4700:3035::6815:31eb
Redirect IPs 104.21.49.235, 172.67.195.149, 2606:4700:3031::ac43:c395, 2606:4700:3035::6815:31eb
Response IP 104.21.49.235
Found Yes
Hash 75827505b002a6dc7b398ca216b7c477f9adf189e97b4e223f8fa3f4dc51d234
SimHash 106ac9428077

Groups

*

Rule Path
Disallow /account/*

anthropic-ai
applebot-extended
bytespider
ccbot
chatgpt-user
claudebot
cohere-ai
diffbot
facebookbot
gptbot
imagesiftbot
meta-externalagent
meta-externalfetcher
omgilibot
perplexitybot
timpibot
google-extended
google-cloudvertexbot

Rule Path
Disallow /

Comments

  • www.robotstxt.org
  • Explicit rules for common LLM bots that might not attribute source data.