trvst.world
robots.txt

Robots Exclusion Standard data for trvst.world

Resource Scan

Scan Details

Site Domain trvst.world
Base Domain trvst.world
Scan Status Ok
Last Scan2024-11-16T18:46:44+00:00
Next Scan 2024-11-23T18:46:44+00:00

Last Scan

Scanned2024-11-16T18:46:44+00:00
URL https://trvst.world/robots.txt
Domain IPs 162.159.136.54, 162.159.137.54, 2606:4700:7::a29f:8836, 2606:4700:7::a29f:8936
Response IP 162.159.136.54
Found Yes
Hash bd64cd9cb7f89b107cad3ed079f3e42e2c44c0d426b549d1521684f86c311e3a
SimHash 247a594086b3

Groups

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin
Disallow /trackback/
Disallow /tag/
Disallow /page/
Disallow /comments
Disallow */trackback
Disallow */comments
Disallow /fields-of-action-2
Disallow /inspirations/
Disallow /inspiration/
Disallow /action/
Disallow /the-team/
Disallow /p/
Disallow /foa/
Disallow /news/
Disallow /reel/
Disallow /mind-body-2/
Disallow /2017/
Disallow /2021/
Disallow /sustainableliving/
Disallow /sustainable-living-2/
Allow /projects/$
Disallow /projects/*
Allow /fields-of-action/$
Disallow /fields-of-action/*
Allow /quotes/$
Disallow /quotes/*
Allow /

Other Records

Field Value
sitemap https://www.trvst.world/sitemap.xml

Comments

  • Specific User-agent rules
  • General User-agent rules