bettertrail.com
robots.txt
Robots Exclusion Standard data for bettertrail.com
Resource Scan
Scan Details
| Site Domain | bettertrail.com |
| Base Domain | bettertrail.com |
| Scan Status | Ok |
| Last Scan | 2026-03-04T12:56:56+00:00 |
| Next Scan | 2026-04-03T12:56:56+00:00 |
Last Scan
| Scanned | 2026-03-04T12:56:56+00:00 |
| URL | https://bettertrail.com/robots.txt |
| Domain IPs | 104.26.14.165, 104.26.15.165, 172.67.72.182, 2606:4700:20::681a:ea5, 2606:4700:20::681a:fa5, 2606:4700:20::ac43:48b6 |
| Response IP | 104.26.14.165 |
| Found | Yes |
| Hash | 4da3483901d773cc1b71e029c7b1b50b30fc696f0cd3cedecdf227174952b53e |
| SimHash | 70195956e080 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /api/ |
amazonbot
anthropic-ai
applebot-extended
awariorssbot
awariosmartbot
bytespider
ccbot
chatgpt-user
claudebot
claude-web
cohere-ai
dataforseobot
diffbot
facebookbot
friendlycrawler
google-cloudvertexbot
google-extended
gptbot
imagesiftbot
magpie-crawler
meta-externalagent
meta-externalagent
newsnow
news-please
oai-searchbot
omgili
omgilibot
peer39_crawler
peer39_crawler/1.0
perplexitybot
quora-bot
scrapy
turnitinbot
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://bettertrail.com/sitemap.xml |