envistaforum.com
robots.txt

Robots Exclusion Standard data for envistaforum.com

Resource Scan

Scan Details

Site Domain envistaforum.com
Base Domain envistaforum.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-14T14:21:23+00:00
Next Scan 2025-11-21T14:21:23+00:00

Last Successful Scan

Scanned2025-11-06T00:42:44+00:00
URL https://envistaforum.com/robots.txt
Domain IPs 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91
Response IP 151.101.193.91
Found Yes
Hash b566192ac2f0276e067426ddeb40e226dda7720c3f64fae1090ca02f0ccbd0d1
SimHash 6029599022b8

Groups

facebookbot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

*

Rule Path
Disallow /account/
Disallow /goto/
Disallow /login/
Disallow /search/
Disallow /admin.php
Disallow /business/directory
Allow /

anthropic-ai
bytespider
ccbot
chatgpt-user
claudebot
cohere-ai
cohere-training-data-crawler
diffbot
gptbot
imagesiftbot
meta-externalagent
meta-externalagent
meta-webindexer
oai-searchbot
omgili
omgilibot
perplexitybot
quillbot.com
quora-bot
youbot

Rule Path
Disallow /

amazonbot
aliyunsecbot
audigentadbot
awariorssbot
awariosmartbot
blexbot
dataforseobot
echoboxbot
friendlycrawler
jetslide
magpie-crawler
mycentralaiscraperbot
newsnow
news-please
peer39_crawler
peer39_crawler/1.0
poseidon research crawler
scrapy
seekrbot
seznamhomepagecrawler
taragroup intelligent bot
timpibot
turnitinbot
viennatinybot

Rule Path
Disallow /

slurp

Rule Path
Disallow /frontier/api/sessionActivity
Disallow /frontier/api/threads/*/pageview

Other Records

Field Value
sitemap https://envistaforum.com/sitemap.xml

Comments

  • Block AI Bots
  • Block Content Scraping and Data Mining Bots
  • Block bots that can't do csrf ajax calls