Log In Sign Up

tfx.tax
robots.txt

Robots Exclusion Standard data for tfx.tax

Resource Scan

Scan Details

Site Domain tfx.tax
Base Domain tfx.tax
Scan Status Ok
Last Scan2026-02-07T19:15:54+00:00
Next Scan 2026-02-21T19:15:54+00:00

Last Scan

Scanned2026-02-07T19:15:54+00:00
URL https://tfx.tax/robots.txt
Domain IPs 104.26.0.202, 104.26.1.202, 172.67.69.89, 2606:4700:20::681a:1ca, 2606:4700:20::681a:ca, 2606:4700:20::ac43:4559
Response IP 104.26.1.202
Found Yes
Hash 90b2339c7454f4b1f7a4a43f25b1b072cbb58ea1f04038b5d502e68355a5fa83
SimHash 201088d2c743

Groups

*

Rule Path
Disallow /client/
Disallow /bak/
Disallow /search.html?*
Disallow /cookies_transmitter/
Disallow /llms.txt
Allow /pdf/
Allow /xls/
Allow *.css
Allow *.js

chatgpt-user

Rule Path
Allow /llms.txt

gptbot

Rule Path
Allow /llms.txt

anthropic-ai

Rule Path
Allow /llms.txt

claudebot

Rule Path
Allow /llms.txt

google-extended

Rule Path
Allow /llms.txt

perplexitybot

Rule Path
Allow /llms.txt

applebot-extended

Rule Path
Allow /llms.txt

ia_archiver

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://tfx.tax/sitemap.xml
Back to top

Comments

  • Allow AI bots to access llms.txt
Back to top