transor.ai
robots.txt

Robots Exclusion Standard data for transor.ai

Resource Scan

Scan Details

Site Domain transor.ai
Base Domain transor.ai
Scan Status Ok
Last Scan2026-01-23T00:22:31+00:00
Next Scan 2026-02-22T00:22:31+00:00

Last Scan

Scanned2026-01-23T00:22:31+00:00
URL https://transor.ai/robots.txt
Domain IPs 104.26.4.176, 104.26.5.176, 172.67.68.183, 2606:4700:20::681a:4b0, 2606:4700:20::681a:5b0, 2606:4700:20::ac43:44b7
Response IP 172.67.68.183
Found Yes
Hash 748f23e45057e16cde79eb35ea34d4cc761997437783aa062245202a752dc9e0
SimHash 6111ded36503

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /profile/
Disallow /change-password
Disallow /login
Disallow /register
Disallow /forgot-password

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

Comments

  • Transor Robots.txt
  • https://transor.ai
  • Allow all search engines
  • Disallow admin and private areas
  • Allow specific bots full access
  • Crawl-delay for responsible crawling