tds.so
robots.txt

Robots Exclusion Standard data for tds.so

Resource Scan

Scan Details

Site Domain tds.so
Base Domain tds.so
Scan Status Ok
Last Scan2026-02-11T18:09:05+00:00
Next Scan 2026-03-13T18:09:05+00:00

Last Scan

Scanned2026-02-11T18:09:05+00:00
URL https://tds.so/robots.txt
Domain IPs 104.21.54.9, 172.67.222.48, 2606:4700:3034::6815:3609, 2606:4700:3036::ac43:de30
Response IP 172.67.222.48
Found Yes
Hash 645f18095433141e1a86c09b26ca1cab23b3333f9cd051bc1d07532392c93878
SimHash 4d201932ab90

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /api/
Disallow /storage/
Disallow /vendor/
Allow /frontend/
Allow /assets/
Allow /media/

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0

yandexbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://tds.so/sitemap.xml

Comments

  • Disallow admin and backend paths
  • Allow important assets
  • Sitemap location
  • Crawl delay
  • Specific bot rules