smart-dato.com
robots.txt

Robots Exclusion Standard data for smart-dato.com

Resource Scan

Scan Details

Site Domain smart-dato.com
Base Domain smart-dato.com
Scan Status Ok
Last Scan2025-12-07T04:37:58+00:00
Next Scan 2025-12-14T04:37:58+00:00

Last Scan

Scanned2025-12-07T04:37:58+00:00
URL https://smart-dato.com/robots.txt
Redirect https://www.smart-dato.com/robots.txt
Redirect Domain www.smart-dato.com
Redirect Base smart-dato.com
Domain IPs 104.26.12.115, 104.26.13.115, 172.67.70.108, 2606:4700:20::681a:c73, 2606:4700:20::681a:d73, 2606:4700:20::ac43:466c
Redirect IPs 104.26.12.115, 104.26.13.115, 172.67.70.108, 2606:4700:20::681a:c73, 2606:4700:20::681a:d73, 2606:4700:20::ac43:466c
Response IP 104.26.12.115
Found Yes
Hash 980d8908a2c8559f13f788a8de5bb1661cba30e6212b75db904d1ea3473d7d8d
SimHash 6155da86a516

Groups

*

Rule Path
Disallow /typo3/
Disallow /typo3conf/
Disallow /fileadmin/
Disallow /uploads/
Disallow /de/datenschutz
Disallow /de/impressum
Disallow /de/cookies
Disallow /it/privacy
Disallow /it/impressum
Disallow /it/cookies
Disallow /en/privacy
Disallow /en/impressum
Disallow /en/cookies
Allow /fileadmin/_processed_/
Allow /uploads/tx_extension/
Allow /typo3conf/ext/ngsmart_default_template/Resources/Public/Icons/Favicons/

googlebot

Rule Path
Allow *.js
Allow *.css
Disallow /typo3/
Disallow /api/
Disallow /?s=
Disallow /search/

gptbot

Rule Path
Disallow /typo3/
Disallow /api/

chatgpt-user

Rule Path
Disallow /typo3/
Disallow /api/

claudebot

Rule Path
Disallow /typo3/
Disallow /api/

claude-searchbot

Rule Path
Disallow /typo3/
Disallow /api/

claude-user

Rule Path
Disallow /typo3/
Disallow /api/

perplexitybot

Rule Path
Disallow /typo3/
Disallow /api/

perplexity-user

Rule Path
Disallow /typo3/
Disallow /api/

google-extended

Rule Path
Disallow /typo3/
Disallow /api/

google-cloudvertexbot

Rule Path
Disallow /typo3/
Disallow /api/

Other Records

Field Value
sitemap https://www.smart-dato.com/sitemap.xml

Comments

  • === GOOGLEBOT: Allow essential resources ===
  • === AI & LLM CRAWLER RULES ===
  • === SITEMAP LOCATION ===