Log In Sign Up

macos-tahoe.com
robots.txt

Robots Exclusion Standard data for macos-tahoe.com

Resource Scan

Scan Details

Site Domain macos-tahoe.com
Base Domain macos-tahoe.com
Scan Status Ok
Last Scan2025-09-26T21:28:56+00:00
Next Scan 2025-10-03T21:28:56+00:00

Last Scan

Scanned2025-09-26T21:28:56+00:00
URL https://macos-tahoe.com/robots.txt
Domain IPs 104.21.85.91, 172.67.204.61, 2606:4700:3033::ac43:cc3d, 2606:4700:3034::6815:555b
Response IP 172.67.204.61
Found Yes
Hash a35dd261480093a75931e2603ba6220f01e5722a909a9330340a9d3d39d96a2c
SimHash 2535da5e8d03

Groups

*

Rule Path
Allow /
Allow /en/
Allow /zh/
Allow /es/
Allow /ja/
Allow /ko/
Allow /fr/
Allow /de/
Allow /pt/
Allow /ru/
Allow /ar/
Disallow /admin/
Disallow /dashboard/
Disallow /settings/
Disallow /auth/
Disallow /login/
Disallow /register/
Disallow /account/
Disallow /api/
Disallow /_internal/
Disallow /_admin/
Disallow /build/
Disallow /dist/
Disallow /node_modules/
Disallow /temp/
Disallow /tmp/
Disallow /cache/
Disallow /logs/
Disallow /uploads/private/
Disallow /user-data/
Disallow /private/
Allow /search
Allow /search/
Back to top

Other Records

Field Value
sitemap https://macos-tahoe.com/sitemap-index.xml
sitemap https://macos-tahoe.com/sitemap.xml
sitemap https://macos-tahoe.com/rss.xml
Back to top

Comments

  • macOS Tahoe robots.txt (2025-09-21)
  • Simplified to avoid accidental blocking of localized marketing pages.
  • Protect private or non-HTML endpoints from being indexed
  • Allow public search, contact, and newsletter routes to be crawled for structured data
  • Questions? Email support@macos-tahoe.com
Back to top