longexmx.bramblebliss.store
robots.txt

Robots Exclusion Standard data for longexmx.bramblebliss.store

Resource Scan

Scan Details

Site Domain longexmx.bramblebliss.store
Base Domain bramblebliss.store
Scan Status Ok
Last Scan2025-11-11T19:39:44+00:00
Next Scan 2025-11-25T19:39:44+00:00

Last Scan

Scanned2025-11-11T19:39:44+00:00
URL https://longexmx.bramblebliss.store/robots.txt
Domain IPs 76.76.21.93, 76.76.21.98
Response IP 66.33.60.67
Found Yes
Hash 0e74346ee7bc0690453d9a477d183f1af818c36b1e707f2782efc922f2372b56
SimHash e92d44caf955

Groups

*

Rule Path
Allow /$
Disallow /
Disallow /api/
Disallow /dashboard/
Disallow /admin/
Disallow /login/
Disallow /cart/
Disallow /checkout/
Disallow /profile/
Disallow /account/
Disallow /settings/
Disallow /debug/
Disallow /test/
Disallow /preview/
Disallow /regenerate/
Disallow /logs/
Disallow /video-analysis/
Disallow /generations/
Disallow /products/
Disallow /contact/
Disallow /about/
Disallow /legal/
Disallow /oauth2callback/
Disallow /telegram-bot/
Disallow /get-chat-id/
Disallow /api-test/
Disallow /bulk-domain-check/
Disallow /debug-components/
Disallow /store-404/
Disallow /test-accounts/
Disallow /test-turnstile/
Disallow /test-video-gcs/
Disallow /video-analysis-stats/
Disallow /video-analysis-test/
Disallow /regenerate-content/
Disallow /regenerate-elements/
Disallow *.json
Disallow *.xml
Disallow *.txt
Disallow *.log
Disallow *.bak
Disallow *.tmp
Disallow *.backup
Disallow *.old
Disallow *.test
Disallow *.dev
Disallow *.staging
Disallow /.git/
Disallow /.env
Disallow /.next/
Disallow /node_modules/
Disallow /.vercel/
Disallow /.DS_Store
Disallow /package.json
Disallow /package-lock.json
Disallow /tsconfig.json
Disallow /next.config.js
Disallow /tailwind.config.js
Disallow /postcss.config.js
Disallow *.mp4
Disallow *.avi
Disallow *.mov
Disallow *.wmv
Disallow *.flv
Disallow *.webm
Disallow *.zip
Disallow *.rar
Disallow *.tar
Disallow *.gz
Disallow *.7z

Other Records

Field Value
crawl-delay 1

Comments

  • robots.txt для всех React сайтов
  • Запрещаем индексацию всех страниц кроме главной
  • Разрешаем только главную страницу
  • Запрещаем все остальные страницы и директории
  • Запрещаем служебные директории
  • Запрещаем файлы и расширения
  • Запрещаем системные файлы
  • Запрещаем медиа файлы (если не нужны в поиске)
  • Запрещаем архивы
  • Указываем sitemap (если есть)
  • Sitemap: https://yourdomain.com/sitemap.xml
  • Crawl-delay для вежливости (опционально)