Log In Sign Up

pt.psprices.com
robots.txt

Robots Exclusion Standard data for pt.psprices.com

Resource Scan

Scan Details

Site Domain pt.psprices.com
Base Domain psprices.com
Scan Status Ok
Last Scan2025-12-28T08:17:51+00:00
Next Scan 2026-01-27T08:17:51+00:00

Last Scan

Scanned2025-12-28T08:17:51+00:00
URL https://pt.psprices.com/robots.txt
Redirect https://psprices.com/robots.txt
Redirect Domain psprices.com
Redirect Base psprices.com
Domain IPs 104.26.2.13, 104.26.3.13, 172.67.75.103, 2606:4700:20::681a:20d, 2606:4700:20::681a:30d, 2606:4700:20::ac43:4b67
Redirect IPs 104.26.2.13, 104.26.3.13, 172.67.75.103, 2606:4700:20::681a:20d, 2606:4700:20::681a:30d, 2606:4700:20::ac43:4b67
Response IP 104.26.2.13
Found Yes
Hash 09f5d8e509ea9dbe22f337c9537aa77a08082dd96770fe2c92c384f35137ec45
SimHash c50baaf242b1

Groups

*

Rule Path
Allow /
Disallow /*?*sort=
Disallow /*?*display=
Disallow /*?*ordering=
Disallow /*%26sort%3D
Disallow /*%26display%3D
Disallow /*%26ordering%3D
Disallow /admin/
Disallow /account/
Disallow /*/account/
Disallow /api/*
Disallow /a/go/*
Disallow /ads-pay
Disallow /ads-pay/*
Disallow /try-help
Disallow /try-help/*
Disallow /game/buy/*
Disallow /game/social-widget/*
Disallow /game/fragment/
Disallow /*/game/fragment/
Disallow /fragment/
Disallow /*/fragment/
Allow /region-*/game/
Allow /region-*/collection/
Allow /region-*/index
Allow /*?platform=*
Allow /*?region=*

Other Records

Field Value
crawl-delay 0.5
Back to top

Other Records

Field Value
sitemap https://psprices.com/sitemap.xml
Back to top

Comments

  • Блокируем только параметры UI, которые не меняют контент
  • Язык НЕ блокируем - пользователи должны наÑ
  • Блокируем административные и служебные разделы
  • Блокируем HTMX fragment endpoints (AJAX-only, не индексируемый контент)
  • Оптимизация краул-бюджета
  • Разрешаем важные страницы
  • Разрешаем важный динамический контент
Back to top

Warnings

  • 1 invalid line.
  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top