astrolog4you.com
robots.txt

Robots Exclusion Standard data for astrolog4you.com

Resource Scan

Scan Details

Site Domain astrolog4you.com
Base Domain astrolog4you.com
Scan Status Ok
Last Scan2026-02-14T22:20:20+00:00
Next Scan 2026-02-21T22:20:20+00:00

Last Scan

Scanned2026-02-14T22:20:20+00:00
URL https://astrolog4you.com/robots.txt
Domain IPs 185.71.67.157
Response IP 185.71.67.157
Found Yes
Hash e5d7ffe63a197f911fa112161aab7b87cccf58b04c72460cbf99722401598c9b
SimHash 3a4380605b37

Groups

*

Rule Path
Disallow /articles/index
Disallow /transit-service/index
Disallow /transit-every-day/index
Disallow /prognosis/index
Disallow /personal/index
Disallow /solar/index
Disallow /synastry/index
Disallow /*utm_source%3D
Disallow /admin*
Disallow /dashboard*
Disallow /board*
Disallow /stat*
Disallow /move/view*
Disallow /child/view*
Disallow /transit/view*
Disallow /personal/view*
Disallow /synastry/view*
Disallow /perfect/view*
Disallow /wedding/view*
Disallow /prognosis/view*
Disallow /transit-every-day/view*
Disallow /solar/view*
Disallow /transit-service/view*
Disallow /user/password-recovery*
Disallow /natal/view*
Disallow /user/profile*
Disallow /user/safety*
Disallow /user/templates*
Disallow /horoscope/history*
Disallow /subscription/control*
Disallow /subscription/benefits*
Disallow *?__cf_chl_tk=
Allow *.css
Allow *.js
Allow *.png
Allow *.svg
Allow *.jpg

yandex

Rule Path
Disallow /*utm_source%3D
Disallow /admin*
Disallow /dashboard*
Disallow /board*
Disallow /stat*
Disallow /move/view*
Disallow /child/view*
Disallow /transit/view*
Disallow /personal/view*
Disallow /synastry/view*
Disallow /perfect/view*
Disallow /wedding/view*
Disallow /prognosis/view*
Disallow /transit-every-day/view*
Disallow /solar/view*
Disallow /transit-service/view*
Disallow /user/password-recovery*
Disallow /natal/view*
Disallow /user/profile*
Disallow /user/safety*
Disallow /user/templates*
Disallow /horoscope/history*
Disallow /subscription/control*
Disallow /subscription/benefits*
Allow *.css
Allow *.js
Allow *.png
Allow *.svg
Allow *.jpg

Other Records

Field Value
crawl-delay 0.5

Other Records

Field Value
sitemap https://astrolog4you.com/sitemap/sitemap.xml
sitemap https://astrolog4you.com/sitemap/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.