astrolog4you.com
robots.txt
Robots Exclusion Standard data for astrolog4you.com
Resource Scan
Scan Details
| Site Domain | astrolog4you.com |
| Base Domain | astrolog4you.com |
| Scan Status | Ok |
| Last Scan | 2026-02-14T22:20:20+00:00 |
| Next Scan | 2026-02-21T22:20:20+00:00 |
Last Scan
| Scanned | 2026-02-14T22:20:20+00:00 |
| URL | https://astrolog4you.com/robots.txt |
| Domain IPs | 185.71.67.157 |
| Response IP | 185.71.67.157 |
| Found | Yes |
| Hash | e5d7ffe63a197f911fa112161aab7b87cccf58b04c72460cbf99722401598c9b |
| SimHash | 3a4380605b37 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /articles/index |
| Disallow | /transit-service/index |
| Disallow | /transit-every-day/index |
| Disallow | /prognosis/index |
| Disallow | /personal/index |
| Disallow | /solar/index |
| Disallow | /synastry/index |
| Disallow | /*utm_source%3D |
| Disallow | /admin* |
| Disallow | /dashboard* |
| Disallow | /board* |
| Disallow | /stat* |
| Disallow | /move/view* |
| Disallow | /child/view* |
| Disallow | /transit/view* |
| Disallow | /personal/view* |
| Disallow | /synastry/view* |
| Disallow | /perfect/view* |
| Disallow | /wedding/view* |
| Disallow | /prognosis/view* |
| Disallow | /transit-every-day/view* |
| Disallow | /solar/view* |
| Disallow | /transit-service/view* |
| Disallow | /user/password-recovery* |
| Disallow | /natal/view* |
| Disallow | /user/profile* |
| Disallow | /user/safety* |
| Disallow | /user/templates* |
| Disallow | /horoscope/history* |
| Disallow | /subscription/control* |
| Disallow | /subscription/benefits* |
| Disallow | *?__cf_chl_tk= |
| Allow | *.css |
| Allow | *.js |
| Allow | *.png |
| Allow | *.svg |
| Allow | *.jpg |
yandex
| Rule | Path |
|---|---|
| Disallow | /*utm_source%3D |
| Disallow | /admin* |
| Disallow | /dashboard* |
| Disallow | /board* |
| Disallow | /stat* |
| Disallow | /move/view* |
| Disallow | /child/view* |
| Disallow | /transit/view* |
| Disallow | /personal/view* |
| Disallow | /synastry/view* |
| Disallow | /perfect/view* |
| Disallow | /wedding/view* |
| Disallow | /prognosis/view* |
| Disallow | /transit-every-day/view* |
| Disallow | /solar/view* |
| Disallow | /transit-service/view* |
| Disallow | /user/password-recovery* |
| Disallow | /natal/view* |
| Disallow | /user/profile* |
| Disallow | /user/safety* |
| Disallow | /user/templates* |
| Disallow | /horoscope/history* |
| Disallow | /subscription/control* |
| Disallow | /subscription/benefits* |
| Allow | *.css |
| Allow | *.js |
| Allow | *.png |
| Allow | *.svg |
| Allow | *.jpg |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 0.5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://astrolog4you.com/sitemap/sitemap.xml |
| sitemap | https://astrolog4you.com/sitemap/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.