parents.ru
robots.txt
Robots Exclusion Standard data for parents.ru
Resource Scan
Scan Details
| Site Domain | parents.ru |
| Base Domain | parents.ru |
| Scan Status | Ok |
| Last Scan | 2024-05-25T17:25:31+00:00 |
| Next Scan | 2024-06-01T17:25:31+00:00 |
Last Scan
| Scanned | 2024-05-25T17:25:31+00:00 |
| URL | https://parents.ru/robots.txt |
| Redirect | https://www.parents.ru/robots.txt |
| Redirect Domain | www.parents.ru |
| Redirect Base | parents.ru |
| Domain IPs | 195.226.222.194 |
| Redirect IPs | 195.226.222.194 |
| Response IP | 195.226.222.194 |
| Found | Yes |
| Hash | 03c90d1d31fc76564b9902f0dee95efb4b86bbfdb9021a8f05ceb44bff6e3356 |
| SimHash | a7d41e3787f3 |
Groups
yandexnews
| Rule | Path |
|---|---|
| Allow | */yanews/ |
| Allow | /rss/yandex/ |
| Allow | *?from=yanews |
| Allow | *?utm_source= |
| Allow | /rss-feeds/yanews.xml |
*
| Rule | Path |
|---|---|
| Allow | /rss/ |
| Allow | /pages/about/ |
| Disallow | /tags/* |
| Disallow | /js/ |
| Disallow | /css/ |
| Disallow | /search |
| Disallow | /files/ppt |
| Disallow | /*print%3Dy |
| Disallow | /*page%3D1 |
| Disallow | /*?p_= |
| Disallow | /*%26write |
| Disallow | /pregnancy-calendar/*?day |
| Disallow | /pregnancy-calendar/*?cur= |
| Disallow | /child-calendar/*?day |
| Disallow | /child-calendar/*?cur= |
| Disallow | /gifts/*?cur= |
| Disallow | /child-calendar-1-5/*?day |
| Disallow | /child-calendar-1-5/*?cur= |
| Disallow | /astro/dreams/themes/*/% |
| Disallow | /shopping/*place%3D |
| Disallow | /astro/names/ |
| Disallow | /new_user/ |
| Disallow | /*thread%3D |
| Disallow | /*fsize%3D |
| Disallow | /*tmpp%3D |
| Disallow | /*?sort= |
| Disallow | /shopping/*%26at%3D |
| Disallow | /*s%3D |
| Disallow | /*/1/$ |
| Disallow | /*/rabbit-oracle/ |
| Disallow | /*page%3Dall$ |
| Disallow | /*pag%3D |
| Disallow | /*all%3D |
| Disallow | /tests/result/ |
| Disallow | /adstest |
| Disallow | /psychologies |
| Disallow | /restaurant/ |
| Disallow | /*/_article/ |
| Disallow | /astro/* |
| Disallow | /int/* |
| Disallow | /photo/* |
| Disallow | /shopping/* |
| Disallow | /?e=in |
| Disallow | /serial/* |
| Disallow | /starhit/* |
| Disallow | /wdaily/* |
| Disallow | /person/* |
| Disallow | /horoscope/* |
| Disallow | /remove_* |
| Disallow | /frontend/* |
| Disallow | /klorane/* |
| Disallow | /phototag/* |
| Disallow | /tags/* |
| Disallow | /eis/* |
| Disallow | /video/videotag/* |
| Disallow | /treetags/* |
| Disallow | /article/preview/* |
| Disallow | /profile/* |
| Disallow | /about/ |
| Disallow | /condition/ |
| Disallow | /condition2/ |
| Disallow | /termsofuse/ |
| Disallow | /competitionrules/ |
| Disallow | /experts/* |
| Disallow | /specprojects/* |
| Disallow | /rules_* |
| Disallow | /articleComment/* |
| Disallow | /catalogue/submenu/* |
| Disallow | /like/* |
| Disallow | *?previewToken=* |
| Disallow | /pages/ |
| Disallow | */?gmpage=* |
| Disallow | /? |
| Disallow | */?google_preview= |
| Disallow | *%26sort%3D |
| Disallow | *showFullscreen%3D |
| Disallow | *?hl= |
| Disallow | *?email= |
| Disallow | /*?utm |
| Disallow | /*%26utm |
| Disallow | */?openGallery= |
| Disallow | /article/*/? |
| Disallow | */yanews/ |
| Disallow | */getChannel/$ |
| Disallow | /gm-api/ |
| Disallow | /81006599/ |
| Disallow | /22729373807/ |
| Disallow | /s/ |
| Disallow | */result/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.parents.ru/sitemaps/index.xml.gz |
Warnings
- `clean-param` is not a known field.