fd.ru
robots.txt
Robots Exclusion Standard data for fd.ru
Resource Scan
Scan Details
| Site Domain | fd.ru |
| Base Domain | fd.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-10T23:59:00+00:00 |
| Next Scan | 2024-11-17T23:59:00+00:00 |
Last Scan
| Scanned | 2024-11-10T23:59:00+00:00 |
| URL | https://fd.ru/robots.txt |
| Redirect | https://www.fd.ru/robots.txt |
| Redirect Domain | www.fd.ru |
| Redirect Base | fd.ru |
| Domain IPs | 95.214.59.72 |
| Redirect IPs | 95.214.59.72 |
| Response IP | 95.214.59.72 |
| Found | Yes |
| Hash | b9d4799ea9737378528bc925f3d747e4e7d53b705dcaa23ac3240c19e3aa3c1f |
| SimHash | 6875ba2164b2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *Q |
| Disallow | *W |
| Disallow | *E |
| Disallow | *R |
| Disallow | *T |
| Disallow | *Y |
| Disallow | *U |
| Disallow | *I |
| Disallow | *O |
| Disallow | *P |
| Disallow | *A |
| Disallow | *S |
| Disallow | *F |
| Disallow | *D |
| Disallow | *G |
| Disallow | *H |
| Disallow | *J |
| Disallow | *K |
| Disallow | *L |
| Disallow | *Z |
| Disallow | *X |
| Disallow | *C |
| Disallow | *V |
| Disallow | *B |
| Disallow | *N |
| Disallow | *M |
| Disallow | /cgi-bin/ |
| Disallow | /images2/ |
| Disallow | /remind |
| Disallow | /reg |
| Disallow | /admin/ |
| Disallow | /print* |
| Disallow | /converter* |
| Disallow | /tv/ |
| Disallow | /captchanew/ |
| Disallow | /captcha/ |
| Disallow | /cards/ |
| Disallow | /hotline/ |
| Disallow | /postcards/ |
| Disallow | /dokiweb/ |
| Disallow | /tv2/ |
| Disallow | /spread.php |
| Disallow | /pay.htm |
| Disallow | /forum/ |
| Disallow | /info/ |
| Disallow | /od/ |
| Disallow | /rtf* |
| Disallow | /bill |
| Disallow | /virtual |
| Disallow | /*?_openstat |
| Disallow | /away.htm |
| Disallow | /protected/ |
| Disallow | /backend/ |
| Disallow | /consultation/consultation/addQuestion/ |
| Disallow | /npd/ |
| Disallow | /edoc |
| Disallow | /search |
| Disallow | |
| Disallow | *.doc |
| Disallow | *.xls |
| Disallow | *.ppt |
| Disallow | *.docx |
| Disallow | *.xlsx |
| Disallow | *.pptx |
| Disallow | /virtual/ |
| Disallow | /articles/rubric/ |
| Disallow | /unsubscribe* |
| Disallow | *?from=* |
| Disallow | *?switchToSiteVersion=* |
| Disallow | *?utm_* |
| Disallow | /*/print/ |
| Disallow | /*/article/print?id= |
| Disallow | *?ustp=* |
| Disallow | /search?q=* |
| Disallow | /unsubscribe* |
| Disallow | /delivery* |
| Disallow | *IdBatch%3D* |
| Disallow | *IdSL%3D* |
| Disallow | /partner* |
| Disallow | /book* |
| Disallow | /konf2015* |
| Disallow | /*?*btx=* |
| Disallow | *?activityId=* |
| Disallow | /articles/159705* |
| Disallow | /bill* |
| Disallow | /*?bill= |
| Disallow | /vip/ |
| Disallow | /podpiska/ |
| Disallow | /*%26*frp%3D |
| Disallow | /*?*pw= |
| Disallow | /assets/ |
| Disallow | /images/ |
| Disallow | /themes/ |
| Disallow | /files/ |
| Disallow | /news/rubric/ |
| Disallow | /question/rubrika/ |
| Disallow | /person/ |
| Disallow | /poll/ |
yandex
| Rule | Path |
|---|---|
| Allow | /rss/rss_for_yandex.xml |
| Disallow | /cgi-bin/ |
| Disallow | /images2/ |
| Disallow | /remind |
| Disallow | /reg |
| Disallow | /admin/ |
| Disallow | /print* |
| Disallow | /converter* |
| Disallow | /tv/ |
| Disallow | /captchanew/ |
| Disallow | /captcha/ |
| Disallow | /cards/ |
| Disallow | /hotline/ |
| Disallow | /postcards/ |
| Disallow | /dokiweb/ |
| Disallow | /tv2/ |
| Disallow | /spread.php |
| Disallow | /pay.htm |
| Disallow | /forum/ |
| Disallow | /info/ |
| Disallow | /od/ |
| Disallow | /rtf* |
| Disallow | /bill |
| Disallow | /virtual |
| Disallow | /*?_openstat |
| Disallow | /away.htm |
| Disallow | /protected/ |
| Disallow | /backend/ |
| Disallow | /consultation/consultation/addQuestion/ |
| Disallow | /npd/ |
| Disallow | /edoc |
| Disallow | /search |
| Disallow | |
| Disallow | *.doc |
| Disallow | *.xls |
| Disallow | *.ppt |
| Disallow | *.docx |
| Disallow | *.xlsx |
| Disallow | *.pptx |
| Disallow | /virtual/ |
| Disallow | /rubricator/230* |
| Disallow | /rubricator/336* |
| Disallow | /rubricator/296* |
| Disallow | /rubricator/274* |
| Disallow | /rubricator/251* |
| Disallow | /rubricator/25* |
| Disallow | /rubricator/307* |
| Disallow | /articles/rubric/ |
| Disallow | /unsubscribe* |
| Disallow | *?from=* |
| Disallow | *?switchToSiteVersion=* |
| Disallow | *?utm_* |
| Disallow | /*/print/ |
| Disallow | /*/article/print?id= |
| Disallow | *?ustp=* |
| Disallow | /search?q=* |
| Disallow | /unsubscribe* |
| Disallow | /delivery* |
| Disallow | *IdBatch%3D* |
| Disallow | *IdSL%3D* |
| Disallow | /partner* |
| Disallow | /book* |
| Disallow | /konf2015* |
| Disallow | /*?*btx=* |
| Disallow | *?activityId=* |
| Disallow | /articles/159705* |
| Disallow | /bill* |
| Disallow | /*?bill= |
| Disallow | /vip/ |
| Disallow | /podpiska/ |
| Disallow | /*%26*frp%3D |
| Disallow | /*?*pw= |
| Disallow | /assets/ |
| Disallow | /images/ |
| Disallow | /themes/ |
| Disallow | /files/ |
| Disallow | /news/rubric/ |
| Disallow | /question/rubrika/ |
| Disallow | /person/ |
| Disallow | /poll/ |
| Disallow | /rubricator/119* |
| Disallow | /rubricator/370* |
| Disallow | /rubricator/288* |
googlebot
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /images2/ |
| Disallow | /remind |
| Disallow | /reg |
| Disallow | /admin/ |
| Disallow | /print* |
| Disallow | /converter* |
| Disallow | /tv/ |
| Disallow | /captchanew/ |
| Disallow | /captcha/ |
| Disallow | /cards/ |
| Disallow | /hotline/ |
| Disallow | /postcards/ |
| Disallow | /dokiweb/ |
| Disallow | /tv2/ |
| Disallow | /spread.php |
| Disallow | /pay.htm |
| Disallow | /forum/ |
| Disallow | /info/ |
| Disallow | /od/ |
| Disallow | /rtf* |
| Disallow | /bill |
| Disallow | /virtual |
| Disallow | /*?_openstat |
| Disallow | /away.htm |
| Disallow | /protected/ |
| Disallow | /backend/ |
| Disallow | /consultation/consultation/addQuestion/ |
| Disallow | /npd/ |
| Disallow | /edoc |
| Disallow | /search |
| Disallow | |
| Disallow | *.doc |
| Disallow | *.xls |
| Disallow | *.ppt |
| Disallow | *.docx |
| Disallow | *.xlsx |
| Disallow | *.pptx |
| Disallow | /virtual/ |
| Disallow | /articles/rubric/ |
| Disallow | /unsubscribe* |
| Disallow | *?from=* |
| Disallow | *?switchToSiteVersion=* |
| Disallow | *?utm_* |
| Disallow | /*/print/ |
| Disallow | /*/article/print?id= |
| Disallow | *?ustp=* |
| Disallow | /search?q=* |
| Disallow | /unsubscribe* |
| Disallow | /delivery* |
| Disallow | *IdBatch%3D* |
| Disallow | *IdSL%3D* |
| Disallow | /partner* |
| Disallow | /book* |
| Disallow | /konf2015* |
| Disallow | /*?*btx=* |
| Disallow | *?activityId=* |
| Disallow | /articles/159705* |
| Disallow | /bill* |
| Disallow | /*?bill= |
| Disallow | /vip/ |
| Disallow | /podpiska/ |
| Disallow | /*%26*frp%3D |
| Disallow | /*?*pw= |
| Disallow | /assets/ |
| Disallow | /images/ |
| Disallow | /themes/ |
| Disallow | /files/ |
| Disallow | /news/rubric/ |
| Disallow | /question/rubrika/ |
| Disallow | /person/ |
| Disallow | /poll/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.fd.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.