fanat1k.ru
robots.txt
Robots Exclusion Standard data for fanat1k.ru
Resource Scan
Scan Details
| Site Domain | fanat1k.ru |
| Base Domain | fanat1k.ru |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-11-11T01:23:03+00:00 |
| Next Scan | 2025-02-09T01:23:03+00:00 |
Last Successful Scan
| Scanned | 2023-10-18T20:10:33+00:00 |
| URL | https://fanat1k.ru/robots.txt |
| Domain IPs | 89.108.104.77 |
| Response IP | 89.108.104.77 |
| Found | Yes |
| Hash | cb862567b6aad7114fec015cd01ebf03371e3db6dfeaa85dcdc1693f17489dd1 |
| SimHash | 067ef5f0e3b4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /e107_handlers/ |
| Disallow | /pm.php |
| Disallow | /user.php |
| Disallow | /*rss_menu |
| Disallow | /*myblog |
| Disallow | /audio-download |
| Disallow | /comment |
| Disallow | /click.php |
| Disallow | /predict_handler.php |
| Disallow | /predict.php?stats |
| Disallow | /news.php?cat |
| Disallow | /newse- |
| Disallow | /newsm- |
| Disallow | /news2- |
| Disallow | /news3- |
| Disallow | /news4- |
| Disallow | /news5- |
| Disallow | /news6- |
| Disallow | /news7- |
| Disallow | /news8- |
| Disallow | /news9- |
| Disallow | /news10- |
| Disallow | /news11- |
| Disallow | /news12- |
| Disallow | /news13- |
| Disallow | /news14- |
| Disallow | /news15- |
| Disallow | /news16- |
| Disallow | /news17- |
| Disallow | /news18- |
| Disallow | /flv/index.php?searchtag. |
| Disallow | /search |
| Disallow | /*cid%3D |
| Disallow | /*gpf%3D |
| Disallow | /flv/data/ |
| Disallow | /event.php |
| Disallow | /images-ctag |
| Disallow | /images-ftag |
| Disallow | /images-pic |
| Disallow | /images-sfoto |
| Disallow | /images-vfoto |
| Disallow | /image- |
| Disallow | /*orderadate.php |
| Disallow | /*orderaparent.php |
| Disallow | /*orderarefer.php |
| Disallow | /*orderaheading.php |
| Disallow | /*orderaorder.php |
| Disallow | /*order%3D |
| Disallow | /predict.php?live. |
| Disallow | /prognoz-predict |
| Disallow | /predict.php?predict |
| Disallow | /prognoz-table |
| Disallow | /predict.php?table |
| Disallow | /prognoz-stats |
| Disallow | /predict.php?stats |
| Disallow | /predict.php?com |
| Disallow | /prognoz-live- |
| Disallow | /programs-download |
| Disallow | /blog-com |
| Disallow | /*macgurublog_menu |
| Disallow | /*rwworld/prognoz-stats |
| Disallow | /torrinfo.phptorr_id |
| Disallow | /video-search |
| Disallow | /ajax.php |
| Disallow | /*_handler.php |
| Disallow | /video-searchtag |
| Disallow | /profile-settings |
| Disallow | /profile-comments |
| Disallow | /profile-editprofile |
| Disallow | /profile-friends-add |
| Disallow | /profile-groups |
| Disallow | /profile-mark |
| Disallow | /tag-*- |
| Disallow | /*mytagcloud_menu/tags.php |
| Disallow | /library-download |
| Disallow | /*video_get.php |
| Disallow | /*pshow%3D |
| Disallow | /*fshow%3D |
| Disallow | /news.php?extend. |
| Disallow | /sostav/ |
| Disallow | /*rw_video_embed.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 0.1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://fanat1k.ru/gsitemap.php |
Warnings
- 2 invalid lines.
- `host` is not a known field.