asil-media.net
robots.txt
Robots Exclusion Standard data for asil-media.net
Resource Scan
Scan Details
| Site Domain | asil-media.net |
| Base Domain | asil-media.net |
| Scan Status | Ok |
| Last Scan | 2024-11-11T22:49:43+00:00 |
| Next Scan | 2024-11-18T22:49:43+00:00 |
Last Scan
| Scanned | 2024-11-11T22:49:43+00:00 |
| URL | https://asil-media.net/robots.txt |
| Redirect | http://asilmedia.org/robots.txt |
| Redirect Domain | asilmedia.org |
| Redirect Base | asilmedia.org |
| Domain IPs | 51.89.233.57 |
| Redirect IPs | 185.16.39.200 |
| Response IP | 185.16.39.200 |
| Found | Yes |
| Hash | 6a73d47dfb681761aafc1067f975d91b8d330914cfafa29b4375df24501d6eba |
| SimHash | 5909a4502531 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /engine/* |
| Disallow | /user/* |
| Disallow | /lastnews/* |
| Disallow | /catalog/* |
| Disallow | /newposts/* |
| Disallow | /favorites/ |
| Disallow | /emoticon/ |
| Disallow | /mylists/ |
| Disallow | /playlist/ |
| Disallow | /rules.html |
| Disallow | /statistics.html |
| Disallow | /addnews.html |
| Disallow | /?do=* |
| Disallow | /index.php?do=* |
| Disallow | /*do%3Dstats |
| Disallow | /*do%3Dpm |
| Disallow | /*do%3Dsearch |
| Disallow | /*subaction%3Duserinfo |
| Disallow | /*subaction%3Dnewposts |
| Disallow | /*do%3Dlastcomments |
| Disallow | /*do%3Dfeedback |
| Disallow | /*do%3Dregister |
| Disallow | /*do%3Dlostpassword |
| Disallow | |
| Allow | /engine/classes/js/ |
| Allow | /engine/classes/min/index.php |
| Allow | /engine/data/emoticons/ |
| Allow | /*.js |
| Allow | /*.css |
yandex
| Rule | Path |
|---|---|
| Disallow | /engine/* |
| Disallow | /user/* |
| Disallow | /lastnews/* |
| Disallow | /catalog/* |
| Disallow | /newposts/* |
| Disallow | /favorites/ |
| Disallow | /emoticon/ |
| Disallow | /mylists/ |
| Disallow | /playlist/ |
| Disallow | /rules.html |
| Disallow | /statistics.html |
| Disallow | /addnews.html |
| Disallow | /?do=* |
| Disallow | /index.php?do=* |
| Disallow | /*do%3Dstats |
| Disallow | /*do%3Dpm |
| Disallow | /*do%3Dsearch |
| Disallow | /*subaction%3Duserinfo |
| Disallow | /*subaction%3Dnewposts |
| Disallow | /*do%3Dlastcomments |
| Disallow | /*do%3Dfeedback |
| Disallow | /*do%3Dregister |
| Disallow | /*do%3Dlostpassword |
| Disallow | |
| Allow | /engine/classes/js/ |
| Allow | /engine/classes/min/index.php |
| Allow | /engine/data/emoticons/ |
| Allow | /*.js |
| Allow | /*.css |
Other Records
| Field | Value |
|---|---|
| sitemap | http://asilmedia.org/sitemap.xml |
Warnings
- `host` is not a known field.