asilmedia.org
robots.txt
Robots Exclusion Standard data for asilmedia.org
Resource Scan
Scan Details
| Site Domain | asilmedia.org |
| Base Domain | asilmedia.org |
| Scan Status | Ok |
| Last Scan | 2024-09-21T18:16:23+00:00 |
| Next Scan | 2024-09-28T18:16:23+00:00 |
Last Scan
| Scanned | 2024-09-21T18:16:23+00:00 |
| URL | https://asilmedia.org/robots.txt |
| Redirect | http://asilmedia.org/robots.txt |
| Domain IPs | 185.16.39.200 |
| Response IP | 185.16.39.200 |
| Found | Yes |
| Hash | 6a73d47dfb681761aafc1067f975d91b8d330914cfafa29b4375df24501d6eba |
| SimHash | 5909a4502531 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /engine/* |
| Disallow | /user/* |
| Disallow | /lastnews/* |
| Disallow | /catalog/* |
| Disallow | /newposts/* |
| Disallow | /favorites/ |
| Disallow | /emoticon/ |
| Disallow | /mylists/ |
| Disallow | /playlist/ |
| Disallow | /rules.html |
| Disallow | /statistics.html |
| Disallow | /addnews.html |
| Disallow | /?do=* |
| Disallow | /index.php?do=* |
| Disallow | /*do%3Dstats |
| Disallow | /*do%3Dpm |
| Disallow | /*do%3Dsearch |
| Disallow | /*subaction%3Duserinfo |
| Disallow | /*subaction%3Dnewposts |
| Disallow | /*do%3Dlastcomments |
| Disallow | /*do%3Dfeedback |
| Disallow | /*do%3Dregister |
| Disallow | /*do%3Dlostpassword |
| Disallow | |
| Allow | /engine/classes/js/ |
| Allow | /engine/classes/min/index.php |
| Allow | /engine/data/emoticons/ |
| Allow | /*.js |
| Allow | /*.css |
yandex
| Rule | Path |
|---|---|
| Disallow | /engine/* |
| Disallow | /user/* |
| Disallow | /lastnews/* |
| Disallow | /catalog/* |
| Disallow | /newposts/* |
| Disallow | /favorites/ |
| Disallow | /emoticon/ |
| Disallow | /mylists/ |
| Disallow | /playlist/ |
| Disallow | /rules.html |
| Disallow | /statistics.html |
| Disallow | /addnews.html |
| Disallow | /?do=* |
| Disallow | /index.php?do=* |
| Disallow | /*do%3Dstats |
| Disallow | /*do%3Dpm |
| Disallow | /*do%3Dsearch |
| Disallow | /*subaction%3Duserinfo |
| Disallow | /*subaction%3Dnewposts |
| Disallow | /*do%3Dlastcomments |
| Disallow | /*do%3Dfeedback |
| Disallow | /*do%3Dregister |
| Disallow | /*do%3Dlostpassword |
| Disallow | |
| Allow | /engine/classes/js/ |
| Allow | /engine/classes/min/index.php |
| Allow | /engine/data/emoticons/ |
| Allow | /*.js |
| Allow | /*.css |
Other Records
| Field | Value |
|---|---|
| sitemap | http://asilmedia.org/sitemap.xml |
Warnings
- `host` is not a known field.