rosserial.mobi
robots.txt
Robots Exclusion Standard data for rosserial.mobi
Resource Scan
Scan Details
| Site Domain | rosserial.mobi |
| Base Domain | rosserial.mobi |
| Scan Status | Ok |
| Last Scan | 2024-09-25T20:08:34+00:00 |
| Next Scan | 2024-10-02T20:08:34+00:00 |
Last Scan
| Scanned | 2024-09-25T20:08:34+00:00 |
| URL | https://rosserial.mobi/robots.txt |
| Domain IPs | 92.63.107.212 |
| Response IP | 92.63.107.212 |
| Found | Yes |
| Hash | 6913683e36a0d0e37e5f5e9784610703186ea72344edd4f4166791320f573801 |
| SimHash | ed0cac532031 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /statistics.html |
| Disallow | /*subaction%3Duserinfo |
| Disallow | /*subaction%3Dnewposts |
| Disallow | /*do%3Dlastcomments |
| Disallow | /*do%3Dregister |
| Disallow | /*do%3Dlostpassword |
| Disallow | /*do%3Daddnews |
| Disallow | /*do%3Dstats |
| Disallow | /*do%3Dpm |
| Disallow | /*do%3Dsearch |
| Disallow | /*do%3Ddownload |
| Disallow | /*do%3Dgo |
| Disallow | /catalog/ |
| Disallow | /index.php?do=userinfo |
| Disallow | /index.php?do=allnews |
| Disallow | /index.php?do=newposts |
| Disallow | /dle-rules-page.html |
| Disallow | /xfsearch/* |
| Disallow | /tags/* |
| Disallow | */tags/* |
| Disallow | */rss.xml |
| Disallow | /? |
| Disallow | /index.php?do=opensearch |
| Disallow | /*?__cf_chl* |
| Disallow | /tags/%D0%9C%D0%BE%D1%81%D1%84%D0%B8%D0%BB%D1%8C%D0%BC/page/*/ |
| Allow | /xfsearch/year/2019/ |
| Allow | /tags/%D0%9C%D0%BE%D1%81%D1%84%D0%B8%D0%BB%D1%8C%D0%BC/ |
| Allow | /xfsearch/year/2020/ |
| Allow | /xfsearch/year/* |
| Disallow | /info/* |
| Disallow | /info-actor/* |
| Disallow | /info-series/* |
| Disallow | /info-photos/* |
| Disallow | /video/* |
| Disallow | /images/show.php |
| Disallow | /uploads/* |
| Allow | /uploads/mini/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://rosserial.mobi/sitemap.xml |
Warnings
- `host` is not a known field.