rosserial.top
robots.txt
Robots Exclusion Standard data for rosserial.top
Resource Scan
Scan Details
| Site Domain | rosserial.top |
| Base Domain | rosserial.top |
| Scan Status | Ok |
| Last Scan | 2024-11-09T03:52:05+00:00 |
| Next Scan | 2024-11-16T03:52:05+00:00 |
Last Scan
| Scanned | 2024-11-09T03:52:05+00:00 |
| URL | https://rosserial.top/robots.txt |
| Domain IPs | 104.21.94.214, 172.67.140.83, 2606:4700:3033::ac43:8c53, 2606:4700:3035::6815:5ed6 |
| Response IP | 104.21.94.214 |
| Found | Yes |
| Hash | e78442c6a9ed59de152d9b895d133500f30510f136ceab69b16abdd2ad852c80 |
| SimHash | 7d0d8c7b5631 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /engine/go.php |
| Disallow | /user/ |
| Disallow | /newposts/ |
| Disallow | /statistics.html |
| Disallow | /*subaction%3Duserinfo |
| Disallow | /*subaction%3Dnewposts |
| Disallow | /*do%3Dlastcomments |
| Disallow | /*do%3Dfeedback |
| Disallow | /*do%3Dregister |
| Disallow | /*do%3Dlostpassword |
| Disallow | /*do%3Daddnews |
| Disallow | /*do%3Dstats |
| Disallow | /*do%3Dpm |
| Disallow | /*do%3Dsearch |
| Disallow | /*do%3Ddownload |
| Disallow | /*do%3Dgo |
| Disallow | /catalog/ |
| Disallow | /index.php?do=userinfo |
| Disallow | /index.php?do=allnews |
| Disallow | /index.php?do=newposts |
| Disallow | /index.php?do |
| Disallow | /dle-rules-page.html |
| Disallow | /obnovlenie/ |
| Disallow | /xfsearch/* |
| Disallow | /tags/* |
| Disallow | */tags/* |
| Disallow | */rss.xml |
| Disallow | /uploads/* |
| Disallow | /serii/ |
| Disallow | /? |
| Disallow | /episode/ |
| Disallow | /izbrannoe/ |
| Disallow | /redirect.php? |
| Disallow | /page* |
| Disallow | */page/* |
| Disallow | */page/*/ |
| Disallow | /mylists* |
| Disallow | /mylists/* |
| Disallow | /engine/modules/antibot/antibot.php |
| Allow | /tags/1%2B1%20%D0%9F%D1%80%D0%BE%D0%B4%D0%B0%D0%BA%D1%88%D0%BD/ |
| Disallow | /tags/1%2B1%20%D0%9F%D1%80%D0%BE%D0%B4%D0%B0%D0%BA%D1%88%D0%BD/page/*/ |
| Allow | /tags/%D0%9C%D0%BE%D1%81%D1%84%D0%B8%D0%BB%D1%8C%D0%BC/ |
| Disallow | /tags/%D0%9C%D0%BE%D1%81%D1%84%D0%B8%D0%BB%D1%8C%D0%BC/page/*/ |
| Allow | /tags/%D0%AD%D0%BF%D0%B8%D0%BA%20%D0%9C%D0%B5%D0%B4%D0%B8%D0%B0/ |
| Disallow | /tags/%D0%AD%D0%BF%D0%B8%D0%BA%20%D0%9C%D0%B5%D0%B4%D0%B8%D0%B0/page/*/ |
| Disallow | /myyoutube/ |
| Disallow | /myrss/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://rosserial.top/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.