rosserial.online
robots.txt
Robots Exclusion Standard data for rosserial.online
Resource Scan
Scan Details
Site Domain | rosserial.online |
Base Domain | rosserial.online |
Scan Status | Ok |
Last Scan | 2024-11-13T19:28:50+00:00 |
Next Scan | 2024-11-20T19:28:50+00:00 |
Last Scan
Scanned | 2024-11-13T19:28:50+00:00 |
URL | https://rosserial.online/robots.txt |
Domain IPs | 104.21.3.244, 172.67.131.93, 2606:4700:3031::ac43:835d, 2606:4700:3037::6815:3f4 |
Response IP | 104.21.3.244 |
Found | Yes |
Hash | db185322a489f38ffba48173a16b01f5dd75a7b94ff6be1d589bb93c636bff9e |
SimHash | d90900c92533 |
Groups
*
Rule | Path |
---|---|
Disallow | /engine/ |
Disallow | /engine/go.php |
Disallow | /user/ |
Disallow | /newposts/ |
Disallow | /statistics.html |
Disallow | /*subaction%3Duserinfo |
Disallow | /*subaction%3Dnewposts |
Disallow | /*do%3Dlastcomments |
Disallow | /*do%3Dfeedback |
Disallow | /*do%3Dregister |
Disallow | /*do%3Dlostpassword |
Disallow | /*do%3Daddnews |
Disallow | /*do%3Dstats |
Disallow | /*do%3Dpm |
Disallow | /*do%3Dsearch |
Disallow | /*do%3Ddownload |
Disallow | /*do%3Dgo |
Disallow | /iviru/ |
Disallow | /lastnews |
Disallow | /rossija-2/ |
Disallow | /xfsearch/kinocompany/* |
Disallow | /xfsearch/country/%D0%A8%D0%B2%D0%B5%D1%86%D0%B8%D1%8F/ |
Disallow | /xfsearch/country/%D0%90%D1%80%D0%BC%D0%B5%D0%BD%D0%B8%D1%8F/ |
Disallow | /podborki/ |
Disallow | /istoricheskie/istoricheskie-filmy-pro-srednevekove/ |
Disallow | /komedijnye/komedii-pro-parnej/ |
Allow | *.js* |
Allow | *.css* |
Other Records
Field | Value |
---|---|
sitemap | https://rosserial.online/sitemap.xml |
Warnings
- 3 invalid lines.