dpstream.onl
robots.txt
Robots Exclusion Standard data for dpstream.onl
Resource Scan
Scan Details
| Site Domain | dpstream.onl |
| Base Domain | dpstream.onl |
| Scan Status | Ok |
| Last Scan | 2025-03-24T15:54:04+00:00 |
| Next Scan | 2025-04-23T15:54:04+00:00 |
Last Scan
| Scanned | 2025-03-24T15:54:04+00:00 |
| URL | https://dpstream.onl/robots.txt |
| Domain IPs | 104.21.56.232, 172.67.137.174, 2606:4700:3036::6815:38e8, 2606:4700:3036::ac43:89ae |
| Response IP | 104.21.56.232 |
| Found | Yes |
| Hash | ca34baa8601dd54b661e34ec5544a5cc5b2c7fccfeebe2c291ef1c36251e8435 |
| SimHash | 6f04a1c34d82 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /engine/classes/*.css |
| Allow | /engine/classes/*.js |
| Allow | /templates/dpstream/style/*.css |
| Allow | /templates/dpstream/js/*.js |
| Disallow | /user/ |
| Disallow | /backup/ |
| Disallow | /engine/ |
| Disallow | /language/ |
| Disallow | /upgrade/ |
| Disallow | /autobackup.php |
| Disallow | /admin.php |
| Disallow | /index.php?do=addnews |
| Disallow | /index.php?do=feedback |
| Disallow | /index.php?do=lostpassword |
| Disallow | /index.php?do=pm |
| Disallow | /index.php?do=register |
| Disallow | /index.php?do=stats |
| Disallow | /index.php?do=search |
| Disallow | /index.php?subaction=newposts |
| Disallow | /?do=lastcomments |
| Disallow | /statistics.html |
| Disallow | /xfsearch/ |
| Disallow | /page/ |
| Disallow | /*/page/ |
| Disallow | /catalog/ |
| Disallow | /index.php/*/ |
| Disallow | /index.php/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://dpstream.onl/sitemap.xml |
Warnings
- `host` is not a known field.