soft.mydiv.net
robots.txt
Robots Exclusion Standard data for soft.mydiv.net
Resource Scan
Scan Details
| Site Domain | soft.mydiv.net |
| Base Domain | mydiv.net |
| Scan Status | Ok |
| Last Scan | 2025-07-29T08:30:11+00:00 |
| Next Scan | 2025-08-28T08:30:11+00:00 |
Last Scan
| Scanned | 2025-07-29T08:30:11+00:00 |
| URL | https://soft.mydiv.net/robots.txt |
| Domain IPs | 108.181.24.29 |
| Response IP | 108.181.24.29 |
| Found | Yes |
| Hash | f022628bc96fa54709441e0f34f91cc60f8a153c5c7953b944c889bad41f9b39 |
| SimHash | 303e75d3ceb9 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /exports/ |
| Disallow | /imgs/core/captcha/ |
| Disallow | /gf/ |
| Disallow | /cgi-bin/ |
| Disallow | /*/clicklink |
| Disallow | /*/clicksite |
| Disallow | /*/commentsredir |
| Disallow | /*/postinfo |
| Disallow | /*/buy |
| Disallow | /*/ddl |
| Disallow | /*/informers |
| Disallow | /*/sf |
| Disallow | /*/ajax |
| Disallow | /*/subsc |
| Disallow | /*/comments.a |
| Disallow | /*/reviews.a |
| Disallow | /*/reviews.ra |
| Disallow | /*/qans.stmp |
| Disallow | /*/qans.addq |
| Disallow | /*/qans.t0 |
| Disallow | /*/qans.r |
| Disallow | /*/qans.a |
| Disallow | /*/addscreens |
| Disallow | /*/dfile |
| Disallow | /*/dlfile |
| Disallow | /*/adload |
| Disallow | /*/tags |
| Disallow | /*/viewtags |
| Disallow | /*/buylink |
| Disallow | /*/collections/show. |
| Disallow | /lin/ |
| Disallow | /pda/ |
yandex
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /exports/ |
| Disallow | /imgs/core/captcha/ |
| Disallow | /gf/ |
| Disallow | /cgi-bin/ |
| Disallow | /*/clicklink |
| Disallow | /*/clicksite |
| Disallow | /*/commentsredir |
| Disallow | /*/postinfo |
| Disallow | /*/buy |
| Disallow | /*/ddl |
| Disallow | /*/informers |
| Disallow | /*/sf |
| Disallow | /*/ajax |
| Disallow | /*/subsc |
| Disallow | /*/comments.a |
| Disallow | /*/reviews.a |
| Disallow | /*/reviews.ra |
| Disallow | /*/qans.stmp |
| Disallow | /*/qans.addq |
| Disallow | /*/qans.t0 |
| Disallow | /*/qans.r |
| Disallow | /*/qans.a |
| Disallow | /*/addscreens |
| Disallow | /*/dfile |
| Disallow | /*/dlfile |
| Disallow | /*/adload |
| Disallow | /*/tags |
| Disallow | /*/viewtags |
| Disallow | /*/buylink |
| Disallow | /*/collections/show. |
| Disallow | /lin/ |
| Disallow | /pda/ |
Warnings
- 2 invalid lines.
- `clean-param` is not a known field.
Comments