demodit.com
robots.txt
Robots Exclusion Standard data for demodit.com
Resource Scan
Scan Details
| Site Domain | demodit.com |
| Base Domain | demodit.com |
| Scan Status | Ok |
| Last Scan | 2024-11-09T14:34:45+00:00 |
| Next Scan | 2024-11-16T14:34:45+00:00 |
Last Scan
| Scanned | 2024-11-09T14:34:45+00:00 |
| URL | https://demodit.com/robots.txt |
| Redirect | https://www.demodit.com/robots.txt |
| Redirect Domain | www.demodit.com |
| Redirect Base | demodit.com |
| Domain IPs | 80.74.142.110 |
| Redirect IPs | 80.74.142.110 |
| Response IP | 80.74.142.110 |
| Found | Yes |
| Hash | dd82dfdfe4461d51afed4d19a1dfa3b3cffdbf5fe1cc796eb7ce3e67f5fbd6c6 |
| SimHash | b65657e57df1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*.zip$ |
| Disallow | /bpde/ |
| Disallow | /bpdeu/ |
| Disallow | /bpen/ |
| Disallow | /bpfourm/ |
| Disallow | /bpppen/ |
| Disallow | /cpde/ |
| Disallow | /cpen/ |
| Disallow | /cpforum/ |
| Disallow | /css/ |
| Disallow | /cw/ |
| Disallow | /ftp/ |
| Disallow | /gpde/ |
| Disallow | /gpen/ |
| Disallow | /idde/ |
| Disallow | /iden/ |
| Disallow | /instde/ |
| Disallow | /insten/ |
| Disallow | /log/ |
| Disallow | /bpde/ |
| Disallow | /memde/ |
| Disallow | /memen/ |
| Disallow | /php/ |
| Disallow | /press/ |
| Disallow | /ssde/ |
| Disallow | /ssen/ |
| Disallow | /tit/ |
| Disallow | /tk/ |
| Disallow | /tof/ |
| Disallow | /fof_source/ |
| Disallow | /usa/ |
| Disallow | /user/ |