websterz.net
robots.txt
Robots Exclusion Standard data for websterz.net
Resource Scan
Scan Details
| Site Domain | websterz.net |
| Base Domain | websterz.net |
| Scan Status | Ok |
| Last Scan | 2025-05-31T16:27:04+00:00 |
| Next Scan | 2025-06-30T16:27:04+00:00 |
Last Scan
| Scanned | 2025-05-31T16:27:04+00:00 |
| URL | https://websterz.net/robots.txt |
| Domain IPs | 104.21.25.154, 172.67.134.88, 2606:4700:3034::6815:199a, 2606:4700:3037::ac43:8658 |
| Response IP | 104.21.25.154 |
| Found | Yes |
| Hash | 935efb9e3276f377801726c4f0db986dcd376480639ba4023ade823897dc7642 |
| SimHash | a974c55043ec |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /components/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /media/ |
| Disallow | /modules/ |
| Disallow | /plugins/ |
| Disallow | /templates/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Disallow | /clients/ |
| Disallow | /clients |
| Disallow | /due |
| Disallow | /due/ |