web100.kz
robots.txt
Robots Exclusion Standard data for web100.kz
Resource Scan
Scan Details
| Site Domain | web100.kz |
| Base Domain | web100.kz |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 4/30/2025, 7:10:10 PM |
| Next Scan | 5/30/2025, 7:10:10 PM |
Last Successful Scan
| Scanned | 3/9/2025, 3:56:41 PM |
| URL | https://web100.kz/robots.txt |
| Domain IPs | 104.21.37.202, 172.67.212.228, 2606:4700:3033::ac43:d4e4, 2606:4700:3035::6815:25ca |
| Response IP | 172.67.212.228 |
| Found | Yes |
| Hash | 3eb02f7dad693e14227ae7b7a7a34779810a5d952919b6af7302be13acd1ccd7 |
| SimHash | 4834ac72c716 |
Groups
*
| Rule | Path |
|---|---|
| Allow | *.js |
| Allow | *.ico |
| Allow | /wp-content/themes/*.jpg |
| Allow | /wp-content/themes/*.webp* |
| Allow | /wp-content/plugins/*.js |
| Allow | /wp-content/plugins/*.gif |
| Disallow | /wp-json/ |
| Disallow | /cgi-bin/* |
| Disallow | */trackback/ |
| Disallow | /? |
| Disallow | /*?* |
| Disallow | /*? |
| Disallow | */trackback |
| Disallow | */feed |
| Disallow | /category/*/* |