kz.agentiz.com
robots.txt
Robots Exclusion Standard data for kz.agentiz.com
Resource Scan
Scan Details
| Site Domain | kz.agentiz.com |
| Base Domain | agentiz.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2025-05-10T16:58:38+00:00 |
| Next Scan | 2025-06-09T16:58:38+00:00 |
Last Successful Scan
| Scanned | 2025-04-04T14:53:43+00:00 |
| URL | https://kz.agentiz.com/robots.txt |
| Redirect | https://agentiz.kz/robots.txt |
| Redirect Domain | agentiz.kz |
| Redirect Base | agentiz.kz |
| Domain IPs | 104.21.23.178, 172.67.212.117, 2606:4700:3034::ac43:d475, 2606:4700:3036::6815:17b2 |
| Redirect IPs | 104.21.27.135, 172.67.142.187, 2606:4700:3033::6815:1b87, 2606:4700:3037::ac43:8ebb |
| Response IP | 104.21.27.135 |
| Found | Yes |
| Hash | e8f8f5ab1b646c79def01da54fc611a768d7bd0bc93f063c3e3ce161d76e777d |
| SimHash | 6c75134351d3 |
Groups
adsbot-google
adsbot-msn
ahrefsbot
ahrefssiteaudit
agentizbot
applebot
bingbot
bingpreview
chatgptbot
claudebot
cloudflareobservatory
duckassist
duckduckbot
ecosiabot
facebookcatalog
facebookexternalhit
feedfetcher-google
flipboardproxy
google-adwords-express
google-api-java-client
google-imageproxy
google-read-aloud
google-site-verification
googlebot
googlebot-image
googleother
gptbot
ia_archiver
linkedinbot
mediapartners-google
meta-externalfetcher
msnbot
naverbot
oai-searchbot
perplexitybot
pinterestbot
seznambot
slurp
structured-data-testing-tool
telegrambot
twitterbot
uptimerobot
| Rule | Path |
|---|---|
| Disallow | /*-xs.jpg$ |
| Disallow | /*-xxs.jpg$ |
| Disallow | /*-xxxs.jpg$ |
| Disallow | /*-xs.webp$ |
| Disallow | /*-xxs.webp$ |
| Disallow | /*-xxxs.webp$ |
| Disallow | /*/?type=* |
| Disallow | /*/assets |
| Disallow | /*/policies |
| Disallow | /*/redirect |
*
| Rule | Path |
|---|---|
| Disallow | / |
Warnings
- `host` is not a known field.
Comments