konsopahaber.com
robots.txt
Robots Exclusion Standard data for konsopahaber.com
Resource Scan
Scan Details
| Site Domain | konsopahaber.com |
| Base Domain | konsopahaber.com |
| Scan Status | Ok |
| Last Scan | 2025-04-16T06:45:19+00:00 |
| Next Scan | 2025-04-23T06:45:19+00:00 |
Last Scan
| Scanned | 2025-04-16T06:45:19+00:00 |
| URL | https://konsopahaber.com/robots.txt |
| Redirect | https://www.konsopahaber.com/robots.txt |
| Redirect Domain | www.konsopahaber.com |
| Redirect Base | konsopahaber.com |
| Domain IPs | 104.21.37.118, 172.67.207.215, 2606:4700:3030::ac43:cfd7, 2606:4700:3031::6815:2576 |
| Redirect IPs | 104.21.37.118, 172.67.207.215, 2606:4700:3030::ac43:cfd7, 2606:4700:3031::6815:2576 |
| Response IP | 172.67.207.215 |
| Found | Yes |
| Hash | 23a779ca1a50c3555a7da4209a95d4c9c8b85ab63e6ccfbecd30504add5a60e4 |
| SimHash | 421ec060a099 |
Groups
yandex
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 600 |
| crawl-delay | 600 |
awariorssbot
awariosmartbot
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1000 |
semrushbot
amazonbot
anthropicbot
claude
claudebot
gptbot
chatgpt-user
ccbot
chatgpt-user
gptbot
google-extended
anthropic-ai
omgilibot
omgili
diffbot
bytespider
imagesiftbot
cohere-ai
go-http-client
seekportbot
mj12bot
criteobot/0.1
barkrowler
blexbot
dotbot
dataforseobot
mediatoolkitbot
ahrefsbot
dotbot
| Rule | Path |
|---|---|
| Disallow | / |
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.konsopahaber.com/sitemap.xml |