ntka.org
robots.txt
Robots Exclusion Standard data for ntka.org
Resource Scan
Scan Details
| Site Domain | ntka.org |
| Base Domain | ntka.org |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-08-28T09:12:33+00:00 |
| Next Scan | 2025-09-04T09:12:33+00:00 |
Last Successful Scan
| Scanned | 2025-08-20T08:28:30+00:00 |
| URL | https://ntka.org/robots.txt |
| Domain IPs | 2a06:41c0:1:4::13, 89.252.182.99 |
| Response IP | 89.252.182.99 |
| Found | Yes |
| Hash | 5243a81667f95a3833e0f07d55a974c80d5f8d8a4d5e4f320d0b351bcbdd6320 |
| SimHash | e9009b739730 |
Groups
googlebot
googlebot-image
googlebot-mobile
mediapartners-google
feedfetcher-google
google wireless transcoder
twitterbot
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /datas |
| Disallow | /system |
| Disallow | /hasan |
| Disallow | /message.php |
| Allow | /datas/resized |
| Allow | /datas/users |
| Allow | /datas/thumbs |
| Allow | /plugins/pagethumb/resim |
| Disallow | /plugins/gensitemap |
| Allow | /js |
| Allow | /images |
| Allow | /system/javascript |
Other Records
| Field | Value |
|---|---|
| sitemap | https://ntka.org/rss.php |
Warnings
- 1 invalid line.
- `host` is not a known field.
Comments