normalsozluk.com
robots.txt
Robots Exclusion Standard data for normalsozluk.com
Resource Scan
Scan Details
| Site Domain | normalsozluk.com |
| Base Domain | normalsozluk.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-07-28T22:22:38+00:00 |
| Next Scan | 2024-10-26T22:22:38+00:00 |
Last Successful Scan
| Scanned | 2024-03-31T22:20:45+00:00 |
| URL | https://normalsozluk.com/robots.txt |
| Domain IPs | 104.26.0.42, 104.26.1.42, 172.67.68.209, 2606:4700:20::681a:12a, 2606:4700:20::681a:2a, 2606:4700:20::ac43:44d1 |
| Response IP | 104.26.0.42 |
| Found | Yes |
| Hash | 2d721006cf1f52a8ea3e32bdf69ae8ed3a2b5ddcc373bb7ad8f17d6fa343b5bd |
| SimHash | c004bfd36126 |
Groups
microsoft url control
baiduspider
baiduspider
baiduspider+
baiduspider-video
baiduspider-image
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /image |
| Disallow | /basliklar/takip-yazar* |
| Disallow | /basliklar/takip-baslik* |
| Disallow | /basliklar/ara* |
| Disallow | /stats/authorlist/* |
| Disallow | /stats/entries/* |
| Disallow | /author/entries/* |
| Disallow | /yazar/*/tanimlar* |
| Disallow | /yazar/*/basliklar* |
| Disallow | /yazar/*/info* |
| Disallow | /yazar/*/ukde |
| Disallow | /cdn-cgi/* |
| Disallow | /entry/loadfull |
| Disallow | /entry/* |
| Disallow | /baslik/* |
| Disallow | /portakal |
| Disallow | /messages* |
| Disallow | /external* |
| Disallow | /*?yorumlar=1 |
| Disallow | /*?goster=* |
| Allow | /yazar/*/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://normalsozluk.com/sitemap-yeni.xml |