aydinhaberleri.com
robots.txt
Robots Exclusion Standard data for aydinhaberleri.com
Resource Scan
Scan Details
| Site Domain | aydinhaberleri.com |
| Base Domain | aydinhaberleri.com |
| Scan Status | Ok |
| Last Scan | 2024-11-19T13:36:32+00:00 |
| Next Scan | 2024-11-26T13:36:32+00:00 |
Last Scan
| Scanned | 2024-11-19T13:36:32+00:00 |
| URL | https://aydinhaberleri.com/robots.txt |
| Domain IPs | 104.21.17.175, 172.67.177.187, 2606:4700:3030::ac43:b1bb, 2606:4700:3032::6815:11af |
| Response IP | 104.21.17.175 |
| Found | Yes |
| Hash | 03b70b97083a4acd39c70abbadf93c9450f99477a10ecccb891f08f665fe1794 |
| SimHash | 69381423ae12 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /arama |
| Disallow | /public |
| Disallow | /public/* |
| Disallow | /service* |
| Disallow | /share* |
| Disallow | /tr/* |
| Disallow | /*?ref= |
| Disallow | /*?q= |
| Disallow | /*?preview= |
| Disallow | /*?utm_source= |
| Disallow | /*?page= |
| Disallow | /*?cursor= |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.aydinhaberleri.com/sitemap.xml |