yildirimgazetesi.com
robots.txt
Robots Exclusion Standard data for yildirimgazetesi.com
Resource Scan
Scan Details
| Site Domain | yildirimgazetesi.com |
| Base Domain | yildirimgazetesi.com |
| Scan Status | Ok |
| Last Scan | 2024-11-14T18:58:42+00:00 |
| Next Scan | 2024-11-21T18:58:42+00:00 |
Last Scan
| Scanned | 2024-11-14T18:58:42+00:00 |
| URL | https://yildirimgazetesi.com/robots.txt |
| Redirect | https://www.yildirimgazetesi.com/robots.txt |
| Redirect Domain | www.yildirimgazetesi.com |
| Redirect Base | yildirimgazetesi.com |
| Domain IPs | 104.21.17.245, 172.67.178.227, 2606:4700:3031::6815:11f5, 2606:4700:3037::ac43:b2e3 |
| Redirect IPs | 104.21.17.245, 172.67.178.227, 2606:4700:3031::6815:11f5, 2606:4700:3037::ac43:b2e3 |
| Response IP | 104.21.17.245 |
| Found | Yes |
| Hash | 01206a555e4ede0b36c044616441f8ee20dbf4c51d08cbac7f18b56d4f2cb9e5 |
| SimHash | a1081632ee13 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /arama |
| Disallow | /public |
| Disallow | /public/* |
| Disallow | /service* |
| Disallow | /share* |
| Disallow | /tr/* |
| Disallow | /*?ref= |
| Disallow | /*?q= |
| Disallow | /*?preview= |
| Disallow | /*?utm_source= |
| Disallow | /*?page= |
| Disallow | /*?cursor= |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.yildirimgazetesi.com/sitemap.xml |