medyagazete.com
robots.txt
Robots Exclusion Standard data for medyagazete.com
Resource Scan
Scan Details
Site Domain | medyagazete.com |
Base Domain | medyagazete.com |
Scan Status | Ok |
Last Scan | 2024-11-09T08:55:49+00:00 |
Next Scan | 2024-11-16T08:55:49+00:00 |
Last Scan
Scanned | 2024-11-09T08:55:49+00:00 |
URL | https://medyagazete.com/robots.txt |
Redirect | https://www.medyagazete.com/robots.txt |
Redirect Domain | www.medyagazete.com |
Redirect Base | medyagazete.com |
Domain IPs | 104.21.51.95, 172.67.178.31, 2606:4700:3033::ac43:b21f, 2606:4700:3035::6815:335f |
Redirect IPs | 104.21.51.95, 172.67.178.31, 2606:4700:3033::ac43:b21f, 2606:4700:3035::6815:335f |
Response IP | 104.21.51.95 |
Found | Yes |
Hash | 1a4e1c18fcc1299622601b1193d1cfd3ec332204179a57b20c723090b0713755 |
SimHash | 5602f220e372 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /ara |
Disallow | /ara?q=* |
Disallow | /etiketler/* |
Disallow | /haber-gonder |
Disallow | /firma-ekle |
Disallow | /ilan-ekle |
Disallow | /sitene-ekle |
Disallow | /arsiv* |
Disallow | /?utm_source= |
Disallow | /panel |
Disallow | /panel/* |
Disallow | /login |
Disallow | /public/* |
Disallow | /vendor/* |
Disallow | /git/* |
Disallow | /tests/* |