haber24.com
robots.txt
Robots Exclusion Standard data for haber24.com
Resource Scan
Scan Details
Site Domain | haber24.com |
Base Domain | haber24.com |
Scan Status | Ok |
Last Scan | 2024-05-03T18:29:26+00:00 |
Next Scan | 2024-05-10T18:29:26+00:00 |
Last Scan
Scanned | 2024-05-03T18:29:26+00:00 |
URL | https://haber24.com/robots.txt |
Redirect | https://www.haber24.com/robots.txt |
Redirect Domain | www.haber24.com |
Redirect Base | haber24.com |
Domain IPs | 104.21.40.197, 172.67.188.71, 2606:4700:3033::6815:28c5, 2606:4700:3033::ac43:bc47 |
Redirect IPs | 104.21.40.197, 172.67.188.71, 2606:4700:3033::6815:28c5, 2606:4700:3033::ac43:bc47 |
Response IP | 172.67.188.71 |
Found | Yes |
Hash | 52f7572247037da9b0e33f418a263daef06698a11e014cc57b67a454e55ab008 |
SimHash | aa283e27dc32 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /public |
Disallow | /public/* |
Disallow | /public/index.php |
Disallow | /public/index.php/* |
Disallow | /tebilisim |
Disallow | /service* |
Disallow | /share* |
Disallow | /tr/* |
Disallow | /*?ref= |
Disallow | /*?q= |
Disallow | /*?preview= |
Disallow | /*?utm_source= |
Disallow | /*?ref= |
Disallow | /*?page= |
Disallow | /xpanel |
Disallow | /xpanel/* |
Disallow | /tebilisim |
Disallow | /vidyome |
Other Records
Field | Value |
---|---|
sitemap | https://www.haber24.com/sitemap.xml |