birgazete.com
robots.txt
Robots Exclusion Standard data for birgazete.com
Resource Scan
Scan Details
| Site Domain | birgazete.com |
| Base Domain | birgazete.com |
| Scan Status | Ok |
| Last Scan | 2024-11-13T03:51:18+00:00 |
| Next Scan | 2024-11-20T03:51:18+00:00 |
Last Scan
| Scanned | 2024-11-13T03:51:18+00:00 |
| URL | https://birgazete.com/robots.txt |
| Domain IPs | 104.247.167.211, 2a06:41c0:1:4::5 |
| Response IP | 104.247.167.211 |
| Found | Yes |
| Hash | 5e0b5fbcd33dda4bfdb427c3226195fc3cfd9e486c3c5217880da77e520393c5 |
| SimHash | 680098322fd3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /*?p= |
| Disallow | *?amp |
| Disallow | *api/Stats* |
| Disallow | */haber-detay/* |
| Disallow | */ara?q= |
| Disallow | */*?* |
| Disallow | */*%3D* |
| Disallow | /next/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.birgazete.com/sitemap-news.xml |
| sitemap | https://www.birgazete.com/sitemap-mobile.xml |
| sitemap | https://www.birgazete.com/sitemap_index.xml |
| sitemap | https://www.birgazete.com/sitemap.xml |
| sitemap | https://www.birgazete.com/kategori/gundem/feed |
| sitemap | https://www.birgazete.com/kategori/siyaset/feed |
| sitemap | https://www.birgazete.com/kategori/dunya/feed |