bolgegundem.com
robots.txt
Robots Exclusion Standard data for bolgegundem.com
Resource Scan
Scan Details
| Site Domain | bolgegundem.com |
| Base Domain | bolgegundem.com |
| Scan Status | Ok |
| Last Scan | 2024-05-03T22:11:07+00:00 |
| Next Scan | 2024-05-10T22:11:07+00:00 |
Last Scan
| Scanned | 2024-05-03T22:11:07+00:00 |
| URL | https://bolgegundem.com/robots.txt |
| Redirect | https://www.bolgegundem.com.tr/robots.txt |
| Redirect Domain | www.bolgegundem.com.tr |
| Redirect Base | bolgegundem.com.tr |
| Domain IPs | 104.21.235.179, 104.21.235.180, 2606:4700:3038::6815:ebb3, 2606:4700:3038::6815:ebb4 |
| Redirect IPs | 104.21.89.223, 172.67.148.155, 2606:4700:3030::ac43:949b, 2606:4700:3035::6815:59df |
| Response IP | 172.67.148.155 |
| Found | Yes |
| Hash | 7282a194322e7207f1cc381e254bc6a83bf021e4a004bdb1689d7b128560f487 |
| SimHash | cd000030e175 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /*.php$ |
| Disallow | /*.php? |
| Disallow | /service/webmaster/ |
| Disallow | /sitene-ekle.htm |
| Disallow | |
| Disallow | /*.docx |
| Disallow | /*.doc |
| Disallow | /*.csv |
| Disallow | /*.xlsx |
| Disallow | /*.xls |
| Disallow | /egazete/ |
| Allow | /service/rss_firm.php |
| Allow | /contact.php |
| Allow | /service/sitemap_google_news.php |
| Allow | /referandum/lib/sitemap.php |
| Allow | /service/rss.php |
| Allow | /rss.php |
| Allow | /secim/14-mayis-2023/sitemap.php |
| Allow | /secim/28-mayis-2023/sitemap.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bolgegundem.com.tr/sitemap-google-news |