m.turkiyegazetesi.com.tr
robots.txt
Robots Exclusion Standard data for m.turkiyegazetesi.com.tr
Resource Scan
Scan Details
Site Domain | m.turkiyegazetesi.com.tr |
Base Domain | turkiyegazetesi.com.tr |
Scan Status | Ok |
Last Scan | 2024-04-19T14:02:06+00:00 |
Next Scan | 2024-05-19T14:02:06+00:00 |
Last Scan
Scanned | 2024-04-19T14:02:06+00:00 |
URL | https://m.turkiyegazetesi.com.tr/robots.txt |
Redirect | https://www.turkiyegazetesi.com.tr/robots.txt |
Redirect Domain | www.turkiyegazetesi.com.tr |
Redirect Base | turkiyegazetesi.com.tr |
Domain IPs | 85.95.244.179 |
Redirect IPs | 190.2.150.114, 2.59.169.31, 80.79.4.140, 80.79.5.199 |
Response IP | 195.181.166.177 |
Found | Yes |
Hash | 34f43b8f5d4e016b4f5f6ab32cd80399ad9f05111fbef7b327c0dece850ff2d0 |
SimHash | 49091630d8b6 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /item/ |
Disallow | /?is_ajax* |
Disallow | /?response_type* |
Disallow | /embed/ |
Disallow | /images/widget/ |
Disallow | /api/ |
Disallow | /son-dakika/* |
Disallow | /arama-sonuc* |
Disallow | *-videolari/* |
Disallow | /fotogaleri/* |
Disallow | /assets/ |
Disallow | /takim/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.turkiyegazetesi.com.tr/sitemap/google-news-sitemap |