spor.internethaber.com
robots.txt
Robots Exclusion Standard data for spor.internethaber.com
Resource Scan
Scan Details
Site Domain | spor.internethaber.com |
Base Domain | internethaber.com |
Scan Status | Ok |
Last Scan | 2024-09-16T07:14:04+00:00 |
Next Scan | 2024-09-23T07:14:04+00:00 |
Last Scan
Scanned | 2024-09-16T07:14:04+00:00 |
URL | http://spor.internethaber.com/robots.txt |
Redirect | https://www.internetspor.com/robots.txt |
Redirect Domain | www.internetspor.com |
Redirect Base | internetspor.com |
Domain IPs | 195.142.106.235 |
Redirect IPs | 104.21.0.188, 172.67.128.52, 2606:4700:3030::6815:bc, 2606:4700:3036::ac43:8034 |
Response IP | 172.67.128.52 |
Found | Yes |
Hash | d0710eeb3a02d3cd70a7e95e17f5f631e9d6afd473c289d1b5d6d4990d41525a |
SimHash | ad055c5c4951 |
Groups
*
Rule | Path |
---|---|
Disallow | /mays/* |
Disallow | /icerik-Her/* |
Disallow | /embed-medium/* |
Disallow | /author.php |
Disallow | /posts/* |
Disallow | /search_tag.php |
Disallow | /arama* |
Disallow | /video-embed/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.internetspor.com/export/sitemap |
sitemap | https://www.internetspor.com/export/newsmap |