ciddihaber.com.tr
robots.txt
Robots Exclusion Standard data for ciddihaber.com.tr
Resource Scan
Scan Details
Site Domain | ciddihaber.com.tr |
Base Domain | ciddihaber.com.tr |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-10-24T21:34:11+00:00 |
Next Scan | 2025-01-22T21:34:11+00:00 |
Last Successful Scan
Scanned | 2024-03-29T20:36:30+00:00 |
URL | https://ciddihaber.com.tr/robots.txt |
Redirect | https://www.ciddihaber.com.tr/robots.txt |
Redirect Domain | www.ciddihaber.com.tr |
Redirect Base | ciddihaber.com.tr |
Domain IPs | 185.135.222.13 |
Redirect IPs | 185.135.222.13 |
Response IP | 185.135.222.13 |
Found | Yes |
Hash | 2b87958af8889caf6045cf64ccfdca5fee1755ec09f9cfb4c098629f321c35db |
SimHash | 8b08dd938723 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /haberleri |
Disallow | /videolari |
Disallow | /*.html |
Disallow | /images |
Other Records
Field | Value |
---|---|
sitemap | https://www.ciddihaber.com.tr/sitemap.xsd |