istikbal.com.tr
robots.txt
Robots Exclusion Standard data for istikbal.com.tr
Resource Scan
Scan Details
Site Domain | istikbal.com.tr |
Base Domain | istikbal.com.tr |
Scan Status | Ok |
Last Scan | 2024-09-29T23:57:44+00:00 |
Next Scan | 2024-10-29T23:57:44+00:00 |
Last Scan
Scanned | 2024-09-29T23:57:44+00:00 |
URL | https://istikbal.com.tr/robots.txt |
Domain IPs | 104.16.0.42, 104.16.31.41 |
Response IP | 104.16.31.41 |
Found | Yes |
Hash | bd8dbed1b9cbca7dfa3a8f2b8ace38885390b37d8324353ca350977f672a6d85 |
SimHash | d55c3e92d493 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /uye-girisi |
Disallow | /uye-girisi?next=order2 |
Disallow | /uye-ol |
Disallow | /uye-ol?next=order2 |
Disallow | /sifremi-unuttum |
Disallow | /sepet |
Disallow | /hesabim |
Disallow | /hesabim/* |
Disallow | /dosya/ |
Disallow | /admin/ |
Disallow | /brand/listByCategory/categoryId/ |
Disallow | /brand/listByCategory/categoryId/* |
Disallow | /cart/ |
Disallow | /cart/* |
Disallow | /*index.php?do=catalog%2Fprint& |
Disallow | /*?varyantlar=* |
Disallow | /*?category=* |
Disallow | /*?siralama=* |
Disallow | /*?filtre_secenekleri=* |
Disallow | /*?stoktakiler=* |
Disallow | /*?ozellikler=* |
Disallow | /arama/ |
Disallow | /search/ |
Disallow | /en/* |
Disallow | /fr/* |
Disallow | /product/ |
Disallow | /category/ |
Disallow | /*?marka=* |
Disallow | /en* |
Disallow | /fr* |
Disallow | /dosya/kumas.html |
Other Records
Field | Value |
---|---|
crawl-delay | 20 |
Other Records
Field | Value |
---|---|
sitemap | https://www.istikbal.com.tr/sitemap.xml |
Warnings
- 2 invalid lines.
Comments