ergul.com.tr
robots.txt
Robots Exclusion Standard data for ergul.com.tr
Resource Scan
Scan Details
| Site Domain | ergul.com.tr |
| Base Domain | ergul.com.tr |
| Scan Status | Ok |
| Last Scan | 2024-09-26T15:33:28+00:00 |
| Next Scan | 2024-10-26T15:33:28+00:00 |
Last Scan
| Scanned | 2024-09-26T15:33:28+00:00 |
| URL | https://ergul.com.tr/robots.txt |
| Domain IPs | 104.19.156.83, 104.19.157.83 |
| Response IP | 104.19.157.83 |
| Found | Yes |
| Hash | 049785dc129cb5ef306e9091c562cb7618702ed64b6825c8dd66ee33c9298550 |
| SimHash | d5445cb251b3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /uye-girisi |
| Disallow | /uye-girisi?next=order2 |
| Disallow | /uye-ol |
| Disallow | /uye-ol?next=order2 |
| Disallow | /sifremi-unuttum |
| Disallow | /sepet |
| Disallow | /hesabim |
| Disallow | /hesabim/* |
| Disallow | /dosya/ |
| Disallow | /admin/ |
| Disallow | /brand/listByCategory/categoryId/ |
| Disallow | /brand/listByCategory/categoryId/* |
| Disallow | /cart/ |
| Disallow | /cart/* |
| Disallow | /*index.php?do=catalog%2Fprint& |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.ergul.com.tr/sitemap.xml |
Warnings
- 2 invalid lines.
Comments