dawlance.com.pk
robots.txt
Robots Exclusion Standard data for dawlance.com.pk
Resource Scan
Scan Details
Site Domain | dawlance.com.pk |
Base Domain | dawlance.com.pk |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-07-22T23:52:53+00:00 |
Next Scan | 2024-10-20T23:52:53+00:00 |
Last Successful Scan
Scanned | 2024-03-02T22:49:59+00:00 |
URL | https://www.dawlance.com.pk/robots.txt |
Domain IPs | 23.59.168.163, 2600:1413:b000:1b::17d7:714, 2600:1413:b000:1b::17d7:718 |
Response IP | 23.52.171.224 |
Found | Yes |
Hash | fa395da90d0f501e14c15ec4dedb1ab06ad0c5ae9b806c68286415f1715e9566 |
SimHash | 4031fe5008aa |
Groups
*
Rule | Path |
---|---|
Disallow | /login* |
Disallow | /login-processing* |
Disallow | /social-processing* |
Disallow | /ws/v2* |
Disallow | /guest* |
Disallow | /sifremi-unuttum* |
Disallow | /restore-password* |
Disallow | /users* |
Disallow | /static* |
Disallow | /hesabim* |
Disallow | /my-account* |
Disallow | /registration* |
Disallow | /checkout* |
Disallow | /security* |
Disallow | /promotions* |
Disallow | /my-addresses* |
Disallow | /adreslerim* |
Disallow | /logout* |
Disallow | /urunlerim* |
Disallow | /my-account/products* |
Disallow | /siparislerim* |
Disallow | /my-account/orders* |
Disallow | /my-account/notifications* |
Disallow | /my-account/favourites* |
Disallow | /myStockReminderPage* |
Disallow | /my-account/coupons* |
Disallow | /coupons* |
Disallow | /my-account/my-profile* |
Disallow | /my-profile* |
Disallow | /password/forgot-password* |
Disallow | /bilgilerim* |
Disallow | /favorilerim* |
Disallow | /arama?query* |
Disallow | /search/?text* |
Disallow | /etc/clientlibs/foundation/testandtarget* |
Disallow | /404 |
Disallow | */?opf=* |
Disallow | */?opr=* |
Disallow | */?oid2=* |
Disallow | /search?text |
Disallow | *variant* |
Other Records
Field | Value |
---|---|
sitemap | https://www.dawlance.com.pk/sitemap.xml |
Warnings
- 3 invalid lines.