tdp.com.ua
robots.txt
Robots Exclusion Standard data for tdp.com.ua
Resource Scan
Scan Details
| Site Domain | tdp.com.ua |
| Base Domain | tdp.com.ua |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't establish SSL connection. |
| Last Scan | 2024-09-07T06:58:59+00:00 |
| Next Scan | 2024-12-06T06:58:59+00:00 |
Last Successful Scan
| Scanned | 2023-04-17T12:02:29+00:00 |
| URL | https://tdp.com.ua/robots.txt |
| Domain IPs | 91.210.190.230 |
| Response IP | 91.210.190.230 |
| Found | Yes |
| Hash | 1309b349302629b97e3ad96f478a581204804b9b4946e14bb72533fb9708c57f |
| SimHash | 4fa2dc945e33 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*utm_ |
| Disallow | /*gclid%3D |
| Disallow | */register/reminder.html |
| Disallow | */order%3Acheap/ |
| Disallow | */order%3Aexpansiv/ |
| Disallow | */order%3Apopularity/ |
| Disallow | */order%3Alast/ |
| Disallow | */user/ |
| Disallow | /*filter%3A |
| Disallow | /*search%3D |
| Disallow | /*price%3A |
| Disallow | /*order%3A |
| Disallow | */comparison/ |
| Disallow | /*?s= |
| Disallow | /*%26s%3D |
| Disallow | */order/ |
| Disallow | */admin/ |
| Disallow | */library |
| Disallow | */search/ |
| Disallow | */modules/ |
| Disallow | */application/ |
| Disallow | */order/ |
| Disallow | */checkout.html |
| Disallow | /*status%3D |
| Disallow | */finish.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 40 |
googlebot
| Rule | Path |
|---|---|
| Disallow | /*utm_ |
| Disallow | /*gclid%3D |
| Disallow | */register/reminder.html |
| Disallow | */order%3Acheap/ |
| Disallow | */order%3Aexpansiv/ |
| Disallow | */order%3Apopularity/ |
| Disallow | */order%3Alast/ |
| Disallow | */user/ |
| Disallow | /*filter%3A |
| Disallow | /*search%3D |
| Disallow | /*price%3A |
| Disallow | /*order%3A |
| Disallow | */comparison/ |
| Disallow | /*?s= |
| Disallow | /*%26s%3D |
| Disallow | */order/ |
| Disallow | */admin/ |
| Disallow | */library |
| Disallow | */search/ |
| Disallow | */modules/ |
| Disallow | */application/ |
| Disallow | */order/ |
| Disallow | */checkout.html |
| Disallow | /*status%3D |
| Disallow | */finish.html |
yandex
| Rule | Path |
|---|---|
| Disallow | /*utm_ |
| Disallow | /*gclid%3D |
| Disallow | */register/reminder.html |
| Disallow | */order%3Acheap/ |
| Disallow | */order%3Aexpansiv/ |
| Disallow | */order%3Apopularity/ |
| Disallow | */order%3Alast/ |
| Disallow | */user/ |
| Disallow | /*filter%3A |
| Disallow | /*search%3D |
| Disallow | /*price%3A |
| Disallow | /*order%3A |
| Disallow | */comparison/ |
| Disallow | /*?s= |
| Disallow | /*%26s%3D |
| Disallow | */order/ |
| Disallow | */admin/ |
| Disallow | */library |
| Disallow | */search/ |
| Disallow | */modules/ |
| Disallow | */application/ |
| Disallow | */order/ |
| Disallow | */checkout.html |
| Disallow | /*status%3D |
| Disallow | */finish.html |
ahrefsbot
deepcrawl
codewisebot
uptimerobot
yandexbot
yandex
mozilla/4.0 (compatible; naverbot/1.0; http://help.naver.com/customer_webtxt_02.jsp)
mozilla/5.0 (compatible; yandexblogs/0.99; robot; b; +http://yandex.com/bots)
mozilla/5.0 (compatible; yandexbot/3.0; +http://yandex.com/bots)
mozilla/5.0 (compatible; yandexbot/3.0; mirrordetector; +http://yandex.com/bots)
mozilla/5.0 (compatible; yandexmedia/3.0; +http://yandex.com/bots)
yandex*
yandexsomething/1.0
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://tdp.com.ua/sitemap.xml |
Warnings
- `host` is not a known field.