dp.informator.ua
robots.txt
Robots Exclusion Standard data for dp.informator.ua
Resource Scan
Scan Details
Site Domain | dp.informator.ua |
Base Domain | informator.ua |
Scan Status | Ok |
Last Scan | 2024-10-21T11:23:13+00:00 |
Next Scan | 2024-11-20T11:23:13+00:00 |
Last Scan
Scanned | 2024-10-21T11:23:13+00:00 |
URL | https://dp.informator.ua/robots.txt |
Domain IPs | 51.15.20.236, 51.195.190.221 |
Response IP | 51.15.20.236 |
Found | Yes |
Hash | b99696d25ccd641ae43225d19b38176a035a7d90c21ffb8baeaea33dcc4c750e |
SimHash | 481d83c2e61f |
Groups
*
Rule | Path |
---|---|
Allow | / |
Allow | *.jpg |
Allow | *.gif |
Allow | *.svg |
Allow | *.css |
Allow | *.png |
Allow | *.js |
Disallow | /cdn-cgi/ |
Disallow | /comments* |
Disallow | /search |
Disallow | /content/ |
Disallow | /profile/ |
Disallow | /redirect/ |
Disallow | */undefined |
Disallow | *utm_source%3D* |
Disallow | *utm_medium%3D* |
Disallow | *utm_campaign%3D* |
Disallow | /?url=* |
Disallow | /*_sm_byp |
Disallow | /*CFID%3D* |
Disallow | /div_location%3D |
Disallow | /*?refresh |
Disallow | /?quot |
Disallow | /?_ga |
Disallow | /m/?_ga |
googlebot
Rule | Path |
---|---|
Allow | /*.jpg |
Allow | /*.gif |
Allow | /*.svg |
Allow | /*.css |
Allow | /*.png |
Allow | /*.js |
Disallow | /comments* |
Disallow | /search |
Disallow | /profile/ |
yandex
Rule | Path |
---|---|
Allow | /*.jpg |
Allow | /*.gif |
Allow | /*.svg |
Allow | /*.css |
Allow | /*.png |
Allow | /*.js |
Disallow | /comments* |
Disallow | /search/ |
Disallow | /profile/ |