by.tutu.travel
robots.txt
Robots Exclusion Standard data for by.tutu.travel
Resource Scan
Scan Details
Site Domain | by.tutu.travel |
Base Domain | tutu.travel |
Scan Status | Ok |
Last Scan | 2024-06-08T04:18:23+00:00 |
Next Scan | 2024-06-22T04:18:23+00:00 |
Last Scan
Scanned | 2024-06-08T04:18:23+00:00 |
URL | https://by.tutu.travel/robots.txt |
Domain IPs | 178.248.234.61 |
Response IP | 178.248.234.61 |
Found | Yes |
Hash | d08de2e75f11430227f209a0f473c4ce9e771df62f6b7f3fb1c2e8e5ebd5d33a |
SimHash | 4000e6434f90 |
Groups
*
Rule | Path |
---|---|
Disallow | /*? |
Allow | /*.css? |
Allow | /*.js? |
Disallow | /bus/widget_constructor/ |
Disallow | /bus/rosbilet_notify/ |
Disallow | /bus/%D0%BD%D0%B8%D1%87%D0%B5%D0%B3%D0%BE_%D0%BD%D0%B5_%D0%BD%D0%B0%D0%B9%D0%B4%D0%B5%D0%BD%D0%BE/ |
Disallow | /*.csv? |
Warnings
- `host` is not a known field.