podborki.com
robots.txt
Robots Exclusion Standard data for podborki.com
Resource Scan
Scan Details
Site Domain | podborki.com |
Base Domain | podborki.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-07-01T01:15:06+00:00 |
Next Scan | 2025-09-29T01:15:06+00:00 |
Last Successful Scan
Scanned | 2023-06-07T21:29:27+00:00 |
URL | https://podborki.com/robots.txt |
Domain IPs | 104.21.18.9, 172.67.179.33, 2606:4700:3035::6815:1209, 2606:4700:3036::ac43:b321 |
Response IP | 104.21.18.9 |
Found | Yes |
Hash | d5d6df17122cfa0924bd30add7379c9f217365080447093541224d39b5d6e9bb |
SimHash | 4d15fdc42f81 |
Groups
*
Rule | Path |
---|---|
Disallow | /users/me |
Disallow | /votes |
Disallow | /ratings |
Disallow | /bookmarks |
Disallow | /reports |
Disallow | /subscriptions |
Disallow | /search |
Disallow | /images/cache |
Disallow | /admin |
Disallow | /mix_recommendations |
Disallow | /banners |
Disallow | /go/ |
Disallow | /go_url/ |
Disallow | /weeks/feature_this_week |
Disallow | /weeks/unfeature_this_week |
Disallow | /mixes_for_item_addition |
Disallow | /mixes_for_item_addition |
Disallow | /uploads/fittrail |