podborki.com
robots.txt

Robots Exclusion Standard data for podborki.com

Resource Scan

Scan Details

Site Domain podborki.com
Base Domain podborki.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-07-01T01:15:06+00:00
Next Scan 2025-09-29T01:15:06+00:00

Last Successful Scan

Scanned2023-06-07T21:29:27+00:00
URL https://podborki.com/robots.txt
Domain IPs 104.21.18.9, 172.67.179.33, 2606:4700:3035::6815:1209, 2606:4700:3036::ac43:b321
Response IP 104.21.18.9
Found Yes
Hash d5d6df17122cfa0924bd30add7379c9f217365080447093541224d39b5d6e9bb
SimHash 4d15fdc42f81

Groups

*

Rule Path
Disallow /users/me
Disallow /votes
Disallow /ratings
Disallow /bookmarks
Disallow /reports
Disallow /subscriptions
Disallow /search
Disallow /images/cache
Disallow /admin
Disallow /mix_recommendations
Disallow /banners
Disallow /go/
Disallow /go_url/
Disallow /weeks/feature_this_week
Disallow /weeks/unfeature_this_week
Disallow /mixes_for_item_addition
Disallow /mixes_for_item_addition
Disallow /uploads/fittrail