busfor.pl
robots.txt

Robots Exclusion Standard data for busfor.pl

Resource Scan

Scan Details

Site Domain busfor.pl
Base Domain busfor.pl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-26T15:29:23+00:00
Next Scan 2026-02-09T15:29:23+00:00

Last Successful Scan

Scanned2025-10-24T13:34:42+00:00
URL https://busfor.pl/robots.txt
Domain IPs 34.54.126.198
Response IP 34.54.126.198
Found Yes
Hash bac2537cb6db1c2e2ae5c4d7c904d936cfb9b834f6eb4edcf730fa77c2884495
SimHash 2a80c8528d95

Groups

*

Rule Path
Disallow */buy
Disallow */search
Disallow */checkout
Disallow */polls
Disallow */blog/load_more
Disallow */pdf
Disallow */new/noindex_scripts/
Allow /pl/affiliate-program
Allow /en/affiliate-program
Disallow /pl/affiliate-program/*
Disallow /en/affiliate-program/*
Disallow */authorization/new
Disallow /go?to=

yandex

Rule Path
Disallow */buy
Disallow */search
Disallow */checkout
Disallow */polls
Disallow */blog/load_more
Disallow */pdf
Disallow */new/noindex_scripts/
Allow /pl/affiliate-program
Allow /en/affiliate-program
Disallow /pl/affiliate-program/*
Disallow /en/affiliate-program/*
Disallow */authorization/new
Disallow /go?to=
Disallow /*/amp