sprzedawacz.pl
robots.txt

Robots Exclusion Standard data for sprzedawacz.pl

Resource Scan

Scan Details

Site Domain sprzedawacz.pl
Base Domain sprzedawacz.pl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-10T10:11:06+00:00
Next Scan 2024-11-17T10:11:06+00:00

Last Successful Scan

Scanned2024-11-02T10:10:53+00:00
URL https://sprzedawacz.pl/robots.txt
Domain IPs 104.26.4.201, 104.26.5.201, 172.67.75.55, 2606:4700:20::681a:4c9, 2606:4700:20::681a:5c9, 2606:4700:20::ac43:4b37
Response IP 104.26.5.201
Found Yes
Hash 589c6412428ac23caaf1c1c5b9e70d5299ebc77e809a6b653ff9c4eb7210443f
SimHash 651cccc2ea58

Groups

petalbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

amazonbot

Rule Path
Disallow /

*

Rule Path
Disallow /widget/
Disallow /aktywuj/
Disallow /podglad/
Disallow /moj/wiadomosci/pokaz*
Disallow /wyslij_aktywacje*
Disallow /edytuj*
Disallow /przedluz*
Disallow /przedluz_wszystkie*
Disallow /zakoncz*
Disallow /zmien_haslo*
Disallow /aktywuj_konto*
Disallow /ajax_daj_telefon*
Disallow /ajx_dodatkowe*
Disallow /fonts/open-sans*
Disallow /cdn-cgi/

Other Records

Field Value
sitemap https://sprzedawacz.pl/sitemap.xml