bel-pol.pl
robots.txt

Robots Exclusion Standard data for bel-pol.pl

Resource Scan

Scan Details

Site Domain bel-pol.pl
Base Domain bel-pol.pl
Scan Status Ok
Last Scan2024-05-23T12:41:53+00:00
Next Scan 2024-06-22T12:41:53+00:00

Last Scan

Scanned2024-05-23T12:41:53+00:00
URL https://bel-pol.pl/robots.txt
Domain IPs 104.26.2.187, 104.26.3.187, 172.67.73.199, 2606:4700:20::681a:2bb, 2606:4700:20::681a:3bb, 2606:4700:20::ac43:49c7
Response IP 104.26.2.187
Found Yes
Hash 79e51760ace81cc01e488956ef90e31eb399362afe4621528ad6d62968644e99
SimHash ed90ca02c813

Groups

*

Rule Path
Disallow /login_page
Disallow /logout
Disallow /login
Disallow /account
Disallow /set_locale
Disallow /cart
Disallow /sso

surveybot

Rule Path
Disallow /

websitewiki

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

jakarta commons-httpclient

Rule Path
Disallow /

aboutusbot

Rule Path
Disallow /

semager

Rule Path
Disallow /