bobovita.pl
robots.txt

Robots Exclusion Standard data for bobovita.pl

Resource Scan

Scan Details

Site Domain bobovita.pl
Base Domain bobovita.pl
Scan Status Ok
Last Scan2024-10-22T09:50:24+00:00
Next Scan 2024-11-21T09:50:24+00:00

Last Scan

Scanned2024-10-22T09:50:24+00:00
URL https://bobovita.pl/robots.txt
Redirect https://www.bobovita.pl/robots.txt
Redirect Domain www.bobovita.pl
Redirect Base bobovita.pl
Domain IPs 104.21.3.146, 172.67.130.211, 2606:4700:3030::6815:392, 2606:4700:3034::ac43:82d3
Redirect IPs 18.155.68.32, 18.155.68.45, 18.155.68.5, 18.155.68.88, 2600:9000:23d2:2a00:1f:4fbb:6bc0:93a1, 2600:9000:23d2:3000:1f:4fbb:6bc0:93a1, 2600:9000:23d2:3a00:1f:4fbb:6bc0:93a1, 2600:9000:23d2:4400:1f:4fbb:6bc0:93a1, 2600:9000:23d2:5e00:1f:4fbb:6bc0:93a1, 2600:9000:23d2:7800:1f:4fbb:6bc0:93a1, 2600:9000:23d2:d000:1f:4fbb:6bc0:93a1, 2600:9000:23d2:fa00:1f:4fbb:6bc0:93a1
Response IP 18.155.68.32
Found Yes
Hash 46922a7cf2c862d91de81b610d837a15a8cf21340663280a3278f9eef9f6f711
SimHash 4318df740b13

Groups

*
yandexbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

baiduspider

Rule Path
Allow /
Allow /
Disallow /uploads
Disallow /ajax
Disallow /aplikacja-mobilna
Disallow /klub-bobovita/konkursy/konkurs-zdjecie-miesiaca/zdjecie/
Disallow /rejestracja
Disallow /logowanie
Disallow /reset-hasla
Disallow /regulaminy-polityka-prywatnosci
Disallow /regulaminy-nota-prawna
Disallow /regulaminy-regulamin-serwisu
Disallow /regulaminy-porady-eksperta
Disallow /regulaminy-konkurs-zdjecie-miesiaca
Disallow /api

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.bobovita.pl/sitemap.xml