bobovita.pl
robots.txt

Robots Exclusion Standard data for bobovita.pl

Resource Scan

Scan Details

Site Domain bobovita.pl
Base Domain bobovita.pl
Scan Status Ok
Last Scan2024-05-24T06:03:23+00:00
Next Scan 2024-06-23T06:03:23+00:00

Last Scan

Scanned2024-05-24T06:03:23+00:00
URL https://bobovita.pl/robots.txt
Redirect https://www.bobovita.pl/robots.txt
Redirect Domain www.bobovita.pl
Redirect Base bobovita.pl
Domain IPs 104.21.3.146, 172.67.130.211, 2606:4700:3030::6815:392, 2606:4700:3034::ac43:82d3
Redirect IPs 13.35.18.27, 13.35.18.39, 13.35.18.46, 13.35.18.9, 2600:9000:20c7:6600:1f:4fbb:6bc0:93a1, 2600:9000:20c7:8000:1f:4fbb:6bc0:93a1, 2600:9000:20c7:8200:1f:4fbb:6bc0:93a1, 2600:9000:20c7:9200:1f:4fbb:6bc0:93a1, 2600:9000:20c7:ae00:1f:4fbb:6bc0:93a1, 2600:9000:20c7:c400:1f:4fbb:6bc0:93a1, 2600:9000:20c7:f000:1f:4fbb:6bc0:93a1, 2600:9000:20c7:f400:1f:4fbb:6bc0:93a1
Response IP 13.35.18.27
Found Yes
Hash 46922a7cf2c862d91de81b610d837a15a8cf21340663280a3278f9eef9f6f711
SimHash 4318df740b13

Groups

*
yandexbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

baiduspider

Rule Path
Allow /
Allow /
Disallow /uploads
Disallow /ajax
Disallow /aplikacja-mobilna
Disallow /klub-bobovita/konkursy/konkurs-zdjecie-miesiaca/zdjecie/
Disallow /rejestracja
Disallow /logowanie
Disallow /reset-hasla
Disallow /regulaminy-polityka-prywatnosci
Disallow /regulaminy-nota-prawna
Disallow /regulaminy-regulamin-serwisu
Disallow /regulaminy-porady-eksperta
Disallow /regulaminy-konkurs-zdjecie-miesiaca
Disallow /api

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.bobovita.pl/sitemap.xml