bebiklub.pl
robots.txt

Robots Exclusion Standard data for bebiklub.pl

Resource Scan

Scan Details

Site Domain bebiklub.pl
Base Domain bebiklub.pl
Scan Status Ok
Last Scan2024-06-25T21:27:21+00:00
Next Scan 2024-07-25T21:27:21+00:00

Last Scan

Scanned2024-06-25T21:27:21+00:00
URL https://bebiklub.pl/robots.txt
Redirect https://www.bebiklub.pl/robots.txt
Redirect Domain www.bebiklub.pl
Redirect Base bebiklub.pl
Domain IPs 104.21.21.112, 172.67.198.74, 2606:4700:3034::ac43:c64a, 2606:4700:3035::6815:1570
Redirect IPs 18.155.68.20, 18.155.68.41, 18.155.68.5, 18.155.68.70, 2600:9000:23d2:3800:1:95b9:a500:93a1, 2600:9000:23d2:5a00:1:95b9:a500:93a1, 2600:9000:23d2:9800:1:95b9:a500:93a1, 2600:9000:23d2:b400:1:95b9:a500:93a1, 2600:9000:23d2:b600:1:95b9:a500:93a1, 2600:9000:23d2:d600:1:95b9:a500:93a1, 2600:9000:23d2:e800:1:95b9:a500:93a1, 2600:9000:23d2:f000:1:95b9:a500:93a1
Response IP 18.155.68.5
Found Yes
Hash c444089b33605427aaf75a6328da062151096c617c82c6b7c16c6d85e9813c93
SimHash 401cdd7403d3

Groups

*
yandexbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

baiduspider

Rule Path
Allow /
Allow /
Disallow /rejestracja
Disallow /logowanie
Disallow /api

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.bebiklub.pl/sitemap.xml