bebiprogram.pl
robots.txt

Robots Exclusion Standard data for bebiprogram.pl

Resource Scan

Scan Details

Site Domain bebiprogram.pl
Base Domain bebiprogram.pl
Scan Status Ok
Last Scan2024-05-27T21:51:35+00:00
Next Scan 2024-06-26T21:51:35+00:00

Last Scan

Scanned2024-05-27T21:51:35+00:00
URL https://bebiprogram.pl/robots.txt
Redirect https://www.bebiprogram.pl/robots.txt
Redirect Domain www.bebiprogram.pl
Redirect Base bebiprogram.pl
Domain IPs 104.21.49.58, 172.67.159.55, 2606:4700:3031::6815:313a, 2606:4700:3033::ac43:9f37
Redirect IPs 13.225.4.114, 13.225.4.24, 13.225.4.59, 13.225.4.71, 2600:9000:21b4:1a00:1a:e968:a000:93a1, 2600:9000:21b4:4000:1a:e968:a000:93a1, 2600:9000:21b4:7200:1a:e968:a000:93a1, 2600:9000:21b4:b200:1a:e968:a000:93a1, 2600:9000:21b4:ce00:1a:e968:a000:93a1, 2600:9000:21b4:de00:1a:e968:a000:93a1, 2600:9000:21b4:e000:1a:e968:a000:93a1, 2600:9000:21b4:e600:1a:e968:a000:93a1
Response IP 13.225.4.24
Found Yes
Hash e6d774de9adc9971f38bda206073d6906cb6e067a50a93a694785fb046cbde73
SimHash 4c18dd748313

Groups

*
yandexbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

baiduspider

Rule Path
Allow /
Allow /
Disallow /rejestracja
Disallow /logowanie
Disallow /api

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.bebiprogram.pl/sitemap.xml