kawusia.pl
robots.txt

Robots Exclusion Standard data for kawusia.pl

Resource Scan

Scan Details

Site Domain kawusia.pl
Base Domain kawusia.pl
Scan Status Ok
Last Scan2024-06-09T11:18:03+00:00
Next Scan 2024-06-16T11:18:03+00:00

Last Scan

Scanned2024-06-09T11:18:03+00:00
URL https://kawusia.pl/robots.txt
Domain IPs 2001:41d0:602:1d53::183, 51.77.39.183
Response IP 51.77.39.183
Found Yes
Hash 53a6e26ac996b2d6e8671f6e7758663722d7955f449129f7aa9c5d9ab32bb181
SimHash 4b0dc493d612

Groups

*

Rule Path
Disallow /najpopularniejsze*

bingbot

Rule Path
Disallow /najpopularniejsze*

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Disallow /najpopularniejsze*

Other Records

Field Value
crawl-delay 10

yandex
mj12bot
seokicks
semrushbot
ahrefsbot
petalbot
ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.kawusia.pl/sitemap.xml
sitemap https://www.kawusia.pl/map_main.xml
sitemap https://www.kawusia.pl/map_kawusie.xml
sitemap https://www.kawusia.pl/map_kawusie_strony.xml
sitemap https://www.kawusia.pl/map_parzone.xml
sitemap https://www.kawusia.pl/map_parzone_strony.xml