ciekawostkihistoryczne.pl
robots.txt

Robots Exclusion Standard data for ciekawostkihistoryczne.pl

Resource Scan

Scan Details

Site Domain ciekawostkihistoryczne.pl
Base Domain ciekawostkihistoryczne.pl
Scan Status Ok
Last Scan2024-11-16T04:32:06+00:00
Next Scan 2024-11-23T04:32:06+00:00

Last Scan

Scanned2024-11-16T04:32:06+00:00
URL https://ciekawostkihistoryczne.pl/robots.txt
Domain IPs 54.36.175.165
Response IP 54.36.175.165
Found Yes
Hash e1e078eaa2155d57156cbf46e2f25d84aef214a7da2a608796310c7a0f924025
SimHash 4a2898628831

Groups

*

Rule Path
Allow /wp-content/uploads/
Disallow /wp-content/plugins/
Disallow /wp-admin/
Disallow /najnowsze-komentarze/*
Disallow /wp-admin/admin-ajax.php

slurp

Rule Path
Disallow /

yahoo!

Rule Path
Disallow /

yandex

Rule Path
Disallow /

cuil

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baidu

Rule Path
Disallow /

baiduspider+(+http://www.baidu.com/search/spider.htm)

Rule Path
Disallow /

baiduspider+(+http://www.baidu.com/search/spider_jp.html)

Rule Path
Disallow /

riddlerbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

gg+peekbot+1.0+(http://gg.pl)

Rule Path
Disallow /

gg+peekbot

Rule Path
Disallow /

sentibot admin@senti1.com (compatible with googlebot)

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://ciekawostkihistoryczne.pl/sitemap.xml