michal-wrzosek.fitness.wp.pl
robots.txt

Robots Exclusion Standard data for michal-wrzosek.fitness.wp.pl

Resource Scan

Scan Details

Site Domain michal-wrzosek.fitness.wp.pl
Base Domain wp.pl
Scan Status Ok
Last Scan2024-05-21T14:46:08+00:00
Next Scan 2024-06-20T14:46:08+00:00

Last Scan

Scanned2024-05-21T14:46:08+00:00
URL https://michal-wrzosek.fitness.wp.pl/robots.txt
Domain IPs 193.17.41.204
Response IP 193.17.41.204
Found Yes
Hash 374aa1851819c613a9694c298734de4fe06f49467b0f45b5ce3ce1205b51bf50
SimHash 401899e4e791

Groups

*

Rule Path
Allow /
Disallow /*-json/$
Disallow /*?ticket=*
Disallow /next-posts/

proximic
seokicks
ahrefsbot
seoscanners.net
linkdexbot
grapeshotcrawler
semrushbot
semrushbot-sa

Rule Path
Disallow /

bingbot
msnbot
slurp
ahrefsbot
yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

bingbot
msnbot
slurp
ahrefsbot
yandexbot

Rule Path
Disallow /search/