fitness.wp.pl
robots.txt

Robots Exclusion Standard data for fitness.wp.pl

Resource Scan

Scan Details

Site Domain fitness.wp.pl
Base Domain wp.pl
Scan Status Ok
Last Scan2024-04-12T05:37:35+00:00
Next Scan 2024-05-12T05:37:35+00:00

Last Scan

Scanned2024-04-12T05:37:35+00:00
URL https://fitness.wp.pl/robots.txt
Domain IPs 193.17.41.204
Response IP 193.17.41.204
Found Yes
Hash 3d14ac654625d1f4d361463e465922fdc3c3b24577fef92ad615b1b07d51e7bc
SimHash 4a9155d06791

Groups

*

Rule Path
Allow /
Disallow /*-json/$
Disallow /*?ticket=*
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /.htaccess
Disallow /license.txt
Disallow /readme.html
Disallow /wp-admin/
Disallow /wp-content/languages/
Disallow /wp-content/mu-plugins/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-includes/
Disallow /wp-*.php
Disallow /xmlrpc.php
Disallow /20*/feed
Disallow /wp-content/plugins/blomedia-socialmedia-floating-box/like_count.php
Disallow /tag/*/feed
Disallow /kategoria/*/feed
Disallow /next-posts/
Disallow /latest
Disallow /tools_python

proximic
seokicks
ahrefsbot
seoscanners.net
linkdexbot
grapeshotcrawler
semrushbot
semrushbot-sa

Rule Path
Disallow /

bingbot
msnbot
slurp
ahrefsbot
yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

bingbot
msnbot
slurp
ahrefsbot
yandexbot

Rule Path
Disallow /search/