bodybuilding-wizard.com
robots.txt

Robots Exclusion Standard data for bodybuilding-wizard.com

Resource Scan

Scan Details

Site Domain bodybuilding-wizard.com
Base Domain bodybuilding-wizard.com
Scan Status Ok
Last Scan2025-09-30T13:18:55+00:00
Next Scan 2025-10-07T13:18:55+00:00

Last Scan

Scanned2025-09-30T13:18:55+00:00
URL https://bodybuilding-wizard.com/robots.txt
Domain IPs 172.66.41.37, 172.66.42.219, 2606:4700:3108::ac42:2925, 2606:4700:3108::ac42:2adb
Response IP 172.66.41.37
Found Yes
Hash e6041f7440d9927115d53e6f49a5d76b97677e4ae831fb5f38c473dd4ab73826
SimHash 5041d04347d2

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Disallow /forums/users/
Disallow /?s=*
Disallow /?search=*