fitwp.com
robots.txt

Robots Exclusion Standard data for fitwp.com

Resource Scan

Scan Details

Site Domain fitwp.com
Base Domain fitwp.com
Scan Status Ok
Last Scan2025-12-14T07:08:06+00:00
Next Scan 2026-01-13T07:08:06+00:00

Last Scan

Scanned2025-12-14T07:08:06+00:00
URL https://www.fitwp.com/robots.txt
Domain IPs 104.21.4.15, 172.67.131.131
Response IP 104.21.4.15
Found Yes
Hash 9aaf234e1957fe38bfb66b988bcbd9248e4f02bf4bf3e91198638f3e9d6385ac
SimHash 420048408136

Groups

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php