fitnessandpower.com
robots.txt

Robots Exclusion Standard data for fitnessandpower.com

Resource Scan

Scan Details

Site Domain fitnessandpower.com
Base Domain fitnessandpower.com
Scan Status Ok
Last Scan2024-09-19T15:16:42+00:00
Next Scan 2024-09-26T15:16:42+00:00

Last Scan

Scanned2024-09-19T15:16:42+00:00
URL https://fitnessandpower.com/robots.txt
Domain IPs 104.21.38.147, 172.67.223.168, 2606:4700:3030::ac43:dfa8, 2606:4700:3031::6815:2693
Response IP 172.67.223.168
Found Yes
Hash b3d4a4bad109fbb0ebea20d3be02dea0a6e4ad2b2c2c0ecd4f1339d23e074e6e
SimHash 6934485aca90

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-content/
Disallow /wp-includes/
Disallow /archives/
Disallow /*?*
Disallow /tag/
Disallow /search
Disallow /index.php
Disallow /xmlrpc.php
Disallow *?replytocom
Disallow /wp-*
Disallow /author
Disallow /feed/
Disallow /trackback/
Disallow /comments/feed/
Disallow /page/
Disallow /comments/
Disallow /wp-content/plugins

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

twitterbot

Rule Path
Allow /wp-content/uploads/*

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /wp-content/cache/min/1/

googlebot-mobile

Rule Path
Allow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://www.fitnessandpower.com/sitemap.xml