thehealthfeed.com
robots.txt

Robots Exclusion Standard data for thehealthfeed.com

Resource Scan

Scan Details

Site Domain thehealthfeed.com
Base Domain thehealthfeed.com
Scan Status Ok
Last Scan2024-05-28T04:50:41+00:00
Next Scan 2024-06-04T04:50:41+00:00

Last Scan

Scanned2024-05-28T04:50:41+00:00
URL https://thehealthfeed.com/robots.txt
Redirect https://www.thehealthfeed.com/robots.txt
Redirect Domain www.thehealthfeed.com
Redirect Base thehealthfeed.com
Domain IPs 199.232.46.114
Redirect IPs 151.101.130.114, 151.101.194.114, 151.101.2.114, 151.101.66.114
Response IP 199.232.46.114
Found Yes
Hash 7340467ba8685cf850d66ffd553ab838fc71dc50b5fb8598cce97bd88f0dcd35
SimHash 05111270d713

Groups

*

Rule Path
Disallow /web
Disallow /article/
Disallow /slideshow/
Disallow /fragment
Disallow /_clk
Disallow /slp
Disallow /ar
Disallow /log/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

mediapartners-google

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

adsbot-google-mobile

Rule Path
Disallow

adidxbot

Rule Path
Disallow

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.thehealthfeed.com/sitemap.xml

Comments

  • Thehealthfeed robots.txt