homewarrantyreviews.com
robots.txt

Robots Exclusion Standard data for homewarrantyreviews.com

Resource Scan

Scan Details

Site Domain homewarrantyreviews.com
Base Domain homewarrantyreviews.com
Scan Status Ok
Last Scan2024-11-03T23:43:35+00:00
Next Scan 2024-12-03T23:43:35+00:00

Last Scan

Scanned2024-11-03T23:43:35+00:00
URL https://homewarrantyreviews.com/robots.txt
Redirect https://www.homewarrantyreviews.com/robots.txt
Redirect Domain www.homewarrantyreviews.com
Redirect Base homewarrantyreviews.com
Domain IPs 13.33.88.100, 13.33.88.115, 13.33.88.119, 13.33.88.90
Redirect IPs 13.33.88.100, 13.33.88.115, 13.33.88.119, 13.33.88.90
Response IP 13.33.88.115
Found Yes
Hash f5dd085a9684d8c5b97fa28d792504124db0f9aa6c006460a04b4f7090284896
SimHash 4f1d5a72e718

Groups

*

Rule Path
Disallow /wp-admin
Allow /wp-content/uploads/
Allow /crp/
Allow /*.js*
Allow /*.css*
Disallow /*?subpage=
Disallow /*?sub_page=
Disallow /*?*
Disallow /*.php$
Disallow /search-result/
Disallow /cgi-bin/
Disallow /wp-content/plugins/
Disallow /feed/
Disallow /*/feed/
Disallow /brand/
Disallow /author/
Disallow /best-home-warranty-companies-2021/

adsbot-google
adsbot-google-mobile
adidxbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.homewarrantyreviews.com/sitemap_index.xml