hfrreviews.com
robots.txt
Robots Exclusion Standard data for hfrreviews.com
Resource Scan
Scan Details
| Site Domain | hfrreviews.com |
| Base Domain | hfrreviews.com |
| Scan Status | Ok |
| Last Scan | 5/24/2025, 7:09:02 AM |
| Next Scan | 6/23/2025, 7:09:02 AM |
Last Scan
| Scanned | 5/24/2025, 7:09:02 AM |
| URL | https://hfrreviews.com/robots.txt |
| Domain IPs | 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001 |
| Response IP | 104.21.112.1 |
| Found | Yes |
| Hash | 267465fd4af1a53ff3f99677d0c8d8cf696a8f8d1e1f7bf65b69c48f2193a40e |
| SimHash | 243109128611 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /freebooks |
| Disallow | /subs |
| Disallow | /1 |
| Disallow | /? |
| Disallow | /wp- |
| Disallow | *?s= |
| Disallow | *%26s%3D |
| Disallow | /search/ |
| Disallow | /author/ |
| Disallow | /users/ |
| Disallow | */trackback |
| Disallow | */feed |
| Disallow | */rss |
| Disallow | */embed |
| Disallow | /xmlrpc.php |
| Disallow | *utm*%3D |
| Disallow | *openstat%3D |
| Allow | */uploads |
| Allow | /wp-content/themes/*.css |
| Allow | /wp-content/plugins/*.css |
| Allow | /wp-content/uploads/*.css |
| Allow | /wp-content/themes/*.js |
| Allow | /wp-content/plugins/*.js |
| Allow | /wp-content/uploads/*.js |
| Allow | /wp-includes/*.js$ |
| Allow | /wp-includes/*.css$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.hfrreviews.com/sitemap.xml |
| sitemap | https://www.hfrreviews.com/sitemap.xml.gz |