dealfuel.com
robots.txt
Robots Exclusion Standard data for dealfuel.com
Resource Scan
Scan Details
| Site Domain | dealfuel.com |
| Base Domain | dealfuel.com |
| Scan Status | Ok |
| Last Scan | 2026-02-23T00:04:05+00:00 |
| Next Scan | 2026-03-25T00:04:05+00:00 |
Last Scan
| Scanned | 2026-02-23T00:04:05+00:00 |
| URL | https://dealfuel.com/robots.txt |
| Redirect | https://www.dealfuel.com/robots.txt |
| Redirect Domain | www.dealfuel.com |
| Redirect Base | dealfuel.com |
| Domain IPs | 104.26.4.84, 104.26.5.84, 172.67.72.77, 2606:4700:20::681a:454, 2606:4700:20::681a:554, 2606:4700:20::ac43:484d |
| Redirect IPs | 104.26.4.84, 104.26.5.84, 172.67.72.77, 2606:4700:20::681a:454, 2606:4700:20::681a:554, 2606:4700:20::ac43:484d |
| Response IP | 104.26.5.84 |
| Found | Yes |
| Hash | 40c42449da2bfe2c2ea821396066107c0cb74f615aa23bf112d05b91cbd1f62e |
| SimHash | 68694a9364f4 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /wp-admin/ | - |
| Disallow | /wp-content/uploads/wpforms/ | - |
| Disallow | /cgi-bin/ | - |
| Disallow | /author/ | Block thin/duplicate author pages |
| Disallow | /tag/ | - |
| Disallow | /partners/ | - |
| Disallow | */feed/ | - |
| Disallow | /?s= | Search result pages |
| Disallow | /search/ | - |
| Disallow | /cart/ | - |
| Disallow | /checkout/ | - |
| Disallow | /my-account/ | - |
| Disallow | /wishlist/ | - |
| Disallow | /track-order/ | - |
| Disallow | /thank-you/ | - |
| Disallow | /404/ | - |
| Disallow | /privacy-policy/ | - |
| Disallow | /terms-and-conditions/ | - |
| Disallow | /*?add-to-cart | - |
| Disallow | /*?attachment_id | - |
| Disallow | /*?ref= | - |
| Disallow | /*?ap_id= | - |
| Disallow | /*?aff_id= | - |
| Disallow | /*?cmid= | - |
| Disallow | /*?sscid= | - |
| Disallow | /*?utm_ | Blocks all UTM tracking URLs |
| Disallow | /*?fbclid | - |
| Disallow | /*?gclid | - |
| Disallow | /*?redirect_to | - |
| Disallow | /*add-to-cart%3D | - |
| Allow | / | - |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.dealfuel.com/sitemap_index.xml |
Comments