bettycrocker.com
robots.txt
Robots Exclusion Standard data for bettycrocker.com
Resource Scan
Scan Details
| Site Domain | bettycrocker.com |
| Base Domain | bettycrocker.com |
| Scan Status | Ok |
| Last Scan | 2024-11-15T17:48:21+00:00 |
| Next Scan | 2024-11-22T17:48:21+00:00 |
Last Scan
| Scanned | 2024-11-15T17:48:21+00:00 |
| URL | https://bettycrocker.com/robots.txt |
| Redirect | https://www.bettycrocker.com/robots.txt |
| Redirect Domain | www.bettycrocker.com |
| Redirect Base | bettycrocker.com |
| Domain IPs | 20.236.87.75 |
| Redirect IPs | 152.199.43.124 |
| Response IP | 152.199.43.124 |
| Found | Yes |
| Hash | ef69b5f8059ea3b5479b6e0bfd7e384209068ad28930125b53204f39aa1f1e74 |
| SimHash | 240b1add1d50 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /register |
| Disallow | /register/ |
| Disallow | /login |
| Disallow | /search |
| Disallow | /testing |
| Disallow | /Testing |
| Disallow | /sitecore/ |
| Disallow | /shared/ |
| Disallow | /home/ |
| Disallow | /Home/ |
| Disallow | /myaccount/ |
| Disallow | /~/media/files/* |
| Disallow | /.well-known/apple-app-site-association |
| Disallow | /apple-app-site-association |
| Disallow | /user-profile/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bettycrocker.com/sitemap.xml |
Comments