pillsbury.com
robots.txt
Robots Exclusion Standard data for pillsbury.com
Resource Scan
Scan Details
Site Domain | pillsbury.com |
Base Domain | pillsbury.com |
Scan Status | Ok |
Last Scan | 2024-11-08T23:54:39+00:00 |
Next Scan | 2024-11-15T23:54:39+00:00 |
Last Scan
Scanned | 2024-11-08T23:54:39+00:00 |
URL | https://pillsbury.com/robots.txt |
Redirect | https://www.pillsbury.com/robots.txt |
Redirect Domain | www.pillsbury.com |
Redirect Base | pillsbury.com |
Domain IPs | 20.236.87.75 |
Redirect IPs | 152.199.43.124 |
Response IP | 152.199.43.124 |
Found | Yes |
Hash | 133f12f15b8fe6da7ae427afd81a6e392156d21320226853f9e6814079fae672 |
SimHash | 240a18c91610 |
Groups
*
Rule | Path |
---|---|
Disallow | /register |
Disallow | /register/ |
Disallow | /search |
Disallow | /services/ |
Disallow | /testing/ |
Disallow | /Testing/ |
Disallow | /sitecore/ |
Disallow | /shared/ |
Disallow | /home/ |
Disallow | /Home/ |
Disallow | /myaccount/ |
Disallow | /~/media/files/* |
Disallow | /user-profile/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.pillsbury.com/sitemap.xml |
Comments