dealspromoscoupons.com
robots.txt
Robots Exclusion Standard data for dealspromoscoupons.com
Resource Scan
Scan Details
Site Domain | dealspromoscoupons.com |
Base Domain | dealspromoscoupons.com |
Scan Status | Ok |
Last Scan | 2024-09-20T20:13:42+00:00 |
Next Scan | 2024-09-27T20:13:42+00:00 |
Last Scan
Scanned | 2024-09-20T20:13:42+00:00 |
URL | https://dealspromoscoupons.com/robots.txt |
Domain IPs | 104.21.45.13, 172.67.207.127, 2606:4700:3031::6815:2d0d, 2606:4700:3037::ac43:cf7f |
Response IP | 104.21.45.13 |
Found | Yes |
Hash | 7c1c80c45db0d707196b50479758d6c7b1bc9b0a64a5e7b37f928de69c92908f |
SimHash | 4900d817e219 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /go/ |
Disallow | /go/* |
Disallow | /*/show/* |
Disallow | /*/s/ |
Disallow | /*/show/* |
Disallow | /brand/* |
Other Records
Field | Value |
---|---|
crawl-delay | 3 |
Other Records
Field | Value |
---|---|
sitemap | https://dealspromoscoupons.com/sitemap.xml |