samplethat.com
robots.txt
Robots Exclusion Standard data for samplethat.com
Resource Scan
Scan Details
Site Domain | samplethat.com |
Base Domain | samplethat.com |
Scan Status | Ok |
Last Scan | 2024-09-20T10:14:32+00:00 |
Next Scan | 2024-09-27T10:14:32+00:00 |
Last Scan
Scanned | 2024-09-20T10:14:32+00:00 |
URL | https://samplethat.com/robots.txt |
Redirect | https://www.samplethat.com/robots.txt |
Redirect Domain | www.samplethat.com |
Redirect Base | samplethat.com |
Domain IPs | 159.135.12.19 |
Redirect IPs | 159.135.12.19 |
Response IP | 159.135.12.19 |
Found | Yes |
Hash | efb2839773daefb5f016b23abfc1a7aef99c8a58be15fe5ea6df8fc22d45fbaf |
SimHash | 09518ae47bd3 |
Groups
*
Rule | Path |
---|---|
Disallow | / |
Allow | /blog/ |
Allow | /winners |
Allow | /official-rules |
Allow | /beautybox-rules |
Allow | /snackbox-rules |
Allow | /starbucks-rules |
Allow | /product-testing-rules |
Allow | /doll-sweepstakes-rules |
Allow | /faq |
Allow | /contact-us |
Allow | /parequest.php |
Allow | /privacy-policy |
Allow | /terms-and-conditions |
Other Records
Field | Value |
---|---|
sitemap | https://www.samplethat.com/sitemap.xml |