freesamples.us
robots.txt
Robots Exclusion Standard data for freesamples.us
Resource Scan
Scan Details
| Site Domain | freesamples.us |
| Base Domain | freesamples.us |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-03-19T01:11:47+00:00 |
| Next Scan | 2024-05-18T01:11:47+00:00 |
Last Successful Scan
| Scanned | 2023-04-29T20:06:57+00:00 |
| URL | https://freesamples.us/robots.txt |
| Redirect | https://www.freesamples.us/robots.txt |
| Redirect Domain | www.freesamples.us |
| Redirect Base | freesamples.us |
| Domain IPs | 75.2.70.75, 99.83.190.102 |
| Redirect IPs | 13.115.182.240, 13.115.92.205, 35.79.138.241 |
| Response IP | 13.115.92.205 |
| Found | Yes |
| Hash | 57c7b3b42ebd2f0bc7f3952b5a6742f60e530b303e2a5f9ca706339fca8b5d36 |
| SimHash | 781d4d74c6d3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /utility/ |
| Disallow | /testing/ |
| Disallow | /offer/ |
| Disallow | /lander-no-data |
| Disallow | /lp-form-1 |
| Disallow | /loading |
| Disallow | /search |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.freesamples.us/sitemap.xml |