leetestevens.com
robots.txt
Robots Exclusion Standard data for leetestevens.com
Resource Scan
Scan Details
Site Domain | leetestevens.com |
Base Domain | leetestevens.com |
Scan Status | Ok |
Last Scan | 2025-06-01T17:19:09+00:00 |
Next Scan | 2025-07-01T17:19:09+00:00 |
Last Scan
Scanned | 2025-06-01T17:19:09+00:00 |
URL | https://leetestevens.com/robots.txt |
Redirect | https://www.leetestevens.com/robots.txt |
Redirect Domain | www.leetestevens.com |
Redirect Base | leetestevens.com |
Domain IPs | 72.32.39.199 |
Redirect IPs | 98.129.167.1 |
Response IP | 98.129.167.1 |
Found | Yes |
Hash | 3d94f3e19e33745fbebab6f650369d3f7dab319866a45d2a55008f6d2541342a |
SimHash | 61619cc4c9b1 |
Groups
*
Rule | Path |
---|---|
Disallow | /privacy-policy |
Disallow | /terms-of-use |
Other Records
Field | Value |
---|---|
crawl-delay | 20 |
Other Records
Field | Value |
---|---|
sitemap | https://www.leetestevens.com/sitemap.xml |