presearch.org
robots.txt
Robots Exclusion Standard data for presearch.org
Resource Scan
Scan Details
| Site Domain | presearch.org |
| Base Domain | presearch.org |
| Scan Status | Ok |
| Last Scan | 2024-09-24T19:37:33+00:00 |
| Next Scan | 2024-10-01T19:37:33+00:00 |
Last Scan
| Scanned | 2024-09-24T19:37:33+00:00 |
| URL | https://presearch.org/robots.txt |
| Redirect | https://presearch.com/robots.txt |
| Redirect Domain | presearch.com |
| Redirect Base | presearch.com |
| Domain IPs | 108.157.254.47, 108.157.254.59, 108.157.254.65, 108.157.254.67 |
| Redirect IPs | 52.220.70.215, 52.74.198.205, 54.179.235.200 |
| Response IP | 52.74.198.205 |
| Found | Yes |
| Hash | 9882dcf8a43a5f7703e4e2b92237b82b1f14737670ee493044309f2e79c1c26b |
| SimHash | 481ad4306242 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /search |
| Disallow | /images |
| Disallow | /videos |
| Disallow | /news |
| Disallow | /shopping |
| Disallow | /results |
| Disallow | /ai-results |
| Disallow | /background-url/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |