searchpeoplefree.net
robots.txt
Robots Exclusion Standard data for searchpeoplefree.net
Resource Scan
Scan Details
Site Domain | searchpeoplefree.net |
Base Domain | searchpeoplefree.net |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-15T06:42:23+00:00 |
Next Scan | 2024-08-13T06:42:23+00:00 |
Last Successful Scan
Scanned | 2023-03-28T23:23:30+00:00 |
URL | https://searchpeoplefree.net/robots.txt |
Domain IPs | 104.26.12.38, 104.26.13.38, 172.67.70.74, 2606:4700:20::681a:c26, 2606:4700:20::681a:d26, 2606:4700:20::ac43:464a |
Response IP | 104.26.12.38 |
Found | Yes |
Hash | 56fa79e799a77a3947669e0e4716dcaab151a6535bab9bddd323aea33d915bda |
SimHash | 690cd870c7b1 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /search* |
Disallow | /full-name/* |
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Other Records
Field | Value |
---|---|
sitemap | https://searchpeoplefree.net/sitemap.xml |