nz.justprofessionaldating.com
robots.txt
Robots Exclusion Standard data for nz.justprofessionaldating.com
Resource Scan
Scan Details
| Site Domain | nz.justprofessionaldating.com |
| Base Domain | justprofessionaldating.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-10-09T20:21:43+00:00 |
| Next Scan | 2024-12-08T20:21:43+00:00 |
Last Successful Scan
| Scanned | 2024-07-20T10:49:00+00:00 |
| URL | https://nz.justprofessionaldating.com/robots.txt |
| Domain IPs | 104.18.201.180, 104.18.202.180, 104.18.203.180, 104.18.204.180, 104.18.205.180, 2606:4700::6812:c9b4, 2606:4700::6812:cab4, 2606:4700::6812:cbb4, 2606:4700::6812:ccb4, 2606:4700::6812:cdb4 |
| Response IP | 104.18.204.180 |
| Found | Yes |
| Hash | bc5468eae17628e26101112f155a210cbcce1037364537683fa10066907f0a65 |
| SimHash | 0d30e2166f90 |
Groups
*
| Product | Comment |
|---|---|
| * | directed to all robots |
| Rule | Path |
|---|---|
| Disallow | /api/ |
| Disallow | /assets/ |
| Disallow | /member/ |
| Disallow | /help/shared_network.cfm |
| Allow | /assets/template/premium/scripts/pageswitch.min.js |
Comments