jobtoyou.co.uk
robots.txt
Robots Exclusion Standard data for jobtoyou.co.uk
Resource Scan
Scan Details
| Site Domain | jobtoyou.co.uk |
| Base Domain | jobtoyou.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-11-06T05:23:19+00:00 |
| Next Scan | 2024-11-13T05:23:19+00:00 |
Last Scan
| Scanned | 2024-11-06T05:23:19+00:00 |
| URL | https://jobtoyou.co.uk/robots.txt |
| Redirect | https://www.jobtoyou.co.uk/robots.txt |
| Redirect Domain | www.jobtoyou.co.uk |
| Redirect Base | jobtoyou.co.uk |
| Domain IPs | 2600:1901:0:11f5::, 34.149.210.165 |
| Redirect IPs | 2600:1901:0:11f5::, 34.149.210.165 |
| Response IP | 34.149.210.165 |
| Found | Yes |
| Hash | 99786279851f2d38a9f9bc2296876f0d3bae50395aec1aff89d9ccbce0dbb6da |
| SimHash | 0054c360c771 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /$ |
| Allow | /ads.txt$ |
| Allow | /amp/* |
| Allow | /editor/* |
| Disallow | /* |