itjobs.com.pt
robots.txt
Robots Exclusion Standard data for itjobs.com.pt
Resource Scan
Scan Details
| Site Domain | itjobs.com.pt |
| Base Domain | itjobs.com.pt |
| Scan Status | Ok |
| Last Scan | 2024-11-07T10:51:42+00:00 |
| Next Scan | 2024-11-14T10:51:42+00:00 |
Last Scan
| Scanned | 2024-11-07T10:51:42+00:00 |
| URL | http://itjobs.com.pt/robots.txt |
| Redirect | https://www.itjobs.pt/robots.txt |
| Redirect Domain | www.itjobs.pt |
| Redirect Base | itjobs.pt |
| Domain IPs | 176.58.117.23 |
| Redirect IPs | 104.26.10.238, 104.26.11.238, 172.67.71.250, 2606:4700:20::681a:aee, 2606:4700:20::681a:bee, 2606:4700:20::ac43:47fa |
| Response IP | 172.67.71.250 |
| Found | Yes |
| Hash | 27de289aa557a3a94187985b253980bf98b2f4eabea74ee335976d1b31f0fa0c |
| SimHash | 0010a9348a40 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /*?lang= |
| Disallow | /admin |
| Disallow | /index.php |
| Allow | /user/login |
| Allow | /user/register |
| Disallow | /user/* |
Comments