job.fanpage.it
robots.txt
Robots Exclusion Standard data for job.fanpage.it
Resource Scan
Scan Details
| Site Domain | job.fanpage.it |
| Base Domain | fanpage.it |
| Scan Status | Ok |
| Last Scan | 2024-05-04T05:33:46+00:00 |
| Next Scan | 2024-05-18T05:33:46+00:00 |
Last Scan
| Scanned | 2024-05-04T05:33:46+00:00 |
| URL | https://job.fanpage.it/robots.txt |
| Domain IPs | 23.209.46.19, 23.209.46.27 |
| Response IP | 184.27.123.88 |
| Found | Yes |
| Hash | 7cc6ca5c7a6ec9b38b1b0e0956bcde58f0ae8a9bf8872d5b60598df2f5ddfb03 |
| SimHash | 4b664c58c613 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /struttura/ |
| Disallow | /search/ |
| Disallow | /cgi-bin/ |
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /wp-content/plugins/ |
| Disallow | /wp-content/cache/ |
| Disallow | /wp-content/themes/ |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /1010633/ |
| Disallow | /xmlrpc.php |