monster.it
robots.txt
Robots Exclusion Standard data for monster.it
Resource Scan
Scan Details
| Site Domain | monster.it |
| Base Domain | monster.it |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-11-10T15:42:37+00:00 |
| Next Scan | 2024-11-24T15:42:37+00:00 |
Last Successful Scan
| Scanned | 2024-01-21T13:38:47+00:00 |
| URL | https://monster.it/robots.txt |
| Redirect | https://www.monster.it/robots.txt |
| Redirect Domain | www.monster.it |
| Redirect Base | monster.it |
| Domain IPs | 208.71.193.147, 208.71.199.147 |
| Redirect IPs | 13.224.167.100, 13.224.167.109, 13.224.167.44, 13.224.167.79 |
| Response IP | 108.157.194.4 |
| Found | Yes |
| Hash | 5b6eb232715a328986a4ac1b58a389b77a8931e7d166686eb759d223327507d3 |
| SimHash | 4c2011400d85 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /lavoro/cerca* |
| Disallow | /consigli-di-lavoro/articolo?q=* |
| Disallow | /lavoro/annunci-consigliati |
| Disallow | /lavoro/condividi-annuncio |
| Disallow | /reviews |
| Disallow | */Agents/ |
| Disallow | */apply/ |
| Disallow | */applyStart.asp |
| Disallow | */become-member/ |
| Disallow | */columntemplatesearch |
| Disallow | */Controls/ |
| Disallow | */default.aspx_Confirmation.evt |
| Disallow | */DoNotAddToP4/UserControls/ |
| Disallow | */Error |
| Disallow | */Error.aspx |
| Disallow | */jbs/ |
| Disallow | */lpfsearch |
| Disallow | */ManageSavedSearch |
| Disallow | */services/ |
| Disallow | /cmslanding.aspx |
| Disallow | /contact. |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.monster.it/psp-static-sitemapindex.xml |
| sitemap | https://www.monster.it/consigli-di-lavoro/sitemap.xml |
| sitemap | https://www.monster.it/ricerca-personale/sitemap_index.xml |
| sitemap | https://www.monster.it/lang-sitemap.xml |
| sitemap | https://www.monster.it/seositemap-af2w67kh1z-it-it.xml |
| sitemap | https://www.monster.it/jobview-zuq65ljydx-it.xml |
| sitemap | https://www.monster.it/ricerca-personale/risorse/sitemap_index.xml |
Comments