candidate.webcruiter.com
robots.txt
Robots Exclusion Standard data for candidate.webcruiter.com
Resource Scan
Scan Details
| Site Domain | candidate.webcruiter.com |
| Base Domain | webcruiter.com |
| Scan Status | Ok |
| Last Scan | 2024-11-03T07:13:20+00:00 |
| Next Scan | 2024-12-03T07:13:20+00:00 |
Last Scan
| Scanned | 2024-11-03T07:13:20+00:00 |
| URL | https://candidate.webcruiter.com/robots.txt |
| Domain IPs | 13.107.246.59, 2620:1ec:bdf::59 |
| Response IP | 13.107.246.59 |
| Found | Yes |
| Hash | 6f123b459c4433a48c6fe93926d904dd92452bf870067cd7275c57063813cb08 |
| SimHash | 4a08926a023e |
Groups
googlebot
| Rule | Path |
|---|---|
| Allow | /home/alladverts/ |
| Allow | /nb-no/home/alladverts/ |
| Allow | /en-gb/home/alladverts/ |
| Allow | /nb-nn/home/alladverts/ |
| Allow | /da-dk/home/alladverts/ |
| Allow | /de-de/home/alladverts/ |
| Allow | /fi-fi/home/alladverts/ |
| Allow | /se-no/home/alladverts/ |
| Allow | /sv-se/home/alladverts/ |
| Allow | /home/companyAdverts/ |
| Allow | /nb-no/home/companyAdverts/ |
| Allow | /en-gb/home/companyAdverts/ |
| Allow | /nb-nn/home/companyAdverts/ |
| Allow | /da-dk/home/companyAdverts/ |
| Allow | /de-de/home/companyAdverts/ |
| Allow | /fi-fi/home/companyAdverts/ |
| Allow | /se-no/home/companyAdverts/ |
| Allow | /sv-se/home/companyAdverts/ |
| Allow | /brannjobb/ |
| Allow | /nb-no/brannjobb/ |
| Allow | /en-gb/brannjobb/ |
| Allow | /nb-nn/brannjobb/ |
| Allow | /da-dk/brannjobb/ |
| Allow | /de-de/brannjobb/ |
| Allow | /fi-fi/brannjobb/ |
| Allow | /se-no/brannjobb/ |
| Allow | /sv-se/brannjobb/ |
| Allow | /kirkejobb/ |
| Allow | /en-gb/kirkejobb/ |
| Allow | /nb-nn/kirkejobb/ |
| Allow | /da-dk/kirkejobb/ |
| Allow | /de-de/kirkejobb/ |
| Allow | /fi-fi/kirkejobb/ |
| Allow | /se-no/kirkejobb/ |
| Allow | /sv-se/kirkejobb/ |
*
| Rule | Path |
|---|---|
| Disallow | / |