nw-job.de
robots.txt
Robots Exclusion Standard data for nw-job.de
Resource Scan
Scan Details
| Site Domain | nw-job.de |
| Base Domain | nw-job.de |
| Scan Status | Ok |
| Last Scan | 2024-09-17T18:45:35+00:00 |
| Next Scan | 2024-09-24T18:45:35+00:00 |
Last Scan
| Scanned | 2024-09-17T18:45:35+00:00 |
| URL | https://nw-job.de/robots.txt |
| Redirect | https://job.nw.de/robots.txt |
| Redirect Domain | job.nw.de |
| Redirect Base | nw.de |
| Domain IPs | 213.157.3.157 |
| Redirect IPs | 213.157.3.157 |
| Response IP | 213.157.3.157 |
| Found | Yes |
| Hash | 940db98d76603b480dbd304baadd9e9a61dc20cfae5d753ba588d26a6943bff9 |
| SimHash | 0150dd9035d6 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/UseResponsiveness |
| Disallow | /Captcha |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /*?search= |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
| Disallow | /OfferDetail |
| Disallow | /UserFeature |
| Allow | / |
googlebot-image
| Rule | Path |
|---|---|
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/UseResponsiveness |
| Disallow | /Captcha |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /*?search= |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
| Disallow | /OfferDetail |
| Disallow | /UserFeature |
| Allow | / |
googlebot-mobile
| Rule | Path |
|---|---|
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/UseResponsiveness |
| Disallow | /Captcha |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /*?search= |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
| Disallow | /OfferDetail |
| Disallow | /UserFeature |
| Allow | / |
mediapartners-google
| Rule | Path |
|---|---|
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/UseResponsiveness |
| Disallow | /Captcha |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /*?search= |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
| Disallow | /OfferDetail |
| Disallow | /UserFeature |
| Allow | / |
adsbot-google
| Rule | Path |
|---|---|
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/UseResponsiveness |
| Disallow | /Captcha |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /*?search= |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
| Disallow | /OfferDetail |
| Disallow | /UserFeature |
| Allow | / |
msnbot
| Rule | Path |
|---|---|
| Disallow | /Search |
| Disallow | /Lead |
| Disallow | /Toolbar |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/NotedOffers |
| Disallow | /UserFeature/RecentOffers |
| Disallow | /UserFeature/LastSearches |
| Disallow | /UserFeature/UseResponsiveness |
| Disallow | /Captcha |
| Disallow | /Bewerben |
| Disallow | /OfferDetail |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /*?search= |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
| Disallow | /UserFeature |
| Allow | / |
slurp
| Rule | Path |
|---|---|
| Disallow | /Search |
| Disallow | /Lead |
| Disallow | /Toolbar |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/NotedOffers |
| Disallow | /UserFeature/RecentOffers |
| Disallow | /UserFeature/LastSearches |
| Disallow | /UserFeature/UseResponsiveness |
| Disallow | /Captcha |
| Disallow | /Bewerben |
| Disallow | /OfferDetail |
| Disallow | /CachedImage |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /*?search= |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
| Disallow | /UserFeature |
| Allow | / |
teoma
| Rule | Path |
|---|---|
| Disallow | /Search |
| Disallow | /Lead |
| Disallow | /Toolbar |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/NotedOffers |
| Disallow | /UserFeature/RecentOffers |
| Disallow | /UserFeature/LastSearches |
| Disallow | /UserFeature/UseResponsiveness |
| Disallow | /Captcha |
| Disallow | /Bewerben |
| Disallow | /OfferDetail |
| Disallow | /CachedImage |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /*?search= |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
| Disallow | /UserFeature |
| Allow | / |
ia_archiver
| Rule | Path |
|---|---|
| Disallow | /Search.aspx |
| Disallow | /Search |
| Disallow | /Lead |
| Disallow | /Toolbar |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/NotedOffers |
| Disallow | /UserFeature/RecentOffers |
| Disallow | /UserFeature/LastSearches |
| Disallow | /UserFeature/UseResponsiveness |
| Disallow | /Captcha |
| Disallow | /Bewerben |
| Disallow | /OfferDetail |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /*?search= |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
| Disallow | /UserFeature |
| Allow | / |
yahoo-mmcrawler
| Rule | Path |
|---|---|
| Disallow | /Search |
| Disallow | /Lead |
| Disallow | /Toolbar |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/NotedOffers |
| Disallow | /UserFeature/RecentOffers |
| Disallow | /UserFeature/LastSearches |
| Disallow | /UserFeature/UseResponsiveness |
| Disallow | /Captcha |
| Disallow | /Bewerben |
| Disallow | /OfferDetail |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /*?search= |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
| Disallow | /UserFeature |
| Allow | / |
psbot
| Rule | Path |
|---|---|
| Disallow | /Search |
| Disallow | /Lead |
| Disallow | /Toolbar |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/NotedOffers |
| Disallow | /UserFeature/RecentOffers |
| Disallow | /UserFeature/LastSearches |
| Disallow | /UserFeature/UseResponsiveness |
| Disallow | /Captcha |
| Disallow | /Bewerben |
| Disallow | /OfferDetail |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
| Disallow | /UserFeature |
| Allow | / |
lycos_spider_(t-rex)
| Rule | Path |
|---|---|
| Disallow | /Search |
| Disallow | /Lead |
| Disallow | /Toolbar |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/NotedOffers |
| Disallow | /UserFeature/RecentOffers |
| Disallow | /UserFeature/LastSearches |
| Disallow | /UserFeature/UseResponsiveness |
| Disallow | /Captcha |
| Disallow | /Bewerben |
| Disallow | /OfferDetail |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /*?search= |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
| Disallow | /UserFeature |
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /Bewerben |
| Disallow | /OfferDetail |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /*?search= |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
| Disallow | /UserFeature |
Comments