jobs26.de
robots.txt
Robots Exclusion Standard data for jobs26.de
Resource Scan
Scan Details
| Site Domain | jobs26.de |
| Base Domain | jobs26.de |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-05-21T05:27:55+00:00 |
| Next Scan | 2024-08-19T05:27:55+00:00 |
Last Successful Scan
| Scanned | 2024-01-23T00:40:51+00:00 |
| URL | https://jobs26.de/robots.txt |
| Redirect | https://jobs.nwzonline.de/robots.txt#InfoMessage |
| Redirect Domain | jobs.nwzonline.de |
| Redirect Base | nwzonline.de |
| Domain IPs | 213.157.3.157 |
| Redirect IPs | 138.201.75.97 |
| Response IP | 138.201.75.97 |
| Found | Yes |
| Hash | ec2b96bed579f22e95716c34e637e0050e2325db1f00a2cf2e67f993c7408a0b |
| SimHash | 0050dd9870d7 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /application |
| Disallow | /search |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/UseResponsiveness |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /*?search= |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
| Allow | / |
googlebot-image
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /application |
| Disallow | /search |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/UseResponsiveness |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /*?search= |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
| Allow | / |
googlebot-mobile
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /application |
| Disallow | /search |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/UseResponsiveness |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /*?search= |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
| Allow | / |
mediapartners-google
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /application |
| Disallow | /search |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/UseResponsiveness |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /*?search= |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
| Allow | / |
adsbot-google
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /application |
| Disallow | /search |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/UseResponsiveness |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /*?search= |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
| Allow | / |
msnbot
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /application |
| Disallow | /search |
| Disallow | /Search |
| Disallow | /Lead |
| Disallow | /Toolbar |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/NotedOffers |
| Disallow | /UserFeature/RecentOffers |
| Disallow | /UserFeature/LastSearches |
| Disallow | /UserFeature/UseResponsiveness |
| Disallow | /Bewerben |
| Disallow | /OfferDetail |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /*?search= |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
| Allow | / |
slurp
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /application |
| Disallow | /search |
| Disallow | /Search |
| Disallow | /Lead |
| Disallow | /Toolbar |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/NotedOffers |
| Disallow | /UserFeature/RecentOffers |
| Disallow | /UserFeature/LastSearches |
| Disallow | /UserFeature/UseResponsiveness |
| Disallow | /Bewerben |
| Disallow | /OfferDetail |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /*?search= |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
| Allow | / |
teoma
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /application |
| Disallow | /search |
| Disallow | /Search |
| Disallow | /Lead |
| Disallow | /Toolbar |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/NotedOffers |
| Disallow | /UserFeature/RecentOffers |
| Disallow | /UserFeature/LastSearches |
| Disallow | /UserFeature/UseResponsiveness |
| Disallow | /Bewerben |
| Disallow | /OfferDetail |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /*?search= |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
| Allow | / |
ia_archiver
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /application |
| Disallow | /search |
| Disallow | /Search.aspx |
| Disallow | /Search |
| Disallow | /Lead |
| Disallow | /Toolbar |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/NotedOffers |
| Disallow | /UserFeature/RecentOffers |
| Disallow | /UserFeature/LastSearches |
| Disallow | /UserFeature/UseResponsiveness |
| Disallow | /Bewerben |
| Disallow | /OfferDetail |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /*?search= |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
| Allow | / |
yahoo-mmcrawler
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /application |
| Disallow | /search |
| Disallow | /Search |
| Disallow | /Lead |
| Disallow | /Toolbar |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/NotedOffers |
| Disallow | /UserFeature/RecentOffers |
| Disallow | /UserFeature/LastSearches |
| Disallow | /UserFeature/UseResponsiveness |
| Disallow | /Bewerben |
| Disallow | /OfferDetail |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /*?search= |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
| Allow | / |
psbot
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /application |
| Disallow | /search |
| Disallow | /Search |
| Disallow | /Lead |
| Disallow | /Toolbar |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/NotedOffers |
| Disallow | /UserFeature/RecentOffers |
| Disallow | /UserFeature/LastSearches |
| Disallow | /UserFeature/UseResponsiveness |
| Disallow | /Bewerben |
| Disallow | /OfferDetail |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
| Allow | / |
lycos_spider_(t-rex)
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /application |
| Disallow | /search |
| Disallow | /Search |
| Disallow | /Lead |
| Disallow | /Toolbar |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/NotedOffers |
| Disallow | /UserFeature/RecentOffers |
| Disallow | /UserFeature/LastSearches |
| Disallow | /UserFeature/UseResponsiveness |
| Disallow | /Bewerben |
| Disallow | /OfferDetail |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /*?search= |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /api |
| Disallow | /application |
| Disallow | /search |
| Disallow | /Bewerben |
| Disallow | /OfferDetail |
| Disallow | /CachedImage |
| Disallow | /RecentSearch |
| Disallow | /*?search= |
| Disallow | /Tracking/ |
| Disallow | /offerdetailsuggestedjobs |
Comments