jobs-ostfriesland.de
robots.txt
Robots Exclusion Standard data for jobs-ostfriesland.de
Resource Scan
Scan Details
| Site Domain | jobs-ostfriesland.de |
| Base Domain | jobs-ostfriesland.de |
| Scan Status | Ok |
| Last Scan | 2024-11-02T02:35:08+00:00 |
| Next Scan | 2024-11-09T02:35:08+00:00 |
Last Scan
| Scanned | 2024-11-02T02:35:08+00:00 |
| URL | https://jobs-ostfriesland.de/robots.txt |
| Redirect | https://www.jobs-ostfriesland.de/robots.txt |
| Redirect Domain | www.jobs-ostfriesland.de |
| Redirect Base | jobs-ostfriesland.de |
| Domain IPs | 213.157.3.157 |
| Redirect IPs | 213.157.3.157 |
| Response IP | 213.157.3.157 |
| Found | Yes |
| Hash | 78ebedf2e1a98fac3065758f5ae71e2f32bd0e05f63e4cf4a4d9eadf49116ca8 |
| SimHash | 0150d5997157 |
Groups
msnbot
| Rule | Path |
|---|---|
| Disallow | /Search |
| Disallow | /Lead |
| Disallow | /Toolbar |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/NotedOffers |
| Disallow | /UserFeature/RecentOffers |
| Disallow | /UserFeature/LastSearches |
| Allow | / |
slurp
| Rule | Path |
|---|---|
| Disallow | /Search |
| Disallow | /Lead |
| Disallow | /Toolbar |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/NotedOffers |
| Disallow | /UserFeature/RecentOffers |
| Disallow | /UserFeature/LastSearches |
| Allow | / |
teoma
| Rule | Path |
|---|---|
| Disallow | /Search |
| Disallow | /Lead |
| Disallow | /Toolbar |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/NotedOffers |
| Disallow | /UserFeature/RecentOffers |
| Disallow | /UserFeature/LastSearches |
| Allow | / |
ia_archiver
| Rule | Path |
|---|---|
| Disallow | /Search.aspx |
| Disallow | /Search |
| Disallow | /Lead |
| Disallow | /Toolbar |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/NotedOffers |
| Disallow | /UserFeature/RecentOffers |
| Disallow | /UserFeature/LastSearches |
| Allow | / |
yahoo-mmcrawler
| Rule | Path |
|---|---|
| Disallow | /Search |
| Disallow | /Lead |
| Disallow | /Toolbar |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/NotedOffers |
| Disallow | /UserFeature/RecentOffers |
| Disallow | /UserFeature/LastSearches |
| Allow | / |
psbot
| Rule | Path |
|---|---|
| Disallow | /Search |
| Disallow | /Lead |
| Disallow | /Toolbar |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/NotedOffers |
| Disallow | /UserFeature/RecentOffers |
| Disallow | /UserFeature/LastSearches |
| Allow | / |
lycos_spider_(t-rex)
| Rule | Path |
|---|---|
| Disallow | /Search |
| Disallow | /Lead |
| Disallow | /Toolbar |
| Disallow | /Error |
| Disallow | /Partner |
| Disallow | /UserFeature/NotedOffers |
| Disallow | /UserFeature/RecentOffers |
| Disallow | /UserFeature/LastSearches |
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | / |
Warnings
- 1 invalid line.