lohntastik.de
robots.txt
Robots Exclusion Standard data for lohntastik.de
Resource Scan
Scan Details
| Site Domain | lohntastik.de |
| Base Domain | lohntastik.de |
| Scan Status | Ok |
| Last Scan | 2024-11-15T22:07:11+00:00 |
| Next Scan | 2024-11-22T22:07:11+00:00 |
Last Scan
| Scanned | 2024-11-15T22:07:11+00:00 |
| URL | https://lohntastik.de/robots.txt |
| Domain IPs | 217.160.69.61 |
| Response IP | 217.160.69.61 |
| Found | Yes |
| Hash | 1ed3564df44dcddcf0934651faa9cf8b615088e45b9f83ee255155b3c1c78fe0 |
| SimHash | e60c90f0ef90 |
Groups
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 240 |
*
| Rule | Path |
|---|---|
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | /sgns/ |
| Disallow | /cu/ |
| Disallow | /od_sim* |
| Disallow | /od-tables |
| Disallow | /od-adv-tables |
Other Records
| Field | Value |
|---|---|
| sitemap | https://lohntastik.de/sitemaps/sitemap.xml |
| sitemap | https://lohntastik.de/sitemaps/gns.xml |
| sitemap | https://lohntastik.de/sitemaps/salary_search_sitemap.xml |
| sitemap | https://lohntastik.de/sitemaps/TVL-TVoeD.xml |