oberberg.tv
robots.txt
Robots Exclusion Standard data for oberberg.tv
Resource Scan
Scan Details
Site Domain | oberberg.tv |
Base Domain | oberberg.tv |
Scan Status | Ok |
Last Scan | 2024-10-05T09:23:13+00:00 |
Next Scan | 2024-10-12T09:23:13+00:00 |
Last Scan
Scanned | 2024-10-05T09:23:13+00:00 |
URL | https://www.oberberg.tv/robots.txt |
Domain IPs | 87.106.14.51 |
Response IP | 87.106.14.51 |
Found | Yes |
Hash | b27709c99de1cfe20643dad94bc00fa84b2ca3a0f6178c13760c890e8a770007 |
SimHash | 22b015784e00 |
Groups
*
Rule | Path |
---|---|
Disallow | / |
Allow | /*.html* |
Allow | /index.php* |
Allow | /images/ |
Allow | /pics/ |
Allow | /files/*.pdf* |
Allow | /$ |
googlebot-image/1.0
Rule | Path |
---|---|
Disallow | / |
Allow | /*.html* |
Allow | /index.php* |
Allow | /images/ |
Allow | /pics/ |
Allow | /files/*.jpg |
Allow | /files/*.png |
Allow | /$ |
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Warnings
- 2 invalid lines.
Comments