programmierfrage.com
robots.txt
Robots Exclusion Standard data for programmierfrage.com
Resource Scan
Scan Details
Site Domain | programmierfrage.com |
Base Domain | programmierfrage.com |
Scan Status | Ok |
Last Scan | 2024-09-25T09:50:50+00:00 |
Next Scan | 2024-10-02T09:50:50+00:00 |
Last Scan
Scanned | 2024-09-25T09:50:50+00:00 |
URL | https://programmierfrage.com/robots.txt |
Domain IPs | 104.21.72.186, 172.67.153.220, 2606:4700:3034::ac43:99dc, 2606:4700:3035::6815:48ba |
Response IP | 172.67.153.220 |
Found | Yes |
Hash | e72ce0d89972f7b6fdb7c3034e03da3ffabb81804daae66f913169e7cbf0fbe1 |
SimHash | 65199ce4c897 |
Groups
*
Rule | Path |
---|---|
Disallow | /jump.php |
Disallow | /useraction.php |
Disallow | /account/sign-up |
Disallow | /account/sign-in |
Disallow | /account/restore |
Disallow | /account |
Disallow | /index.php |
Disallow | /index.html |
Other Records
Field | Value |
---|---|
crawl-delay | 20 |
Other Records
Field | Value |
---|---|
sitemap | https://programmierfrage.com/sitemap.xml |
Warnings
- `host` is not a known field.