fussballnews.org
robots.txt
Robots Exclusion Standard data for fussballnews.org
Resource Scan
Scan Details
Site Domain | fussballnews.org |
Base Domain | fussballnews.org |
Scan Status | Ok |
Last Scan | 2024-06-21T23:31:33+00:00 |
Next Scan | 2024-06-28T23:31:33+00:00 |
Last Scan
Scanned | 2024-06-21T23:31:33+00:00 |
URL | https://fussballnews.org/robots.txt |
Domain IPs | 185.104.28.21 |
Response IP | 185.104.28.21 |
Found | Yes |
Hash | ea913c19af75c604bd2466601a91d1f2c5eafb9295b82fe17e92e4b7fee4f0cf |
SimHash | 6af87dd0f8f9 |
Groups
*
Rule | Path |
---|---|
Disallow | /images |
Disallow | /templates |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | http://www.fussballnews.org/sitemap.xml |
sitemap | http://www.fussballnews.org/articles.xml |
Warnings
- 2 invalid lines.