dinetilbudsaviser.dk
robots.txt
Robots Exclusion Standard data for dinetilbudsaviser.dk
Resource Scan
Scan Details
Site Domain | dinetilbudsaviser.dk |
Base Domain | dinetilbudsaviser.dk |
Scan Status | Ok |
Last Scan | 2024-11-16T00:11:18+00:00 |
Next Scan | 2024-11-23T00:11:18+00:00 |
Last Scan
Scanned | 2024-11-16T00:11:18+00:00 |
URL | https://dinetilbudsaviser.dk/robots.txt |
Domain IPs | 104.21.36.107, 172.67.192.148, 2606:4700:3033::6815:246b, 2606:4700:3037::ac43:c094 |
Response IP | 104.21.36.107 |
Found | Yes |
Hash | a7b98fdfe4389c970c0602c872196c7267086889b097ae526ed5e8556ddc9abe |
SimHash | 04455c348993 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin |
Disallow | /n/* |
Disallow | *taghash* |
Disallow | *cutterhash* |
Disallow | *open-street-map* |
Disallow | /user* |
Disallow | *?*hash=* |
Other Records
Field | Value |
---|---|
sitemap | https://dinetilbudsaviser.dk/sitemap-index.xml |