synoniemen.net
robots.txt
Robots Exclusion Standard data for synoniemen.net
Resource Scan
Scan Details
Site Domain | synoniemen.net |
Base Domain | synoniemen.net |
Scan Status | Ok |
Last Scan | 2024-11-09T13:32:54+00:00 |
Next Scan | 2024-11-16T13:32:54+00:00 |
Last Scan
Scanned | 2024-11-09T13:32:54+00:00 |
URL | https://synoniemen.net/robots.txt |
Domain IPs | 178.79.179.78, 2a01:7e00::f03c:91ff:fedf:ddac |
Response IP | 178.79.179.78 |
Found | Yes |
Hash | eb4c3e5524e5e803873b872bc907a0e5bbd70a1d239567dcf85d26fa5a7e396a |
SimHash | a83ccc20c723 |
Groups
*
Rule | Path |
---|---|
Disallow | /m/ |
Disallow | /mobile/ |
Disallow | /test/ |
Disallow | /beheer/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |