meijborg.nl
robots.txt

Robots Exclusion Standard data for meijborg.nl

Resource Scan

Scan Details

Site Domain meijborg.nl
Base Domain meijborg.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-19T02:38:43+00:00
Next Scan 2025-07-18T02:38:43+00:00

Last Successful Scan

Scanned2024-08-30T02:23:45+00:00
URL https://meijborg.nl/robots.txt
Domain IPs 141.193.213.10, 141.193.213.11
Response IP 141.193.213.10
Found Yes
Hash 0f3f1b9b8be0ed0d204335a447494694274435c24a2255d7f148ec0d1952fbdf
SimHash 60008b126731

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Allow /