technicabv.nl
robots.txt

Robots Exclusion Standard data for technicabv.nl

Resource Scan

Scan Details

Site Domain technicabv.nl
Base Domain technicabv.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-06-24T11:52:22+00:00
Next Scan 2025-07-01T11:52:22+00:00

Last Successful Scan

Scanned2025-06-16T11:50:23+00:00
URL https://technicabv.nl/robots.txt
Redirect https://www.technicabv.nl/robots.txt
Redirect Domain www.technicabv.nl
Redirect Base technicabv.nl
Domain IPs 141.138.169.211, 2a03:3c00:a002:211::1000
Redirect IPs 141.138.169.211, 2a03:3c00:a002:211::1000
Response IP 141.138.169.211
Found Yes
Hash 3f5f6ad96b4b91396b8b32983d392b3f812938d5d9ce298a4f2c3fa658c96f58
SimHash 330dd8453493

Groups

*

Rule Path
Disallow /blackhole/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.technicabv.nl/sitemap.xml

Comments

  • robots.txt
  • Private pages
  • Directories