autobutler.dk
robots.txt

Robots Exclusion Standard data for autobutler.dk

Resource Scan

Scan Details

Site Domain autobutler.dk
Base Domain autobutler.dk
Scan Status Ok
Last Scan2026-01-22T10:33:14+00:00
Next Scan 2026-02-21T10:33:14+00:00

Last Scan

Scanned2026-01-22T10:33:14+00:00
URL https://autobutler.dk/robots.txt
Redirect https://www.autobutler.dk/robots.txt
Redirect Domain www.autobutler.dk
Redirect Base autobutler.dk
Domain IPs 104.26.8.87, 104.26.9.87, 172.67.71.94, 2606:4700:20::681a:857, 2606:4700:20::681a:957, 2606:4700:20::ac43:475e
Redirect IPs 104.26.8.87, 104.26.9.87, 172.67.71.94, 2606:4700:20::681a:857, 2606:4700:20::681a:957, 2606:4700:20::ac43:475e
Response IP 172.67.71.94
Found Yes
Hash b6f832bed160f75087b1bb9eb549dc9281c304190d906aa6a18d8008b90c33aa
SimHash 000c1710f941

Groups

*

Rule Path
Allow /
Disallow /documents/
Disallow /mechanics/new
Disallow /job_flow/job_tasks
Disallow /star_ratings

searchmetricsbot

Rule Path
Allow /

zookabot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.autobutler.dk/sitemap.xml