autobutler.se
robots.txt

Robots Exclusion Standard data for autobutler.se

Resource Scan

Scan Details

Site Domain autobutler.se
Base Domain autobutler.se
Scan Status Ok
Last Scan2024-04-25T05:01:20+00:00
Next Scan 2024-05-25T05:01:20+00:00

Last Scan

Scanned2024-04-25T05:01:20+00:00
URL https://autobutler.se/robots.txt
Redirect https://www.autobutler.se/robots.txt
Redirect Domain www.autobutler.se
Redirect Base autobutler.se
Domain IPs 104.26.2.85, 104.26.3.85, 172.67.71.160, 2606:4700:20::681a:255, 2606:4700:20::681a:355, 2606:4700:20::ac43:47a0
Redirect IPs 104.26.2.85, 104.26.3.85, 172.67.71.160, 2606:4700:20::681a:255, 2606:4700:20::681a:355, 2606:4700:20::ac43:47a0
Response IP 172.67.71.160
Found Yes
Hash d042beca6f27e0c5c46d687ed5a6d6a998cdd8035754754870eca4fb8e37ea64
SimHash 100417106d51

Groups

*

Rule Path
Allow /
Disallow /documents/
Disallow /mechanics/new
Disallow /job_flow/job_tasks
Disallow /star_ratings

searchmetricsbot

Rule Path
Allow /

zookabot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.autobutler.se/sitemap.xml