I had the same, but found a workaround here
Basically, you modify llama.go#L37-L38 to remove -D__ARM_FEATURE_MATMUL_INT8
-D__ARM_FEATURE_MATMUL_INT8
Are you sure you want to hide this comment? It will become hidden in your post, but will still be visible via the comment's permalink.
Hide child comments as well
Confirm
For further actions, you may consider blocking this person and/or reporting abuse
We're a place where coders share, stay up-to-date and grow their careers.
I had the same, but found a workaround here
Basically, you modify llama.go#L37-L38 to remove
-D__ARM_FEATURE_MATMUL_INT8