Open
Description
As observed in #583 there's some weird errors with small-sized solves of integer matrices. For example:
julia> m = 2
a = SMatrix{m,m}(rand(Int,m,m))
b = SVector{m}(rand(Int,m))
2-element SArray{Tuple{2},Int64,1,2} with indices SOneTo(2):
8315397486252833078
-1243568792894157487
julia> Matrix(a) \ Vector(b)
2-element Array{Float64,1}:
-1.0427738899729126
0.5986498869255282
julia> a \ b
2-element SArray{Tuple{2},Float64,1,2} with indices SOneTo(2):
4.043446204424333e-20
8.620209721520739e-20
The underlying cause seems to be integer overflow in some specialized _solve
functions. For example due using integer arithmetic here:
Line 10 in 973a709
CC @judober