[py] [test] expect a small rounding error when using double precision