Skip to content

Precision is being lost somewhere #602

Open
@WhiteBlackGoose

Description

@WhiteBlackGoose
In[21:18:52] = MathS.Settings.DecimalPrecisionContext.Set(EContext(1000, ERounding.Hal

╭─Ok──────────────────────────────────────────────────────────────────────────────────╮
│ AngouriMath.Convenience.Setting`1+AutoBackRollableTemporarySettingUnit[             │
│ PeterO.Numbers.EContext]                                                            │
╰─────────────────────────────────────────────────────────────────────────────────────╯

In[21:18:59] = "e ^ (-5.4 - 6.3 * 6.56)" |> eval

╭─Ok──────────────────────────────────────────────────────────────────────────────────╮
│ 0                                                                                   │
╰─────────────────────────────────────────────────────────────────────────────────────╯

Metadata

Metadata

Assignees

No one assigned

    Labels

    BugA serious math/runtime error

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions