Feat/tensor override

[dpmm99]

Based on the April_2025 branch. Should I rebase it?

Example usage:

var modelParams = new ModelParams(path)
{
    TensorBufferOverrides = [new Abstractions.TensorBufferOverride(".*ffn.*", "CPU")],
    GpuLayerCount = -1
};

would make all tensors with 'ffn' in their names offload to CPU, with everything else on GPU.

[martindevans]

Should I rebase it?

yes please, that'll remove a lot of noise from this PR and make it easier to review.

[dpmm99]

Should I rebase it?

yes please, that'll remove a lot of noise from this PR and make it easier to review.

Okay, done. But now it's going to show a conflict when you merge the Apr_2025 branch because they both "added" tensor_buft_overrides to LLamaModelParams. :P

[martindevans]

CI is failing due to ot being detected as a spelling error, just add a suppression for that.