Skip to content

Commit 686870e

Browse files
Wording suggestion from Ali
Co-authored-by: Ali Maredia <[email protected]> Signed-off-by: Nathan Weinberg <[email protected]>
1 parent 1b40cb0 commit 686870e

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

docs/evaluation/eval-repo.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -16,8 +16,8 @@ closest implementation currently in `instructlab/instructlab` via the `ilab test
1616
a JSON Lines file and a LoRA adapter to compare output of a given model before and after
1717
LoRA training with MLX, thus the macOS M-series dependency.
1818

19-
We desire to build out an implementation closer to the described evaluation in the paper,
20-
using more high-level evaluation schemes such as
19+
We desire to build out a library for methods that satisfy the evaluation described in the
20+
paper, using more high-level evaluation schemes such as
2121
[Multi-turn Benchmark](https://arxiv.org/abs/2306.05685) for skills and
2222
[Massive Multitask Language Understanding](https://arxiv.org/abs/2009.03300) (MMLU) for
2323
knowledge. We propose a new repository to house this code that publishes a new Python

0 commit comments

Comments
 (0)