File tree 1 file changed +2
-2
lines changed 1 file changed +2
-2
lines changed Original file line number Diff line number Diff line change @@ -16,8 +16,8 @@ closest implementation currently in `instructlab/instructlab` via the `ilab test
16
16
a JSON Lines file and a LoRA adapter to compare output of a given model before and after
17
17
LoRA training with MLX, thus the macOS M-series dependency.
18
18
19
- We desire to build out an implementation closer to the described evaluation in the paper,
20
- using more high-level evaluation schemes such as
19
+ We desire to build out a library for methods that satisfy the evaluation described in the
20
+ paper, using more high-level evaluation schemes such as
21
21
[ Multi-turn Benchmark] ( https://arxiv.org/abs/2306.05685 ) for skills and
22
22
[ Massive Multitask Language Understanding] ( https://arxiv.org/abs/2009.03300 ) (MMLU) for
23
23
knowledge. We propose a new repository to house this code that publishes a new Python
You can’t perform that action at this time.
0 commit comments