Incompatible with vitest 3

[dcramer]

TypeError: (intermediate value).onTaskUpdate is not a function
 ❯ EvaliteReporter.onTaskUpdate node_modules/.pnpm/evalite@0.10.0/node_modules/evalite/dist/reporter.js:439:15
 ❯ node_modules/.pnpm/vitest@3.1.1_@types+node@22.14.0_msw@2.7.3_@types+node@22.14.0_typescript@5.8.3__tsx@4.19.3_yaml@2.7.1/node_modules/vitest/dist/chunks/cli-api.bwYuoT4p.js:12863:56
 ❯ Vitest.report node_modules/.pnpm/vitest@3.1.1_@types+node@22.14.0_msw@2.7.3_@types+node@22.14.0_typescript@5.8.3__tsx@4.19.3_yaml@2.7.1/node_modules/vitest/dist/chunks/cli-api.bwYuoT4p.js:12863:36
 ❯ TestRun.updated node_modules/.pnpm/vitest@3.1.1_@types+node@22.14.0_msw@2.7.3_@types+node@22.14.0_typescript@5.8.3__tsx@4.19.3_yaml@2.7.1/node_modules/vitest/dist/chunks/cli-api.bwYuoT4p.js:11452:21
 ❯ Proxy.onTaskUpdate node_modules/.pnpm/vitest@3.1.1_@types+node@22.14.0_msw@2.7.3_@types+node@22.14.0_typescript@5.8.3__tsx@4.19.3_yaml@2.7.1/node_modules/vitest/dist/chunks/coverage.SfnlalVs.js:6771:24
 ❯ EventEmitter.onMessage node_modules/.pnpm/vitest@3.1.1_@types+node@22.14.0_msw@2.7.3_@types+node@22.14.0_typescript@5.8.3__tsx@4.19.3_yaml@2.7.1/node_modules/vitest/dist/chunks/index.68735LiX.js:91:29
 ❯ EventEmitter.emit node:events:519:28
 ❯ Object.postMessage node_modules/.pnpm/vitest@3.1.1_@types+node@22.14.0_msw@2.7.3_@types+node@22.14.0_typescript@5.8.3__tsx@4.19.3_yaml@2.7.1/node_modules/vitest/dist/chunks/coverage.SfnlalVs.js:6847:37
 ❯ ChildProcess.<anonymous> node_modules/.pnpm/tinypool@1.0.2/node_modules/tinypool/dist/index.js:216:30

[pablodecm]

Loving this tool for fast local prompt iterations @mattpocock, nice one!

Observed the same error, it actually works as expected but adds lots logs error to the console (one per case).

[mattpocock]

Thanks both! I will take a look.

[arnaugomez]

The error is thrown in this line:

evalite/packages/evalite/src/reporter.ts

Line 648 in 44c5238

super.onTaskUpdate(packs);

It is calling the onTaskUpdate method of the superclass (BaseReporter).

However, in Vitest 3, the BasicReporter superclass does not have the onTaskUpdate method. Neither does the BaseReporter superclass.

In Vitest 3, the onTaskUpdate method is optional.

Therefore, the solution could be to check if onTaskUpdate is a function before calling it.

super.onTaskUpdate?.(packs)

This would make it compatible with Vitest 2 and 3. I'll create a PR.

[mattpocock]

Yeah, this makes sense. There's a broader stream of work here to actually ditch the basic reporter and move to the base reporter. But for now, we should definitely remove those horrible logs.