Skip to content

Quickchecks don't execute unless --compare=jit #2970

@dank-openai

Description

@dank-openai

Describe the bug
Quickchecks don't execute unless --compare=jit.

Why would I want to slow down quickcheck execution by running it twice (interpreted and jit), and using the slow interpreter? What if I trust that JIT is correct and I just want to execute my quickcheck 4 billion times, as quickly as possible?

To Reproduce

  1. Make a file with a quickcheck in it, name it foo.x
  2. dslx_interpreter_main-arm64 --evaluator ir-jit foo.x, observe: [ SKIPPING QUICKCHECKS ] (JIT is disabled). Also skips quickchecks: --compare=none --evaluator ir-jit
  3. dslx_interpreter_main-arm64 --compare=jit foo.x, observe RUN QUICKCHECK
  4. Note that if you supply both flags, that's rejected: --compare flag is only supported on --evaluator=dslx-interpreter

Expected behavior
I would expect that executing quickchecks as quickly as possible (i.e. with evaluator=jit and compare disabled) to be encouraged and accepted. I don't want to compare the interpreter against the JIT, that's just massively slowing things down.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions