Feature #9567
closedUpdate BenchExec
0%
Description
At the moment Klever uses its own version of BenchExec based on BenchExec 1.16 (LDV-BenchExec) since at that time there wasn't an appropriate version in PyPI yet. Now there is BenchExec 1.18 available.
Updated by Ilja Zakharov over 5 years ago
Note, that you will need to do a minor refactoring of Klever components to support new formats updated in BenchExec. And doing this you will likely ignore VerifierCloud scheduler that work with verification tasks and results a bit differently. VerifierCloud is currently broken and you are unable to do testing until supporting the newest format of tasks for the cloud. Ideally it is better to solve these two tasks together.
Updated by Evgeny Novikov over 5 years ago
Ilja Zakharov wrote:
Note, that you will need to do a minor refactoring of Klever components to support new formats updated in BenchExec. And doing this you will likely ignore VerifierCloud scheduler that work with verification tasks and results a bit differently. VerifierCloud is currently broken and you are unable to do testing until supporting the newest format of tasks for the cloud. Ideally it is better to solve these two tasks together.
According to documentation it seems that the old format should be okay. This issue is for getting rid of redundant LDV-BenchExec primarily. Other issues should be fixed separately. BTW, there is already #9507 that touches exactly topics you talked about. There you said that using old scripts for accessing VerifierCloud is pretty well, so, this is not such the awful issue.
Updated by Evgeny Novikov over 5 years ago
- Blocks Feature #9507: Update VerifierCloud scheduler to the recent API added
Updated by Evgeny Novikov over 5 years ago
So, my plan is the following. First, switch to BenchExec 1.18 without any changes in the benchmark format (this issue, perhaps we will make some small tuning). Then, switch to the new format and to the new VerifierCloud scripts (#9507).
Updated by Evgeny Novikov over 5 years ago
- Status changed from New to Resolved
Trivially switched to BenchExec 1.18 in branch update-benchexec. Let's wait for test results.
Updated by Evgeny Novikov over 5 years ago
- Status changed from Resolved to Closed
Everything works nice. So, I merged the branch to master in ece7af172. I am going to drop LDV-BecnchExec on PyPI soon.
Everybody! Please, uninstall LDV-BenchExec from everywhere and switch to standard BenchExec 1.18.