Feature #9567
closed
Added by Evgeny Novikov over 5 years ago.
Updated over 5 years ago.
Description
At the moment Klever uses its own version of BenchExec based on BenchExec 1.16 (LDV-BenchExec) since at that time there wasn't an appropriate version in PyPI yet. Now there is BenchExec 1.18 available.
Note, that you will need to do a minor refactoring of Klever components to support new formats updated in BenchExec. And doing this you will likely ignore VerifierCloud scheduler that work with verification tasks and results a bit differently. VerifierCloud is currently broken and you are unable to do testing until supporting the newest format of tasks for the cloud. Ideally it is better to solve these two tasks together.
Ilja Zakharov wrote:
Note, that you will need to do a minor refactoring of Klever components to support new formats updated in BenchExec. And doing this you will likely ignore VerifierCloud scheduler that work with verification tasks and results a bit differently. VerifierCloud is currently broken and you are unable to do testing until supporting the newest format of tasks for the cloud. Ideally it is better to solve these two tasks together.
According to documentation it seems that the old format should be okay. This issue is for getting rid of redundant LDV-BenchExec primarily. Other issues should be fixed separately. BTW, there is already #9507 that touches exactly topics you talked about. There you said that using old scripts for accessing VerifierCloud is pretty well, so, this is not such the awful issue.
- Blocks Feature #9507: Update VerifierCloud scheduler to the recent API added
So, my plan is the following. First, switch to BenchExec 1.18 without any changes in the benchmark format (this issue, perhaps we will make some small tuning). Then, switch to the new format and to the new VerifierCloud scripts (#9507).
- Status changed from New to Resolved
Trivially switched to BenchExec 1.18 in branch update-benchexec. Let's wait for test results.
- Status changed from Resolved to Closed
Everything works nice. So, I merged the branch to master in ece7af172. I am going to drop LDV-BecnchExec on PyPI soon.
Everybody! Please, uninstall LDV-BenchExec from everywhere and switch to standard BenchExec 1.18.
Also available in: Atom
PDF