Project

General

Profile

Feature #9567

Update BenchExec

Added by Evgeny Novikov about 2 months ago. Updated about 1 month ago.

Status:
Closed
Priority:
Urgent
Category:
Addons
Target version:
Start date:
03/26/2019
Due date:
% Done:

0%

Estimated time:
Published in build:

Description

At the moment Klever uses its own version of BenchExec based on BenchExec 1.16 (LDV-BenchExec) since at that time there wasn't an appropriate version in PyPI yet. Now there is BenchExec 1.18 available.


Related issues

Blocks Klever - Feature #9507: Update VerifierCloud scheduler to the recent APINew02/27/2019

Actions

History

#1

Updated by Ilja Zakharov about 2 months ago

Note, that you will need to do a minor refactoring of Klever components to support new formats updated in BenchExec. And doing this you will likely ignore VerifierCloud scheduler that work with verification tasks and results a bit differently. VerifierCloud is currently broken and you are unable to do testing until supporting the newest format of tasks for the cloud. Ideally it is better to solve these two tasks together.

#2

Updated by Evgeny Novikov about 2 months ago

Ilja Zakharov wrote:

Note, that you will need to do a minor refactoring of Klever components to support new formats updated in BenchExec. And doing this you will likely ignore VerifierCloud scheduler that work with verification tasks and results a bit differently. VerifierCloud is currently broken and you are unable to do testing until supporting the newest format of tasks for the cloud. Ideally it is better to solve these two tasks together.

According to documentation it seems that the old format should be okay. This issue is for getting rid of redundant LDV-BenchExec primarily. Other issues should be fixed separately. BTW, there is already #9507 that touches exactly topics you talked about. There you said that using old scripts for accessing VerifierCloud is pretty well, so, this is not such the awful issue.

#3

Updated by Evgeny Novikov about 2 months ago

  • Blocks Feature #9507: Update VerifierCloud scheduler to the recent API added
#4

Updated by Evgeny Novikov about 2 months ago

So, my plan is the following. First, switch to BenchExec 1.18 without any changes in the benchmark format (this issue, perhaps we will make some small tuning). Then, switch to the new format and to the new VerifierCloud scripts (#9507).

#5

Updated by Evgeny Novikov about 1 month ago

  • Status changed from New to Resolved

Trivially switched to BenchExec 1.18 in branch update-benchexec. Let's wait for test results.

#6

Updated by Evgeny Novikov about 1 month ago

  • Status changed from Resolved to Closed

Everything works nice. So, I merged the branch to master in ece7af172. I am going to drop LDV-BecnchExec on PyPI soon.

Everybody! Please, uninstall LDV-BenchExec from everywhere and switch to standard BenchExec 1.18.

Also available in: Atom PDF