Project

General

Profile

Actions

Feature #1639

closed

KB: KB verdicts and tags on main statistics page

Added by Alexey Khoroshilov almost 13 years ago. Updated over 12 years ago.

Status:
Closed
Priority:
High
Category:
Statistics server
Start date:
08/13/2011
Due date:
% Done:

0%

Estimated time:
Published in build:
ce382c6

Description

For example, KB verdicts can be implemented as a subdivision of UNSAFE column.

It would be good if a number of subcolumns is dynamic,
i.e. we do not show a subcolumn if all values in it are zero.

If there are no unsafes at all, the only UNSAFE column can be shown as we have it now.

KB tags can be visualized similar to how we visualize problems in our tools now.


Related issues 2 (0 open2 closed)

Blocked by Linux Driver Verification - Feature #1715: Extend KB cache with calculated verdictClosedEvgeny Novikov08/31/2011

Actions
Blocks Linux Driver Verification - Feature #2206: Release 0.01 version of LDV Analytics CenterClosedEvgeny Novikov01/16/2012

Actions
Actions #1

Updated by Evgeny Novikov almost 13 years ago

  • Category set to Statistics server
  • Status changed from New to Open
  • Assignee set to Evgeny Novikov

I just want to imagine what will happen if we will place KB tags in the way like problems at the beginning of the main statistics page near or under 'Unsafe' column... May be they should be hidden by default?
Moreover after all this statistics (both for verdict and for tags) should become links on corresponding pages with detailed information. For instance, show all unsafes from a given task with verdict 'True positive' and so on.

Actions #2

Updated by Pavel Shved almost 13 years ago

I'd like to see on the index page only the summaries. I.e. the columns like "tagged unsafes", "untagged unsafes", and "tagged non-unsafes", each linking to the proper auxillary page. I don't think that we really need tags on the front page.

Actions #3

Updated by Alexey Khoroshilov almost 13 years ago

Eugene Novikov wrote:

I just want to imagine what will happen if we will place KB tags in the way like problems at the beginning of the main statistics page near or under 'Unsafe' column...

Under UNSAFE column I expected to see KB verdicts only. KB tags should be in separate columns.

May be they should be hidden by default?

No, they should be available in our "default" profile, but they may be hidden in some of other predefined profiles.

Moreover after all this statistics (both for verdict and for tags) should become links on corresponding pages with detailed information. For instance, show all unsafes from a given task with verdict 'True positive' and so on.

That is definitely true.

Actions #4

Updated by Evgeny Novikov almost 13 years ago

  • Priority changed from Normal to High

Raise priority as we decided.

Actions #5

Updated by Pavel Shved almost 13 years ago

Okay, so at the meeting we had today, we agreed on the following initial design. After the "safe-unsafe-unknown" columns, there is a "cluster" of columns, just like for the other instruments, with such columns as "untagged unsafes", "false positives", "true positives", etc, and with "tags" laid out just like problems in the other instruments.

A potentially useful column "Missing unsafes" is discussed in feature #1708

Actions #6

Updated by Pavel Shved almost 13 years ago

  • Priority changed from High to Normal
Actions #7

Updated by Alexey Khoroshilov almost 13 years ago

  • Priority changed from Normal to High
Actions #8

Updated by Evgeny Novikov almost 13 years ago

  • Status changed from Open to Resolved

It's available in commit 60faf39 of knowledge-base-2 branch.

Actions #9

Updated by Pavel Shved almost 13 years ago

Accepted on demo 18. Will be closed as soon as KB is merged to master.

Actions #10

Updated by Alexey Khoroshilov almost 13 years ago

  • Status changed from Resolved to Open

Numbers for UNKNOWN column are calculated incorrectly. They do not include unsafes with implicit UNKNOWN status.

Actions #11

Updated by Evgeny Novikov almost 13 years ago

  • Status changed from Open to Feedback

I don't see where is the problem. Could you provide a link?

Actions #12

Updated by Evgeny Novikov almost 13 years ago

BTW, I just have noticed, that the numbers of unknowns for Index and for Unsafes pages don't coincide. For Unsafes this number is the number of unknowns + the number of non analyzed unsafes, for Index it's just the number of unknowns.

Actions #14

Updated by Evgeny Novikov almost 13 years ago

Sorry, I have read incorrectly (thought that explicit unknowns aren't counted).

Actions #15

Updated by Evgeny Novikov over 12 years ago

I understand that it's too easy to implement: the number of implicit Unknowns among Unsafes can be calculated as the total number of Unsafes minus the number of analyzed Unsafes (i.e. either True Positives, False Positives or Unknowns). We can do this directly in statistics visualizer, we shouldn't extend KB, KB cache, etc.

Actions #16

Updated by Evgeny Novikov over 12 years ago

Evgeny Novikov wrote:

I understand that it's too easy to implement: the number of implicit Unknowns among Unsafes can be calculated as the total number of Unsafes minus the number of analyzed Unsafes (i.e. either True Positives, False Positives or Unknowns). We can do this directly in statistics visualizer, we shouldn't extend KB, KB cache, etc.

Alexey suggested that we also shouldn't forget about a detailed list of Unknowns among Unsafes (it should include both explicit and implicit Unknowns).

Actions #17

Updated by Evgeny Novikov over 12 years ago

  • Status changed from Open to Resolved
  • Published in build set to ce382c6

Resolve the issue at last! Commit ce382c6 to master is tested now. Live demo of reference launches representation is available here. After testing and if there won't be any objections I'm going to deploy a new stats server on QA.
BTW, may be rename statistics server with LDV analytics server at the public level (i.e. change the title "Linux driver verification statistics" with "Linux driver verification analytics server"). After coming Knowledge Base, our server provides users not only with a statistics representation but also with some kind of analytics (I guess that analytics includes statistics).

Actions #18

Updated by Alexey Khoroshilov over 12 years ago

Evgeny Novikov wrote:

BTW, may be rename statistics server with LDV analytics server at the public level (i.e. change the title "Linux driver verification statistics" with "Linux driver verification analytics server"). After coming Knowledge Base, our server provides users not only with a statistics representation but also with some kind of analytics (I guess that analytics includes statistics).

I like 'LDV Analytics Server'/'Linux Driver Verification Analytics Server' name.

Actions #19

Updated by Evgeny Novikov over 12 years ago

Works on QA now, so the issue could be closed.

Actions #20

Updated by Evgeny Novikov over 12 years ago

Alexey, please verify and close the issue if all is okay.

Actions #21

Updated by Evgeny Novikov over 12 years ago

  • Status changed from Resolved to Closed
Actions

Also available in: Atom PDF