Bug #718
closedError trace visualizer misses some sources [capidrv]
Added by Alexey Khoroshilov over 13 years ago. Updated over 13 years ago.
0%
Description
The ldv-git command below detects an error but error trace visualizer is almost useless since the only sources loaded are slab.h and proc_fs.h.
ldv-git --force --no-update-meta --keep-work --rule=08_1 --filter=isdn/capi/capidrv check
Any intermediate files can help?
Files
Updated by Pavel Shved over 13 years ago
Could you please attach the pax file the uploader tried to upload? It looks like this: $LDVGIT_BASE/envs/1/work-815c4163b6c8ebf8152f42b0a5fd015cfdcedc78/drivers/acpi/apei/erst.c/finished/current--X--commands-xml--X--defaultshadows--X--32_1--X--77_1--X--08_1--X--29_1--X--37_1--X--43_1.pax.
Version of ldv-tools and the Kernel commit you're checking would be useful as well, of course.
Updated by Alexey Khoroshilov over 13 years ago
- File current--X--commands-xml--X--defaultshadows--X--RCU_1.pax added
Upload the requested file. [WRONG FILE]
Updated by Alexey Khoroshilov over 13 years ago
- File deleted (
current--X--commands-xml--X--defaultshadows--X--RCU_1.pax)
Updated by Alexey Khoroshilov over 13 years ago
- File current--X--commands-xml--X--defaultshadows--X--08_1.pax current--X--commands-xml--X--defaultshadows--X--08_1.pax added
Upload the requested file. [CORRECT FILE]
Updated by Evgeny Novikov over 13 years ago
- File report.xml report.xml added
I obtained the full list of required source code files (it's attached) from our nice testing tool checkdb:
DBNAME=ldv_db_3 DBUSER=joker checkdb.pl -c report.xml
Note that the trace depend on 2 c.p files placed to different folders. May be this causes the problem.
Updated by Pavel Shved over 13 years ago
- File current--X--commands-xml--X--defaultshadows--X--08_1.report.xml current--X--commands-xml--X--defaultshadows--X--08_1.report.xml added
- File capidrv.ko.linked.ldv_main0_plain_sorted_withcheck.trace capidrv.ko.linked.ldv_main0_plain_sorted_withcheck.trace added
- Category set to Infrastructure
- Status changed from New to Open
- Assignee set to Evgeny Novikov
I guess this is the issue of error-trace-visualizer's subcomponent that extracts list of sources from a trace.
The report doesn't contain any <sourcefile> tag. In such cases, uploader just assigns all sources to the file... however, there are only two sources in the PAX:
./current--X--commands-xml--X--defaultshadows--X--08_1.report.xml ./sources/artificial_env_1/home/tester/.ldv/ldv/envs/1/shadows/include/linux/proc_fs.h ./sources/artificial_env_1/home/tester/.ldv/ldv/envs/1/shadows/include/linux/slab.h ./traces/artificial_env_1/csd_deg_dscv/22/dscv_tempdir/dscv/cmdfiles/rcv/08_1/reports/capidrv.ko.linked.ldv_main0_plain_sorted_withcheck.trace
while there are a lot of them in the trace!
$ grep 'src=".*"' --only-match <trace_file | sort -u src="/home/tester/.ldv/ldv/envs/1/shadows/include/linux/module.h" src="/home/tester/.ldv/ldv/envs/1/shadows/include/linux/proc_fs.h" src="/home/tester/.ldv/ldv/envs/1/shadows/include/linux/slab.h" src="/home/tester/.ldv/ldv/envs/1/shadows/include/linux/slub_def.h" src="/home/tester/.ldv/ldv/envs/1/work/work-4162cf64973df51fc885825bc9ca4d055891c49f/drivers/isdn/capi/capidrv.c/work/current--X--commands.xml--X--defaultshadows--X--08_1/artificial_env_1/csd_deg_dscv/22/dscv_tempdir/dscv/cmdfiles/rcv/08_1/preprocessed/capidrv.ko.linked.cbe.i" src="/home/tester/.ldv/ldv/envs/1/work/work-4162cf64973df51fc885825bc9ca4d055891c49f/drivers/isdn/capi/capidrv.c/work/current--X--commands.xml--X--defaultshadows--X--08_1/artificial_env_1/csd_deg_dscv/22/dscv_tempdir/dscv/ri/08_1/capidrv.ko.linked.cbe.c" src="/home/tester/.ldv/ldv/envs/1/work/work-4162cf64973df51fc885825bc9ca4d055891c49f/drivers/isdn/capi/capidrv.c/work/current--X--commands.xml--X--defaultshadows--X--08_1/artificial_env_1/csd_deg_dscv/22/dscv_tempdir/dscv/ri/08_1/drivers/isdn/capi/capidrv.c.p" src="/home/tester/.ldv/ldv/envs/1/work/work-4162cf64973df51fc885825bc9ca4d055891c49f/drivers/isdn/capi/capidrv.c/work/current--X--commands.xml--X--defaultshadows--X--08_1/artificial_env_1/csd_deg_dscv/22/dscv_tempdir/dscv/ri/08_1/kernel-rules/files/engine-blast-assert.h" src="/home/tester/.ldv/ldv/envs/1/work/work-4162cf64973df51fc885825bc9ca4d055891c49f/drivers/isdn/hardware/avm/c4.c/work/current--X--commands.xml--X--defaultshadows--X--08_1--X--29_1--X--32_7--X--37_1--X--43_1--X--77_1--X--RCU_1/artificial_env_1/csd_deg_dscv/13/dscv_tempdir/dscv/ri/08_1/drivers/isdn/capi/kcapi.c.p"
Updated by Alexey Khoroshilov over 13 years ago
Updated by Alexey Khoroshilov over 13 years ago
- File cmd_after_deg.xml cmd_after_deg.xml added
Updated by Evgeny Novikov over 13 years ago
Attached log contains following lines:
ldv-task: NORMAL: Calling LDV reporter. error-trace-visualizer: NORMAL: Process the command-line options. error-trace-visualizer: NORMAL: Process trace. error-trace-visualizer: NORMAL: Make all successfully. ldv-task-reporter: NORMAL: Can't find kernel file.ldv-task-reporter: NORMAL: Report created successfully. ldv-task: IFNO: Remove all artificial environments.
Rather obscure...
Seems that problem connected with RI caching.
Updated by Pavel Shved over 13 years ago
Eugene Novikov wrote:
Rather obscure...
Seems that problem connected with RI caching.
"Seems"? :-D
I guess, it's obiovus! :-D
Updated by Evgeny Novikov over 13 years ago
Can you obtain log with LDV_DEBUG=100? Do you use fresh master?
Updated by Evgeny Novikov over 13 years ago
I'll try to obtain this by myself since you point the way to do this.
Updated by Alexey Khoroshilov over 13 years ago
Updated by Evgeny Novikov over 13 years ago
- Status changed from Open to Feedback
- kcapi.o.usual (it's successfully got from cache)
rule-instrumentor: DEBUG: The target file cache key is '/drivers/isdn/capi/kcapi.o.usual'. rule-instrumentor: TRACE: Find in cache '/home/tester/.ldv/ldv/envs/1/work/work-4162cf64973df51fc885825bc9ca4d055891c49f/drivers/isdn/capi/capidrv.c/work/current--X--commands.xml--X--defaultshadows--X--08_1/artificial_env_1/csd_deg_dscv/22/dscv_tempdir/dscv/ri/08_1/drivers/isdn/capi/kcapi.o.usual' with keys '08_1 /drivers/isdn/capi/kcapi.o.usual'. rule-instrumentor: TRACE: Cache hit. rule-instrumentor: INFO: Got file from cache instead of executing '...'.
- kcapi.c.p (it isn't got from cache)
rule-instrumentor: DEBUG: The target file cache key is '/drivers/isdn/capi/kcapi.c.p'. rule-instrumentor: TRACE: Find in cache '/home/tester/.ldv/ldv/envs/1/work/work-4162cf64973df51fc885825bc9ca4d055891c49f/drivers/isdn/capi/capidrv.c/work/current--X--commands.xml--X--defaultshadows--X--08_1/artificial_env_1/csd_deg_dscv/22/dscv_tempdir/dscv/ri/08_1/drivers/isdn/capi/kcapi.c.p' with keys '08_1 /drivers/isdn/capi/kcapi.c.p'. rule-instrumentor: TRACE: Cache miss.
Then this leads to the another problem that I have partially described above:ldv-task-reporter: TRACE: Process trace file: /home/tester/.ldv/ldv/envs/1/work/work-4162cf64973df51fc885825bc9ca4d055891c49f/drivers/isdn/hardware/avm/c4.c/work/current--X--commands.xml--X--defaultshadows--X--08_1--X--29_1--X--32_7--X--37_1--X--43_1--X--77_1--X--RCU_1/artificial_env_1/csd_deg_dscv/13/dscv_tempdir/dscv/ri/08_1/drivers/isdn/capi/kcapi.c.p ldv-task-reporter: NORMAL: Can't find kernel file.
So we either may to change scripts to support backward compatibility of caching (i.e. see on both object and source code files in cache before using them) or remove old cache.
But I still need some proof of my assumptions. Alexey, can you delete the only file /home/tester/.ldv/ldv/envs/1/work/work-4162cf64973df51fc885825bc9ca4d055891c49f/drivers/isdn/capi/capidrv.c/work/current--X--commands.xml--X--defaultshadows--X--08_1/artificial_env_1/csd_deg_dscv/22/dscv_tempdir/dscv/ri/08_1/drivers/isdn/capi/kcapi.c.p' with keys '08_1 /drivers/isdn/capi/kcapi.c.p and obtain the detailed log one more time?
Also it seems to me that ldv-task-reporter should be fixed a bit: when it can't copy one of many required files it should try to copy other ones.
Updated by Pavel Shved over 13 years ago
Eugene Novikov wrote:
But I still need some proof of my assumptions. Alexey, can you delete the only file /home/tester/.ldv/ldv/envs/1/work/work-4162cf64973df51fc885825bc9ca4d055891c49f/drivers/isdn/capi/capidrv.c/work/current--X--commands.xml--X--defaultshadows--X--08_1/artificial_env_1/csd_deg_dscv/22/dscv_tempdir/dscv/ri/08_1/drivers/isdn/capi/kcapi.c.p' with keys '08_1 /drivers/isdn/capi/kcapi.c.p and obtain the detailed log one more time?
I guess, the second file Eugene meant is named
/home/tester/.ldv/ldv/envs/1/cache/cache-4162cf64973df51fc885825bc9ca4d055891c49f/08_1/drivers/isdn/capi/kcapi.c.p
right?
Updated by Evgeny Novikov over 13 years ago
Ooo! I wrote completely incorrectly!!! Thank you! Please delete the file /home/tester/.ldv/ldv/envs/1/cache/cache-4162cf64973df51fc885825bc9ca4d055891c49f/08_1/drivers/isdn/capi/kcapi.o.usual (it's the object file, there isn't specified previously source code file in cache at all!).
Updated by Vadim Mutilin over 13 years ago
Is here the same problem?
Updated by Pavel Shved over 13 years ago
Hmm.... my cache is filled with *.c.p files, so it might be another problem, actually.
Could you please write such errorneous URLs down for us to analyze them thoroughly later?
Updated by Alexey Khoroshilov over 13 years ago
Updated by Evgeny Novikov over 13 years ago
Yes, after the object file removal it's processed and the required source code file is obtained (not from cache, just from aspectator). Then they both are cached and it's most likely that they'll be successfully got from cache in future.
Unfortunately the verdict becomes unknown due to memory limit (why so?..) and we can't see the progress with help of error trace visualizer...
It would be nice if you set up more memory limit and see on progress with error trace visualizer. Then remove old cache (see issue #724) and try again. After all there must be no problems.
Updated by Evgeny Novikov over 13 years ago
Eugene Novikov wrote:
Unfortunately the verdict becomes unknown due to memory limit (why so?..) and we can't see the progress with help of error trace visualizer...
It would be nice if you set up more memory limit and see on progress with error trace visualizer.
Oh, I see the memory limit is large enough (3Gb)... Something strange...
Updated by Vadim Mutilin over 13 years ago
- Without code sources
- No some sources
- Links to the code on the left hand side disappear after loading
2. No some sources
is_state_active_or_queued
http://shved:8999/stats/errortrace/profilename/git/name/ldv_git/user/pavel/host/localhost/password/no/page/Error+trace/value/13677/Task+name/Kernel-59365d136d205cc20fe666ca7f89b1c5001b0d5a/Environment+version/artificial_env_1/Rule+name/43_1/Module/bttv-vbi.ko/Entry+point/ldv_main0_plain_sorted_withcheck
3. Links on the left hand side disappear
Updated by Alexey Khoroshilov over 13 years ago
Feedback is blocked by bug#749.
Updated by Alexey Khoroshilov over 13 years ago
- Status changed from Feedback to Closed
I have checked capidrv with 08_1 and it is safe now.
Since the issue with cache has been fixed, I close the bug.