Project

General

Profile

Bug #10271

Bridge can not upload large job archives

Added by Evgeny Novikov 9 months ago. Updated 7 months ago.

Status:
Closed
Priority:
Immediate
Category:
Bridge
Target version:
Start date:
04/15/2020
Due date:
% Done:

0%

Estimated time:
Detected in build:
git
Platform:
Published in build:

Description

Bridge either uploads them very slowly that is an obvious performance regression or even hangs completely. Anyway we need to fix this issue before releasing Klever 3.0.

In addition, I suggest to increase a default timeout in "klever/deploys/systemd/conf.d/klever-celery.conf" from 15 minutes to 24 hours like we already did for handling server requests.

History

#1

Updated by Evgeny Novikov 7 months ago

  • Status changed from New to Resolved

Vladimir fixed the issue in branch bridge-jobs-upload. So, the large archive was uploaded ~12 times faster. Now it takes ~7 minutes to upload an archive of large enough lightweight jobs. The branch is under testing.

#2

Updated by Evgeny Novikov 7 months ago

  • Status changed from Resolved to Closed

I tested the branch and revealed no errors, so, I merged the branch to master in 827bbd31b. I would like to add that uploading an archive of job for which original sources were already uploaded takes ~2 times less time.

Also available in: Atom PDF