Project

General

Profile

Actions
Copy link

Bug #10271

closed

Bridge can not upload large job archives

Added by Evgeny Novikov over 4 years ago. Updated over 4 years ago.

Status:
Closed
Priority:
Immediate
Assignee:
Vladimir Gratinskiy
Category:
Bridge
Target version:
3.0
Start date:
04/15/2020
Due date:
% Done:

0%

Estimated time:
Detected in build:
git
Platform:
Published in build:

Description

Bridge either uploads them very slowly that is an obvious performance regression or even hangs completely. Anyway we need to fix this issue before releasing Klever 3.0.

In addition, I suggest to increase a default timeout in "klever/deploys/systemd/conf.d/klever-celery.conf" from 15 minutes to 24 hours like we already did for handling server requests.

Actions
Copy link
 #1

Updated by Evgeny Novikov over 4 years ago

  • Status changed from New to Resolved

Vladimir fixed the issue in branch bridge-jobs-upload. So, the large archive was uploaded ~12 times faster. Now it takes ~7 minutes to upload an archive of large enough lightweight jobs. The branch is under testing.

Actions
Copy link
 #2

Updated by Evgeny Novikov over 4 years ago

  • Status changed from Resolved to Closed

I tested the branch and revealed no errors, so, I merged the branch to master in 827bbd31b. I would like to add that uploading an archive of job for which original sources were already uploaded takes ~2 times less time.

Actions
Copy link

Also available in: Atom PDF