wget-dev
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

wget | Draft: Initial test for dynamic buffer size for downloads (!32)


From: Darshit Shah (@darnir)
Subject: wget | Draft: Initial test for dynamic buffer size for downloads (!32)
Date: Mon, 30 May 2022 18:22:45 +0000


Darshit Shah created a merge request: 
https://gitlab.com/gnuwget/wget/-/merge_requests/32

Branches: dynamic-buf-size to master
Author:   Darshit Shah
Assignee: Darshit Shah
Reviewer: Tim Rühsen


This is an initial implementation for a simple idea to improve the efficiency 
of Wget.

Currently, Wget uses a fixed size 8K buffer for downloading files. This is 
however quite small on fast connections and leads to very high CPU usage to 
excessive context switching.
So, the idea is to allow Wget to increase the buffer size upto a max of 8M 
(configurable), so as to more efficiently use the resources available on the 
user's system.

This is currently heavily in-progress. Just a first implementation. In fact, 
this will likely make gzipped downloads a little slower since the gzbuffer is 
not scaled proportionally to the download buffer. That would be a next step 
once everything else is ironed out.

-- 
Reply to this email directly or view it on GitLab: 
https://gitlab.com/gnuwget/wget/-/merge_requests/32
You're receiving this email because of your account on gitlab.com.




reply via email to

[Prev in Thread] Current Thread [Next in Thread]