Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl: the Markov chain saw
 
PerlMonks  

Re: Reverse download protocols

by jdporter (Paladin)
on Aug 30, 2021 at 15:01 UTC ( [id://11136215]=note: print w/replies, xml ) Need Help??


in reply to Reverse download protocols [solved]

I'm having trouble understanding your terminology. When you say you want to "push the downlink load even further", do you mean you want to reduce the downlink bandwidth requirement even further? e.g. reduce the downloaded file size more?

I'm not sure, but my guess is that the solution is probably rather domain dependent, and in particular depends on how much a priori knowledge is shared by both client and server. Any chunk of information that is already known to both could be "compressed" as a single short datum (e.g. UUID). For example - if the data being downloaded is always similar (e.g. genome sequence data, or astronomic imagery), then you could potentially always use the same dictionary, or set of dictionaries, for compression; then store those dictionaries on both client and server and not download it.

Is there a "sweet spot" for this? Not that I know of. You might have to determine one for your specific scenario statistically.

I reckon we are the only monastery ever to have a dungeon staffed with 16,000 zombies.

Replies are listed 'Best First'.
Re^2: Reverse download protocols
by tomasz (Acolyte) on Aug 30, 2021 at 15:10 UTC
    Of course reduction of down link is what I meant - corrected for you.

    And no shared information can be assumed. Think of it as operating on a popular download server, where the file to be downloaded can be anything.

      Can you explain what you mean by "questions" and "answers", and how those would affect the download?

        That's the whole thing, don't get me wrong... What are reasonable client questions here? The client has to guess the file. So it may ask for something like a hash (as in sha1). Then the server answers yes/no, or gives some hint. So it probably involves some hashing algorithm. I'm not sure...

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://11136215]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others avoiding work at the Monastery: (4)
As of 2024-04-25 18:54 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found