HOW-TO: Clone Folding Home?? Where to start, or how would you go about building a decentralized computational platform similar to Folding Home?

Hey all,

I have a business use case in which I will have both my API & a client (user facing) software application perform computational calculations like machine learning on analyzing files.

I gave the example of 'Folding Home' because its something that everyone knows about and is familiar with.

Use Case:

I have trained a machine learning model to perform computational calculations on various audio files. I am planning on making this available for clients to download as a local desktop application, or they can send their data to my server so that my server can 'crunch the numbers' for them.

Assumptions:

I assume that the clients will mostly be on laptops, and computers that are not very strong in computational power, and will likely benefit in both speed and experience from another party performing 'calculations' on their behalf.

​

Goals:

Sure I can build out a massive cloud GPU computational platform, but I'd like to allow other users to participate and help crunch the number just like we see at these applications:

• Folding@Home
• Golem – Global, Open Source, Decentralized super computer that anyone can access. It is made up from the combined power of users machines, from PC's to Data Centers.
• Backend.ai – A SaaS model which allows you to use their cloud GPU's to 'do work' on your task.
• ScyNet (github) – Decentralized network for creating and training autonomous AI agents

I would like users to download a software that I create called "Become a worker" or something like that. And then they can 'join' and give their computational CPU & GPU power to the network, computing tasks and analyzing numbers which will take the load off the weak puny laptops of the users.

​

Difficulties:

I am a very experienced C#, Java, GO, and least of all JavaScript (its to loosie goosey for my taste but I can work in it), I have no issue learning new languages and have worked in Python before. – I see all these other codebases and companies doing what I would like to do, but I am just not sure where to start with this? I have tried to google tutorials and articles, but am left with dead-ends. I have found these open-source libraies that may or may not be helpful which I can use to create this:

• Dipsy – Distributed and Parallel Computing with/for Python
• A research document which outlines 5 libraries here. (screenshot)

​

Questions:

If you were me, or tasked with this – how would you build it?

————-

I struggle to find example code. I suppose I can either:

• Trudge and fight through learning Dipsy
  • I am not sure where to begin, the documentation I am sure is fine, but I have no context for what I need to do, or how I should do it. Without seeing tutorials or full-blown examples (and here) I feel like I am shooting in the dark.
• Fork and Clone Golem
  • Not sure if this is possible, I'm sure it is but I am not sure what to do or what modifications I'd need to make

Does anyone have experience in this or can point me in the right direction?

THANKS!