Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

distcc like framework for Windows [closed]

We are running some heavy computations that can take a lot of time (even days). We have an architecture similar to that of a compiler (compiler + linker):

  • many blocks of data that need to be computed (they are computed by a solver.exe executable) - similar to a compiler
  • a gatherer application that combines all the results into the final form - similar to a linker

What I saw is that distcc does the distribution over the network quite nicely. Unfortunately distcc works under unix environment.

Is there a platform that can provide something similar to what distcc does, but under Windows (7+) platform?

LATER EDIT: Added C++ tag because if such framework exists we would benefit from our C++ coding experience.

like image 621
INS Avatar asked Mar 12 '26 00:03

INS


1 Answers

FastBuild is free and opensource. It is available for Windows/Linux/OSX. It has its own language for build config files. You can setup workers on local network and a client that connects to workers and delivers work to them.

FastBuild works for C++ and should probably work for any language, as you can setup any compiler executable and dependencies (compiler is distributed to workers, so that you don't need to setup compiler on every machine).

The only drawback that I found is that in order to connect workers with clients you need to setup a Windows network share with writable folder, I think that's very inconvenient way to setup a build cluster, a better way would be to write a config with list of servers, maybe it will be fixed in the future.

Also FastBuild cluster can be run only on local network, would be great to be possible to setup many computers though internet, it shouldn't be difficult to implement, also internet connection should be encrypted to secure secret sources.

like image 132
Arty Avatar answered Mar 14 '26 15:03

Arty



Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!