Logo Questions Linux Laravel Mysql Ubuntu Git Menu
HTML CSS JAVASCRIPT SQL PYTHON PHP BOOTSTRAP JAVA JQUERY R React Kotlin
 

What is the closest thing to Apache Hadoop in other languages?

Tags:

c++

python

distributed-computing

hadoop

mapreduce

Specifically any Open Source implementations at any degree of usefulness in the following languages:

1) C++

2) Python

3) Ruby

4) C#

like image 627
algorithmicCoder Avatar asked May 21 '11 22:05

algorithmicCoder

People also ask

Is Hadoop a Python or Java?

Hadoop framework is written in Java language, but it is entirely possible for Hadoop programs to be coded in Python or C++ language. This implies that data architects don't have to learn Java if they are familiar with Python.

Which language is used in Hadoop?

The Hadoop framework itself is mostly written in the Java programming language, with some native code in C and command line utilities written as shell scripts.

Is Hadoop a Java framework?

Apache Hadoop is an open source, Java-based software platform that manages data processing and storage for big data applications. The platform works by distributing Hadoop big data and analytics jobs across nodes in a computing cluster, breaking them down into smaller workloads that can be run in parallel.

Is spark better than Hadoop?

Data fragments in Hadoop can be too large and can create bottlenecks. Thus, it is slower than Spark. Spark is much faster as it uses MLib for computations and has in-memory processing. Hadoop has a slower performance as it uses disk for storage and depends upon disk read and write operations.

2 Answers

The german wikipedia has some software examples for each language. I'm translating:

  • Apache Hadoop MapReduce (natively Java, pipes to C++, Python, etc.)
  • disco Open Source Project (Python and Erlang) by Nokia Research Center
  • Greenplum MapReduce by Greenplum (not sure, seems to be C++ though, but with a SQL layer like PIG/Hive).
  • QtConcurrent Open Source C++ MapReduce implementation (but not distributed) by Qt Software
  • Skynet Ruby Map/Reduce Framework
  • Plasma MapReduce (Ocaml) with its own distributed filesystem called "PlasmaFS"

Source

like image 144
Thomas Jungblut Avatar answered Nov 15 '22 14:11

Thomas Jungblut

For Python there is Disco from Nokia: http://discoproject.org/

like image 41
Zanson Avatar answered Nov 15 '22 12:11

Zanson
Sign in to Comment

Related questions

What can glStencil do?
Creating a C++ DLL loadable by Lua
What is the Equivalent of Windows WMI for MacOS C++ Development?
Is it allowed to assign to a dereferenced this (*this)?
Interface-based programming in C++ in combination with iterators. How too keep this simple?
Which API should I use for playing audio on Windows? [closed]
How to calculate (x,y) for a fixed arc length away from a point on a circumference
C++ const lvalue references
Exception specifications when deriving from std::exception in C++11
Creating several precompiled header files using GNU make
Is it possible to pass a reference to a pointer from Excel VBA to C++?
Converting a size_t into an integer (c++)
Load 2 versions of the same DLL in the same process
AST traversal in visitor or in the nodes?
C: Lock-Free Memory Allocation Library
JNI - problem with threads and jobject
Dynamic Qt string translation
Hybrid Application with Python GUI with C++ background modules
How to redirect printf output back into code?
Is there a way to highlight the currently active code block in Visual Studio 2010?

Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!