Logo Questions Linux Laravel Mysql Ubuntu Git Menu
HTML CSS JAVASCRIPT SQL PYTHON PHP BOOTSTRAP JAVA JQUERY R React Kotlin
 

Hadoop and MySQL Integration

Tags:

mysql

hadoop

integration

We would like to implement Hadoop on our system to improve its performance.

The process works like this: Hadoop will gather data from MySQL database then process it. The output will then be exported back to MySQL database.

Is this a good implementation? Will this improve our system's overall performance? What are the requirements and has this been done before? A good tutorial would really help.

Thanks

like image 561
Jonar Avatar asked Jan 26 '11 02:01

Jonar

People also ask

Which database is used in Hadoop?

Hadoop is not a type of database, but rather a software ecosystem that allows for massively parallel computing. It is an enabler of certain types NoSQL distributed databases (such as HBase), which can allow for data to be spread across thousands of servers with little reduction in performance.

Is MySQL a big data tool?

MySQL is a widely used open-source relational database management system (RDBMS) and is an excellent solution for many applications, including web-scale applications. However, its architecture has limitations when it comes to big data analytics.

1 Answers

Sqoop is a tool designed to import data from relational databases into Hadoop

https://github.com/cloudera/sqoop/wiki/

and a video about it http://www.cloudera.com/blog/2009/12/hadoop-world-sqoop-database-import-for-hadoop/

like image 197
Joe Stein Avatar answered Sep 24 '22 02:09

Joe Stein
Sign in to Comment

Related questions

Configuration storage setup [file vs. database]
Finding k-nearest neighbors for a given vector?
Executing multiple native queries in one go
What ways are there to store information about an anonymous/guest user in a database?
Can you index subqueries?
IllegalArgumentException: Type cannot be null
Convert SQL Server tables to MySQL using ZF2 and Doctrine2
Cache/Re-Use a Subquery in MySQL
Is there any difference between DATE_SUB() and using arithmetic operators for datetime calculation?
What is the unit in returned by MySQL GLength method?
MySQL query with dependent subquery takes too long
MySQL InnoDB locks on joined rows
Algorithm using soundex() or metaphone() to create Mad Gab style phrases
MySQL. Creating an index for "OR" queries
Why does MySQL's performance decrease when queries are executed in parallel?
Convert BIGINT UNSIGNED to INT
Mysql2::Error: This connection is in use by
High numerical precision floats with MySQL and the SQLAlchemy ORM
Flyway migration, Unable to obtain Jdbc connection from DataSource
How to "undeclare" volumes in docker image?

Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!