Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

IMDB to MySQL: Insert IMDB data into MySQL database

I’m looking for a solution to import all the IMDB data into my own MySQL database. I’ve downloaded all the IMDB data files from their homepage which are all in the file format *.list (in Windows).

I want to retrieve and that information and insert it correctly into my MySQL database so I can do some test and query searches.

I followed a guide but about half I realized that it was a 2004 guide and the way things works now did not go well with the tools from seven years ago.

I’ve browsed the net for applications, php-scripts, python-script and what not to find a solution but with no luck. The W32 tool that IMDB themselves references to don’t work either.

Is there anyone who knows a solution or a way to do this task?

like image 554
Emil Devantie Brockdorff Avatar asked Aug 30 '11 13:08

Emil Devantie Brockdorff


People also ask

Does IMDb use MySQL?

In our third post we finally built and indexed the MySQL database to store the IMDb dataset. In our next post we will look at querying the database and also make a few visualisations the data. For further details on database concepts and SQL we refer the interested reader to references below.

How do I download a dataset from IMDb?

The dataset files can be accessed and downloaded from https://datasets.imdbws.com/. The data is refreshed daily. Each dataset is contained in a gzipped, tab-separated-values (TSV) formatted file in the UTF-8 character set.

Is MySQL a database?

MySQL is a relational database management system The database structure is organized into physical files optimized for speed. The logical data model, with objects such as data tables, views, rows, and columns, offers a flexible programming environment.


1 Answers

There is some nice py script, witch helped me. Just make connection and run it. ~1hr to work around everything.

EDIT: Use this readme file for making script.

like image 100
Ernestas Stankevičius Avatar answered Oct 02 '22 19:10

Ernestas Stankevičius