Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Hive unit testing on windows without hadoop setup

I am looking to see if there is a way to run Hive unit tests (i.e unit testing the hive queries) in Windows without having a hadoop/hive/cygwin setup. Came across these open source tools (Hive_runner, HiveTest), tried running hiverunner in Eclipse as maven project, its JUnit tests failed with the following warning and error

Warning: Unable to load native-hadoop library for your platform....using built-in java classes where applicable. Error: Failed to set permission of path ? to 0700

Thanks Srivatsan Nallazhagappan

like image 906
Srivatsan Nallazhagappan Avatar asked May 17 '14 10:05

Srivatsan Nallazhagappan


People also ask

What is unit testing in Spark?

spark-testing-base is a library that simplifies the unit testing of Spark applications. It provides utility classes to create out-of-the-box Spark sessions and DataFrame utility methods that can be used in assert statements. ScalaTest. ScalaTest is a powerful tool that can be used to unit test Scala and Java code.


1 Answers

The HiveQLUnit open source project solves your problem of executing standalone unit tests from your favorite IDE. Check it out @HiveQLUnit

It can execute unit tests from your favorite IDE on any operating system including Windows, Linux and Mac OSX. Here is some guidance around running it from your IDE - Running HiveQLUnit

Note: I am affiliated with the HiveQLUnit OS project.

like image 91
Nilkamal Weerasinghe Avatar answered Oct 04 '22 03:10

Nilkamal Weerasinghe