I am looking to see if there is a way to run Hive unit tests (i.e unit testing the hive queries) in Windows without having a hadoop/hive/cygwin setup. Came across these open source tools (Hive_runner, HiveTest), tried running hiverunner in Eclipse as maven project, its JUnit tests failed with the following warning and error
Warning: Unable to load native-hadoop library for your platform....using built-in java classes where applicable. Error: Failed to set permission of path ? to 0700
Thanks Srivatsan Nallazhagappan
spark-testing-base is a library that simplifies the unit testing of Spark applications. It provides utility classes to create out-of-the-box Spark sessions and DataFrame utility methods that can be used in assert statements. ScalaTest. ScalaTest is a powerful tool that can be used to unit test Scala and Java code.
The HiveQLUnit open source project solves your problem of executing standalone unit tests from your favorite IDE. Check it out @HiveQLUnit
It can execute unit tests from your favorite IDE on any operating system including Windows, Linux and Mac OSX. Here is some guidance around running it from your IDE - Running HiveQLUnit
Note: I am affiliated with the HiveQLUnit OS project.
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With