Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

unittest Vs pytest

In unittest, I can setUp variables in a class and then the methods of this class can chose whichever variable it wants to use...

class test_class(unittest.TestCase):     def setUp(self):                 self.varA = 1         self.varB = 2         self.varC = 3         self.modified_varA = 2      def test_1(self):         do_something_with_self.varA, self.varB      def test_2(self):         do_something_with_self_modified_varA, self.varC 

So in unittest, it was easy to put bunch of tests together that could go under one class and then use many different variables (varA and varB) for different methods. In pytest, I created a fixture in conftest.py instead of a class in unittest, like this...

@pytest.fixture(scope="module") def input1():     varA = 1     varB = 2     return varA, varB  @pytest.fixture(scope="module") def input2():     varA = 2     varC = 3     return varA, varC 

I feed this input1 and input2 to my functions in a different file (let's say test_this.py) for two different functions. Here are the questions based on information above...

  1. Since I can't just declare local variables in conftest.py as I can't simply import this file. Is there a better way of declaring different variables here that can be used in different functions in test_this.py ? I have five different configurations in my actual testing for these variables, defining that many different fixtures in conftest.py and use them as function argument in five different functions in test_this.py sounds painful, I would rather go back to unittest class structure, define my variables and pick and choose what I want

  2. Should I just declare global variables in test_this.py and use them in the functions the way I want ? Seems a bit not pythonic. This variables are only used by the functions in this file.

  3. Let's say I have test_that.py and test_them.py as well. If I have some shared variables between these different files, how would I declare them ? just create a file calle variables.py in the directory where all these test files are and do an import whenever I need ? This way I can keep all data in a separate.

  4. Is it my impression that pytest discourages using a class to organize your functions ? Every example I read online, it all seem to employ bunch of functions with fixtures only. What is a configuration of defining class and methods and organize tests in pytest ?

  5. I have a test scenario where I have to use result of one function into another. With pytest, I have an assert that is at the end of a function not a return so I won't be able to use this function as a fixture. How do I accomplish this ? I know this is not a good practice that my one test relies on another but is there a work around ?

Thanks in advance for your answers.

like image 612
LuckyStarr Avatar asked Jan 14 '15 23:01

LuckyStarr


People also ask

Why is pytest better than unittest?

Pytest comes with a possibility to run tests parallelly by multiple processes using pytest-xdist. The more tests are done – the bigger the advantage is (2 times faster or more). There's one important notice about elapsed time of parallel tests, that needs to be highlightened.

Does pytest use unittest?

pytest supports running Python unittest -based tests out of the box. It's meant for leveraging existing unittest -based test suites to use pytest as a test runner and also allow to incrementally adapt the test suite to take full advantage of pytest's features.

Why is pytest so popular?

pytest allows you to write concise tests that are easy to follow, easy to trace, provides excellent error reporting, and comes with a number of useful features and plug-ins. And at the end of the day you may find that these little things altogether are revolutionary.

Is unittest built into Python?

unittest has been built into the Python standard library since version 2.1. You'll probably see it in commercial Python applications and open-source projects. unittest contains both a testing framework and a test runner. unittest has some important requirements for writing and executing tests.


2 Answers

1) First of all, you can declare those fixtures not only in conftest.py, but in every Python module you want. And you can import that module. Also you can use fixtures in the same way as you used setUp method:

@pytest.fixture(scope='class') def input(request):     request.cls.varA = 1     request.cls.varB = 2     request.cls.varC = 3     request.cls.modified_varA = 2  @pytest.usefixtures('input') class TestClass:     def test_1(self):         do_something_with_self.varA, self.varB      def test_2(self):         do_something_with_self_modified_varA, self.varC 

or you can define separate variables in separate fixtures:

def fixture_a():     return varA  def fixture_b():     return varB  def fixture_c():     return varC  def fixture_mod_A():     return modified_varA 

or make one fixture which returns all the variables (why not?) or even make indirect parametrized fixture which returns variables by your choice (quite confusing way):

@pytest.fixture() def parametrized_input(request):    vars = {'varA': 1, 'varB': 2, 'varC': 3}    var_names = request.param    return (vars[var_name] for var_name in var_names)  @pytest.mark.parametrize('parametrized_input', [('varA', 'varC')], indirect=True) def test_1(parametrized_input)    varA, varC = parametrized_input    ... 

Or even you can make fixture factory which will make fixtures for you on the fly. Sounds curiously when you have only 5 tests and 5 configurations of variables, but when you get hundreds of both, it can be useful.

3) Of course you can. But I recommend you not to import this file directly, but use command line option pointing what file to import. In this case you can choose another file with variables without changing your code.

4) I use classes in my tests because I migrated from nosetest. I didn't mention any problem with using classes in pytest.

5) In that case I propose you to do the following: fist make the function with desired actions:

def some_actions(a, b):     # some actions here     ...     return c 

then use it both in test and fixture:

def test():     assert some_actions(1,2) == 10  @pytest.fixture() def some_fixture():      return some_actions(1,2) 
like image 74
Ilya Karpeev Avatar answered Oct 15 '22 06:10

Ilya Karpeev


I think unittest is easier to read. For new testers, unittest is really easy. It is working out of the box. You depend on the Python implementation, but they will not change the interface coming years.

I like to organize my tests in such a way that I have maximum 1 test per file. In that case I don't depend on classes... but I import classes from every test to do stuff.

Some websites complain about colours in unittest is not possible. I think that is a joke, since my unittests create JUNIT output reports for Jenkins and others. There are great tools (even 1 file) to convert JUNIT to a website, that's not the responsibility of a test tool.

Also, some people complain you need a lot of code to start a unittest. I disagree, it takes 4 lines of code to create a unittest! But Pytest needs to know all the difficult annotations, which are not normal for a simple Python developer.

An important reasons also is that unittest will remain free. However, if you want to use pytest for some reason (bitbucket etc), there are tools to convert your tests and make the code less readable.

Have fun!

like image 40
Bart Mensfort Avatar answered Oct 15 '22 05:10

Bart Mensfort