Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Uniqueness check in Deequ

I'm currently exploring Deequ library and I'm trying to understand whether it's possible to check for the uniqueness of a combination of column.

This code

.hasUniqueness(Seq("col1", "col2"), Check.IsOne))

seems to calculate uniqueness for each column separately (correct if I'm wrong)

Thanks

like image 451
Dawid Avatar asked Oct 01 '19 11:10

Dawid


1 Answers

I am one of the authors of Deequ. Your code snippet should calculate the uniqueness of the combined columns. If you feel that something is wrong with the result, then I would encourage you to open an issue at https://github.com/awslabs/deequ/issues and provide some sample code so that we can reproduce the error.

Best, Sebastian

like image 87
ssc Avatar answered Sep 30 '22 21:09

ssc