I'm currently exploring Deequ library and I'm trying to understand whether it's possible to check for the uniqueness of a combination of column.
This code
.hasUniqueness(Seq("col1", "col2"), Check.IsOne))
seems to calculate uniqueness for each column separately (correct if I'm wrong)
Thanks
I am one of the authors of Deequ. Your code snippet should calculate the uniqueness of the combined columns. If you feel that something is wrong with the result, then I would encourage you to open an issue at https://github.com/awslabs/deequ/issues and provide some sample code so that we can reproduce the error.
Best, Sebastian
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With