assertAll vs multiple assertions in JUnit5

JavaUnit TestingJunitAssertionsJunit5

Java Problem Overview


Is there any reason to group multiple assertions:

public void shouldTellIfPrime(){
    Assertions.assertAll(
            () -> assertTrue(isPrime(2)),
            () -> assertFalse(isPrime(4))
    );
}

instead of doing this:

public void shouldTellIfPrime(){
    Assertions.assertTrue(isPrime(2));
    Assertions.assertFalse(isPrime(4));
}

Java Solutions


Solution 1 - Java

The interesting thing about assertAll is that it always checks all of the assertions that are passed to it, no matter how many fail. If all pass, all is fine - if at least one fails you get a detailed result of all that went wrong (and right for that matter).

It is best used for asserting a set of properties that belong together conceptionally. Something where your first instinct would be, "I want to assert this as one".

Example

Your specific example is not an optimal use case for assertAll because checking isPrime with a prime and a non-prime is independent of each other - so much so that I would recommend writing two test methods for that.

But assume you have a simple class like an address with fields city, street, number and would like to assert that those are what you expect them to be:

Address address = unitUnderTest.methodUnderTest();
assertEquals("Redwood Shores", address.getCity());
assertEquals("Oracle Parkway", address.getStreet());
assertEquals("500", address.getNumber());

Now, as soon as the first assertion fails, you will never see the results of the second, which can be quite annoying. There are many ways around this and JUnit Jupiter's assertAll is one of them:

Address address = unitUnderTest.methodUnderTest();
assertAll("Should return address of Oracle's headquarter",
    () -> assertEquals("Redwood Shores", address.getCity()),
    () -> assertEquals("Oracle Parkway", address.getStreet()),
    () -> assertEquals("500", address.getNumber())
);

If the method under test returns the wrong address, this is the error you get:

org.opentest4j.MultipleFailuresError:
	Should return address of Oracle's headquarter (3 failures)
	expected: <Redwood Shores> but was: <Walldorf>
	expected: <Oracle Parkway> but was: <Dietmar-Hopp-Allee>
	expected: <500> but was: <16>

Solution 2 - Java

According to documentation here

> Asserts that all supplied executables do not throw an AssertionError. > > If any supplied Executable throws an AssertionError, all remaining > executables will still be executed, and all failures will be > aggregated and reported in a MultipleFailuresError. However, if an > executable throws an exception that is not an AssertionError, > execution will halt immediately, and the exception will be rethrown as > is but masked as an unchecked exception.

So main difference is that the assertAll will allow all the asserts to execute without breaking the flow while the others like assertTrue and the lot will stop the test with the AssertionError

So in your first example both assertions will execute regardless of pass to fail, while in the second example test will stop if first assertion fails.

>Is there any reason to group multiple assertions

If you want all assertions exercised in the unit test.

Attributions

All content for this solution is sourced from the original question on Stackoverflow.

The content on this page is licensed under the Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) license.

Content TypeOriginal AuthorOriginal Content on Stackoverflow
QuestionWilhelm OlejnikView Question on Stackoverflow
Solution 1 - JavaNicolai ParlogView Answer on Stackoverflow
Solution 2 - JavaNkosiView Answer on Stackoverflow