JUnit

Last updated
JUnit
Developer(s) Kent Beck, Erich Gamma, David Saff, Kris Vasudevan
Stable release
5.10.0 / July 23, 2023;8 months ago (2023-07-23) [1]
Repository
Written in Java
Operating system Cross-platform
Type Unit testing tool
License Eclipse Public License 2.0 [2] (relicensed previously)
Website junit.org

JUnit is a test automation framework for the Java programming language. JUnit is often used for unit testing, and is one of the xUnit frameworks.

Contents

JUnit is linked as a JAR at compile-time. The latest version of the framework, JUnit 5, resides under package org.junit.jupiter. [3] Previous versions JUnit 4 [3] and JUnit 3 were under packages org.junit and junit.framework, respectively.

A research survey performed in 2013 across 10,000 Java projects hosted on GitHub found that JUnit (in a tie with slf4j-api) was the most commonly included external library. Each library was used by 30.7% of projects. [4]

JUnit Life Cycle

Every JUnit test class usually has several test cases. These test cases are subject to the test life cycle. The full JUnit Life Cycle has three major phases: [5]

  1. Setup phase - This phase is where the test infrastructure is prepared. Two levels of setup are available. The first type of setup is class-level setup in which a computationally expensive object, such as a database connection, is created and reused, with minimal side effects. Class-level setup is implemented using the @BeforeAll annotation. The other type is setup before running each test case, which uses the @BeforeEach annotation. [5]
  2. Test execution - This phase is responsible for running the test and verifying the result. The test result will indicate if the test result is a success or a failure. The @Test annotation is used here. [5]
  3. Clean up phase - After all posttest executions are performed, the system may need to perform cleanup. Similar to class-level setup, there is a corresponding class-level clean up. The @AfterAll annotation is used to support class-level clean up. The @AfterEach annotation allows for cleanup after test execution. [5]

Integration with other tools

JUnit 5 integrates a number of tools, such as build tools, integrated development environments (IDE), continuous integration (CI) tools and many more. [6]

Build Tools

JUnit supports Apache Ant, Apache Maven and Gradle build tools, which are the most widely used project build tools. [7] Build tools are vital for automating the process of building the project. [6]

Ant Extension

Apache Ant, also known as Ant, is one of the build tools with the highest degree of versatility, and has the longest history out of the three build tools listed above. [8] Ant centers around the build.xml file, used for configuring the tasks necessary to run a project. [8] Ant also has an extension called Apache Ivy, which helps deal with dependency resolution. The project dependencies can be declared in the ivy.xml file. Ant can integrate with JUnit 5 by configuring the Java code coverage tools (JaCoCo), for the ivy.xml file. [8] The ivy.xml can then be configured with the java-platform-console and junit-platform-runner dependencies to integrate with JUnit 5. [9]

Maven Extension

In contrast to Ant, Apache Maven, also known as Maven, uses a standardized and unified approach to the build process. [10] Maven follows the paradigm of "convention over configuration" for managing its dependencies. [11] The Java source code (or "src") can be found under the src/main/java directory, and the test files can be found under the src/test/java directory. [11] Maven can be used for any Java Project. [10] It uses the Project Object Model (POM), which is an XML-based approach to configuring the build steps for the project. [10] The minimal Maven with the pom.xml build file must contain a list of dependencies and a unique project identifier. [10] Maven must be available on the build path to work. [10] Maven can integrate with JUnit 5 using the jacoco-maven-plugin plugin which supports out-of-box functionality for JUnit 5 tests. [12] Different Maven goals can be specified to achieve these tasks. [12]

Gradle Extension

Gradle is a build tool that borrows many concepts from its predecessors, Ant and Maven. [11] It uses the build.gradle file to declare the steps required for the project build. [11] Unlike Ant and Maven, which are XML-based, Gradle requires the use of Apache Groovy, which is a Java-based programming language. [11] Unlike Ant and Maven, Gradle does not require the use of XML. [11] Gradle still adheres to Maven's "convention over configuration" approach, and follows the same structure for src/main/java and src/test/java directories. [11] Gradle can integrate with JUnit 5 by configuring a plugin jacoco alongside the junit-platform plug-in given by the JUnit 5 team in the build file. [13]

JUnit Extension Model

JUnit follows the paradigm of preferring extension points over features. [14] The JUnit team decided not to put all features within the JUnit core, and instead decided to give an extensible way for developers to address their concerns. [14]

In JUnit 4, there are two extension mechanisms: the Runner API and Rule API. [15] There were some disadvantages to both the Runner API and the Rule API.

A major limitation of the Runner API is that the developer has to implement the entire life cycle even if they only need a specific life cycle stage. [15] This is too complicated and heighweight for the majority of use cases. [15] Another major limitation is that only one runner class is used for each test case, and makes them uncomposable. [15] As an example, Mockito and Parameterized runners cannot exist within the same test class. [15]

A major limitation of the Rule API is that it cannot control the entire life cycle of the test, so they cannot be used for every single use case. [15] They are only appropriate when something needs to occur before or after test case execution. [15] Another major limitation is that rules for class-level and method-level callbacks must be made separately. [15]

In JUnit 5, the extension API is found within the JUnit Jupiter Engine. [16] The JUnit Team wants to allow the developer to hook to separate stages of a test life cycle by providing a single unified extension API. [16] Upon reaching a certain life cycle phase, the Jupiter Engine will invoke all registered extensions for that phase. [16] The developer can hook into five major extension points: [16]

  1. Test life cycle callbacks - This allows the developer to hook to certain phases of a test life cycle [17]
  2. Test instance post-processing - this enables the developer to hook after test instance creation by implementing the TestInstancePostProcessor interface. [18]
  3. Conditional test execution - this enables the developer to execute the test case only after meeting certain criteria. [19]
  4. Parameter resolution - This enables the developer to resolve a parameter after receiving it from a test method or constructor.
  5. Exception handling - A use case for exception handling is to change the testing behavior instead of throwing an exception. [20]

Example of a JUnit test fixture

A JUnit test fixture is a Java object. Test methods must be annotated by the @Test annotation. If the situation requires it, [21] it is also possible to define a method to execute before (or after) each (or all) of the test methods with the @BeforeEach (or @AfterEach) and @BeforeAll (or @AfterAll) annotations. [22] [23]

importorg.junit.jupiter.api.*;classFoobarTests{@BeforeAllstaticvoidsetUpClass()throwsException{// Code executed before the first test method}@BeforeEachvoidsetUp()throwsException{// Code executed before each test}@TestvoidoneThing(){// Code that tests one thing}@TestvoidanotherThing(){// Code that tests another thing}@TestvoidsomethingElse(){// Code that tests something else}@AfterEachvoidtearDown()throwsException{// Code executed after each test }@AfterAllstaticvoidtearDownClass()throwsException{// Code executed after the last test method }}

Previous versions of JUnit

According to Martin Fowler, one of the early adopters of JUnit: [24]

JUnit was born on a flight from Zurich to the 1997 OOPSLA in Atlanta. Kent was flying with Erich Gamma, and what else were two geeks to do on a long flight but program? The first version of JUnit was built there, pair programmed, and done test first (a pleasing form of meta-circular geekery).

As a side effect of its wide use, previous versions of JUnit remain popular, with JUnit 4 having over 100,000 usages by other software components on the Maven Central repository. [25]

In JUnit 4, the annotations for test execution callbacks were @BeforeClass, @Before, @After, and @AfterClass, as opposed to JUnit 5's @BeforeAll, @BeforeEach, @AfterEach, and @AfterAll. [22] [23]

In JUnit 3, test fixtures had to inherit from junit.framework.TestCase. [26] Additionally, test methods had to be prefixed with 'test'. [27]

See also

Citations

  1. "JUnit Releases". github.com. Retrieved 2023-07-23.
  2. "Change license to EPL v2.0". github.com. 7 September 2017. Retrieved 2021-02-04.
  3. 1 2 Gulati & Sharma 2017, p. 144, §Chapter 8 Dynamic Tests and Migration from Junit 4.
  4. "We Analyzed 30,000 GitHub Projects – Here Are The Top 100 Libraries in Java, JS and Ruby". Archived from the original on 2014-07-09. Retrieved 2014-02-09.
  5. 1 2 3 4 Gulati & Sharma 2017, pp. 37–40, Chapter §2 JUnit LifeCycle API.
  6. 1 2 Gulati & Sharma 2017, p. 99, Chapter §6 Integrating Tools.
  7. Gulati & Sharma 2017, pp. 99–117, Chapter §6 Build Tools.
  8. 1 2 3 Gulati & Sharma 2017, pp. 108–112, Chapter §6 Integrating Tools - Build Tools - Ant.
  9. Gulati & Sharma 2017, pp. 116–117, Chapter §6 Integrating Tools - Build Tools - Ant Extension.
  10. 1 2 3 4 5 Gulati & Sharma 2017, pp. 104–108, Chapter §6 Integrating Tools - Build Tools - Maven.
  11. 1 2 3 4 5 6 7 Gulati & Sharma 2017, pp. 99–103, Chapter §6 Integrating Tools - Build Tools - Gradle.
  12. 1 2 Gulati & Sharma 2017, p. 115, Chapter §6 Integrating Tools - Build Tools - Maven Extension.
  13. Gulati & Sharma 2017, pp. 113–114, Chapter §6 Integrating Tools - Build Tools - Gradle Extension.
  14. 1 2 Gulati & Sharma 2017, p. 121, Chapter §7 JUnit 5 Extension Model.
  15. 1 2 3 4 5 6 7 8 Gulati & Sharma 2017, pp. 121–122, Chapter §7 JUnit 4 Extension Model.
  16. 1 2 3 4 Gulati & Sharma 2017, pp. 122–124, Chapter §7 JUnit 5 Extension Model - JUnit 5 Extension Model.
  17. Gulati & Sharma 2017, pp. 124–126, Chapter §7 JUnit 5 Extension Model - Test Life Cycle Callbacks.
  18. Gulati & Sharma 2017, pp. 126–127, Chapter §7 JUnit 5 Extension Model - Test Instance Post-Processing.
  19. Gulati & Sharma 2017, p. 127, Chapter §7 JUnit 5 Extension Model - Conditional Test Execution.
  20. Gulati & Sharma 2017, p. 129, Chapter §7 JUnit 5 Extension Model - Exception Handling.
  21. Kent Beck. "Expensive Setup Smell". C2 Wiki. Retrieved 2011-11-28.
  22. 1 2 "Writing Tests". junit.org. Retrieved 2021-02-04.
  23. 1 2 Gulati & Sharma 2017, p. 37-40, Chapter §2 Understanding CoreJunit 5.
  24. "bliki: Xunit". martinfowler.com. Retrieved 2022-03-07.
  25. "JUnit". mvnrepository.com. Retrieved 29 October 2021.
  26. Kent Beck; Erich Gamma. "JUnit Cookbook". junit.sourceforge.net. Archived from the original on 2020-06-15. Retrieved 2011-05-21.
  27. Charles A. Sharp (August 2007). "Migrating from JUnit 3 to JUnit 4: Nothing But Good News". Object Computing, Inc. Retrieved 2021-02-04.

Related Research Articles

<span class="mw-page-title-main">Eclipse (software)</span> Software development environment

Eclipse is an integrated development environment (IDE) used in computer programming. It contains a base workspace and an extensible plug-in system for customizing the environment. It is the second-most-popular IDE for Java development, and, until 2016, was the most popular. Eclipse is written mostly in Java and its primary use is for developing Java applications, but it may also be used to develop applications in other programming languages via plug-ins, including Ada, ABAP, C, C++, C#, Clojure, COBOL, D, Erlang, Fortran, Groovy, Haskell, JavaScript, Julia, Lasso, Lua, NATURAL, Perl, PHP, Prolog, Python, R, Ruby, Rust, Scala, and Scheme. It can also be used to develop documents with LaTeX and packages for the software Mathematica. Development environments include the Eclipse Java development tools (JDT) for Java and Scala, Eclipse CDT for C/C++, and Eclipse PDT for PHP, among others.

In computer programming, unit testing, a.k.a. component or module testing, is a form of software testing by which isolated source code is tested to validate expected behavior.

<span class="mw-page-title-main">WebObjects</span> Java web application server and framework originally developed by NeXT Software

WebObjects is a discontinued Java web application server and a server-based web application framework originally developed by NeXT Software, Inc.

<span class="mw-page-title-main">Apache Ant</span> Java software tool

Apache Ant is a software tool for automating software build processes for Java applications which originated from the Apache Tomcat project in early 2000 as a replacement for the Make build tool of Unix. It is similar to Make, but is implemented using the Java language and requires the Java platform. Unlike Make, which uses the Makefile format, Ant uses XML to describe the code build process and its dependencies.

Hibernate ORM is an object–relational mapping tool for the Java programming language. It provides a framework for mapping an object-oriented domain model to a relational database. Hibernate handles object–relational impedance mismatch problems by replacing direct, persistent database accesses with high-level object handling functions.

Maven is a build automation tool used primarily for Java projects. Maven can also be used to build and manage projects written in C#, Ruby, Scala, and other languages. The Maven project is hosted by The Apache Software Foundation, where it was formerly part of the Jakarta Project.

TestNG is a testing framework for the Java programming language created by Cedric_Beust and inspired by JUnit and NUnit. The design goal of TestNG is to cover a wider range of test categories: unit, functional, end-to-end, integration, etc., with more powerful and easy-to-use functionalities.

XMLBeans is a Java-to-XML binding framework which is part of the Apache Software Foundation XML project.

The Spring Framework is an application framework and inversion of control container for the Java platform. The framework's core features can be used by any Java application, but there are extensions for building web applications on top of the Java EE platform. The framework does not impose any specific programming model.. The framework has become popular in the Java community as an addition to the Enterprise JavaBeans (EJB) model. The Spring Framework is free and open source software.

Apache Gump is an open source continuous integration system, which aims to build and test all the open source Java projects, every night. Its aim is to make sure that all the projects are compatible, at both the API level and in terms of functionality matching specifications. It is hosted at gump.apache.org, and runs every night on the official Sun JVM.

<span class="mw-page-title-main">Apache Ivy</span> Package management software

Apache Ivy is a transitive package manager. It is a sub-project of the Apache Ant project, with which Ivy works to resolve project dependencies. An external XML file defines project dependencies and lists the resources necessary to build a project. Ivy then resolves and downloads resources from an artifact repository: either a private repository or one publicly available on the Internet.

<span class="mw-page-title-main">Spring Roo</span> Open-source software tool

Spring Roo is an open-source software tool that uses convention-over-configuration principles to provide rapid application development of Java-based enterprise software. The resulting applications use common Java technologies such as Spring Framework, Java Persistence API, Thymeleaf, Apache Maven and AspectJ. Spring Roo is a member of the Spring portfolio of projects.

MyBatis is a Java persistence framework that couples objects with stored procedures or SQL statements using an XML descriptor or annotations.

<span class="mw-page-title-main">Google Plugin for Eclipse</span> Set of Java development tools

Google Plugin for Eclipse (GPE) was a set of development tools that enabled Java developers to design, build, optimize, and deploy cloud computing applications. developers in creating complex user interfaces, generating Ajax code using the GWT Web Toolkit, and deploying applications to Google App Engine. GPE installed into the Eclipse integrated development environment (IDE) using the extensible plugin system. GPE was available under the Eclipse Public License 1.0.

Gradle is a build automation tool for multi-language software development. It controls the development process in the tasks of compilation and packaging to testing, deployment, and publishing. Supported languages include Java, C/C++, and JavaScript. Gradle builds on the concepts of Apache Ant and Apache Maven, and introduces a Groovy- and Kotlin-based domain-specific language contrasted with the XML-based project configuration used by Maven. Gradle uses a directed acyclic graph to determine the order in which tasks can be run, through providing dependency management. It runs on the Java Virtual Machine.

Java code coverage tools are of two types: first, tools that add statements to the Java source code and require its recompilation. Second, tools that instrument the bytecode, either before or during execution. The goal is to find out which parts of the code are tested by registering the lines of code executed when running a test.

MockServer is an open source mocking framework for HTTP and HTTPS released under the Apache License. MockServer is designed to simplify integration testing, by mocking HTTP and HTTPS system such as a web service or web site, and to decouple development teams, by allowing a team to develop against a service that is not complete or is unstable.

<span class="mw-page-title-main">Spring Boot</span> Application framework for Java platform

Spring Boot is an open-source Java framework used to create a Micro Service. Spring boot is used for programming standalone, production-grade Spring-based applications with minimal effort. Spring Boot is a convention-over-configuration extension for the Spring Java platform intended to help minimize configuration concerns while creating Spring-based applications. Most of the application can be preconfigured using Spring team's "opinionated view" of the best configuration and use of the Spring platform and third-party libraries.

References