Comparison of continuous integration software

Last updated

This is a compendium of software tools that support continuous integration. [1]

Contents

Features

Name Platform License Builders: Windows Builders: Java Builders: otherNotification Integration, IDEs Integration, other
Apache Gump Python Apache 2.0Un­known Ant, Maven 1Un­known Email Un­knownUn­known
AppVeyor Hosted, Self-Hosted Proprietary Visual Studio, MSBuild, PsakeNoCustom Script, PowerShell Email, HipChat, Slack No GitHub, Bitbucket, Kiln, Windows Azure
Azure DevOps Server (formerly TFS and VSTS)Cross-platformProprietary, MIT MSBuild, Visual Studio Ant, Maven, Gradle, Android C, C++, Go, Groovy, Java, Node.js, Perl, PHP, Python, Ruby Email, SOAP Visual Studio, Eclipse, IntelliJ IDEA, Android Studio, Visual Studio Code GitHub, Jenkins, Slack, Hipchat, FindBugs, Checkstyle, PMD
Bamboo Web container Proprietary MSBuild, [2] NAnt, [3] Visual Studio [4] Ant, [5] Maven 1-2-3 [6] Custom script, command-line tool, Bash, Xcode, [7] Phing, [8] Grunt, Grails [9] XMPP, Google Talk, Email, RSS, Remote API, HipChat IntelliJ IDEA, Eclipse, Visual Studio FishEye, Jira, Clover, Bitbucket, GitHub
Buddy Cross-platform Proprietary NoAnt, Maven, Gradle Elixir, Go, Haskell, Node.js, PHP, Python, Ruby, .NET CoreDesktop, Email, Slack, SMSNo Web Services, Bitbucket, GitHub, GitLab, Google Cloud Services, Heroku, Modulus
Buildbot Python GPL Command-lineCommand-lineCommand-line Email, Web, GUI, IRC Un­knownUn­known
BuildMaster Cross-platform Proprietary YesYesCross-platform command-line Email, customNoMany
CircleCI Hosted, Self-Hosted Proprietary Command-lineCommand-lineCommand-line Email Visual Studio Code GitHub, Bitbucket, GitLab
GitLab Hosted, Self-HostedProprietary, MITYes [10] Maven, [11] Gradle [12] SSH, Shell, VirtualBox, Parallels, Docker, Kubernetes, Custom [13] Email, Web, Slack and others [14] Gitpod, [15] WebIDE [16] Many
GoCD Cross-platform Apache 2.0Command-lineCommand-lineCommand-lineEmail, hipchat, Slack, Gerrit, Gitter, Riemann etc No GitHub
Jenkins Web container Creative Commons and MIT MSBuild, NAnt, Batch Script Ant, Maven 2, Kundo CMake, Gant, Gradle, Grails, Phing, Rake, Ruby, SCons, Python, shell script, command-line Android, Email, Google Calendar, IRC, XMPP, RSS, Twitter, Slack, CCMenu, CCTray Eclipse, IntelliJ IDEA, NetBeans Bugzilla, Google Code, Jira, Bitbucket, Redmine, FindBugs, Checkstyle, PMD and Mantis, Trac, HP ALM
OpenMake Software Meister Cross-platform Proprietary MSBuild, NAnt, Visual Studio Ant, Maven 1-2-3 Shell script, batch script, cross-platform command-line, Groovy, Make, RTC Jazz, TFS Build, Custom Script Interpreter Email, XMPP, RSS, Systray Eclipse, Visual Studio Bugzilla, Google Code, Jira, Bitbucket, Redmine, FindBugs, Checkstyle, PMD and Mantis, Trac
Semaphore (software) Hosted Proprietary No Maven, Gradle Ruby, Java, Python, Node.js, PHP, Clojure, C/C++, Elixir, Erlang, Go, Rake, command-line Email, Campfire, HipChat, Slack, Flowdock, Webhooks, Remote APIUn­known GitHub, Bitbucket, Heroku, AWS, Code Climate, [17] Cloud 66
Travis CI Hosted Proprietary No Ant, Maven, Gradle [18] C, C++, Clojure, Elixir, Erlang, Go, Groovy, Haskell, Java, Node.js, Perl, PHP, Python, Ruby, Rust, Scala, Smalltalk Email, Campfire, HipChat, IRC, Slack, CCMenu, CCTrayNo GitHub, Heroku
TeamCity Web container Proprietary MSBuild, NAnt, Visual Studio, ReSharper-based .NET code analysis Ant, Maven 2-3, Gradle, IntelliJ IDEA-based build and code analysiscommand-line, PowerShell, [19] Xcode, [20] Rake, FxCop Email, XMPP, RSS, IDE, SysTray Eclipse, Visual Studio, IntelliJ IDEA, RubyMine, PyCharm, PhpStorm, WebStorm JetBrains YouTrack, Jira, Bugzilla, FishEye, FindBugs, PMD, dotCover, NCover
Vexor Hosted Proprietary NoUn­known Ruby, Clojure, Scala, Python, Node.js, Go, Rust, Haskell Email, HipChat, Slack Un­known GitHub, Bitbucket, GitLab
Buildkite Hosted, Self-Hosted MIT Command-line [21] Unknown Ubuntu, Debian, Red Hat/CentOS, FreeBSD, macOS, Linux, Docker, AWS, Elastic CI Stack for AWS, Google CloudEmail, Basecamp, Slack, webhooks, pagerdutyUnknown Okta, Google Workspace, GitHub, Azure AD, custom SAML, GraphQL, Amazon EventBridge, CC Menu, CCTray, Artifactory [22]

Version control support

The following table compares notable continuous integration software on the basis of version control support.

Name AccuRev BitKeeper CA Harvest ClearCase CVS Darcs Git GNU Bazaar Integrity Mercurial Perforce Plastic PVCS StarTeam Subversion Surround Synergy Team Concert TFVC Vault Visual SourceSafe
Apache Gump NoNoNoNoYesNoNoNoNoNoNoNoNoNoYesNoNoNoNoNoNo
AppVeyor NoNoNoNoNoNoYesNoNoYesNoNoNoNoYes [23] NoNoNoNoNoNo
Azure DevOps Server NoNoNoNoNoNoYesNoNoNoNoNoNoNoYesNoNoNoYesNoNo
Bamboo Yes [24] NoNoYesYesNoYesNoNoYesYesNoNoNoYesNoNoNoYes [25] NoNo
Buddy NoNoNoNoNoNoYesNoNoNoNoNoNoNoNoNoNoNoNoNoNo
BuildBot NoNoNoNoYesYesYesYesNoYesYesNoNoNoYesNoNoNoNoNoNo
BuildMaster YesNoNoYesYesNoYesNoYesYesYesYesYesNoYesYesNoNoYesYesYes
Jenkins YesYesYesYesYesYes [26] YesYesYes [27] YesYesYes [28] YesYesYesYes [29] Yes [30] Yes [31] YesYes [32] Yes
OpenMake Software MeisterYesNoYesYesYesNoYesNoYesNoYesNoYesYesYesNoYesYesYesYesYes
Semaphore (software) NoNoNoNoNoNoYesNoNoNoNoNoNoNoNoNoNoNoNoNoNo
TeamCity YesNoNoYesYesNoYesYes [33] NoYesYesNoNoYesYesNoNoNoYesYesYes
Vexor NoNoNoNoNoNoYesNoNoNoNoNoNoNoNoNoNoNoNoNoNo

References

  1. Integration, Continuous (2007). Continuous Integration: Improving Software Quality and Reducing Risk. Pearson Education. ISBN   9780321630148.
  2. "MSBuild | Bamboo Server 8.0 | Atlassian Documentation". confluence.atlassian.com.
  3. "NAnt | Bamboo Server 8.0 | Atlassian Documentation". confluence.atlassian.com.
  4. "Visual Studio | Bamboo Server 8.0 | Atlassian Documentation". confluence.atlassian.com.
  5. "Ant | Bamboo Server 8.0 | Atlassian Documentation". confluence.atlassian.com.
  6. "Maven | Bamboo Server 8.0 | Atlassian Documentation". confluence.atlassian.com.
  7. "Xcode | Bamboo Server 8.0 | Atlassian Documentation". confluence.atlassian.com.
  8. "Phing | Bamboo Server 5.10 | Atlassian Documentation". confluence.atlassian.com.
  9. "Grails | Bamboo Server 5.11 | Atlassian Documentation". confluence.atlassian.com.
  10. "Install GitLab Runner on Windows | GitLab". docs.gitlab.com.
  11. "Maven packages in the Package Repository | GitLab". docs.gitlab.com.
  12. "Unit test reports | GitLab". docs.gitlab.com.
  13. "Executors | GitLab". docs.gitlab.com.
  14. "Project integrations | GitLab". docs.gitlab.com.
  15. "Gitpod Integration | GitLab". docs.gitlab.com.
  16. "Web IDE | GitLab". docs.gitlab.com.
  17. Code Climate "Getting Started with Code Climate Quality: Setting Up Test Coverage".
  18. "Travis CI Documentation". docs.travis-ci.com.
  19. "PowerShell | TeamCity On-Premises". TeamCity On-Premises Help.
  20. "Xcode Project | TeamCity On-Premises". TeamCity On-Premises Help.
  21. "Installing Buildkite agent". buildkite.com.
  22. "Integrations- Buildkite Docs". buildkite.com.
  23. "Build Environment".
  24. "Atlassian Marketplace". marketplace.atlassian.com.
  25. "Atlassian Marketplace". marketplace.atlassian.com.
  26. "Darcs Plugin - Jenkins - Jenkins Wiki".
  27. "PTC Windchill RV&S CM". PTC Windchill RV&S CM.
  28. "PlasticSCM Plugin - Jenkins - Jenkins Wiki".
  29. "Surround SCM Plugin - Jenkins - Jenkins Wiki".
  30. "Synergy Plugin - Jenkins - Jenkins Wiki".
  31. "Team Concert". Team Concert.
  32. "SourceGear Vault". SourceGear Vault.
  33. "Bazaar - TeamCity Plugin". JetBrains Marketplace.

Further reading