Comparison of GUI testing tools

Last updated

GUI testing tools serve the purpose of automating the testing process of software with graphical user interfaces.

NameSupported platforms
(testing system)
Supported platforms
(tested system)
DeveloperLicenseAutomationLatest versionReferenceStatus
AutoHotkey WindowsWindows AutoHotkey GNU GPL v2 Yes1.1.32.00 [1] Active
AutoIt WindowsWindows AutoIt Proprietary Yes3.3.14.5 [2] Active
Appium Windows, Linux, Mac
(Python, C#, Ruby, Java, Javascript, PHP, Robot Framework)
iOS, Android (both native App & browser hosted app) JS Foundation Apache Yes(Binding Specific) [3] Active
Blisk Windows, Mac, LinuxWebBlisk Proprietary Yes16.0.79.98 [4] Active
Dojo Objective Harness cross-platformWebDojo Foundation AFL Yes6.0 [5] Active
eggPlant Functional Windows, Linux, OS XWindows, Linux, OS X, iOS, Android, Blackberry, Win Embedded, Win CE TestPlant Ltd Proprietary YesUn­known[ citation needed ]Active
HP WinRunner WindowsWindows Hewlett-Packard Proprietary Un­knownUn­known[ citation needed ]Discontinued
iMacros Web (cross-browser)Un­knowniOpus Proprietary Yes12.5/10.0.5/10.0.2[ citation needed ]
Katalon Studio Windows, Linux, OS XWeb (UI & API), Mobile appsKatalon LLC Proprietary Yes6.3.0 [6] Active
Linux Desktop Testing Project Linux (With Windows and OSX ports)GUI applications with accessibility APIs(Collaborative project) GNU LGPL Yes3.5.0 [7]
Oracle Application Testing Suite WindowsWeb, Oracle Technology Products Oracle Proprietary Yes12.5 [8] [9] Active
QF-Test Windows, Linux, macOS X, Web (cross-browser)Windows, Java/Swing/SWT/Eclipse, JavaFX, Web applications, Windows Applications, C++, AndroidQuality First Software GmbH Proprietary Yes7.0.8 [10] Active
Ranorex Studio WindowsWindows, Web, iOS, Android Ranorex GmbH Proprietary Yes9.3.4 [11] Active
Robot Framework Web (cross-browser)Web(Collaborative project) Apache Yes3.1.2 [12] Active
Sahi Web (cross-browser), WindowsWeb, Java, Java Web Start, Applet, FlexTyto Software [13] Apache and Proprietary Yes5.1 (open source), 8.0.0 [14] [15] Active
Selenium Web (cross-browser)Web(Collaborative project) Apache Yes3.141.59 [16] Active
SilkTest WindowsWindows, Web Micro Focus
previously Borland and Segue
Proprietary Yes20.0 [17] Active
SOAtest Windows, Linux, (cross-browser)Web (cross-browser) Parasoft Proprietary Yes9.10.8 [18] Active
Squish GUI Tester Windows, Linux, macOS, Solaris, AIX, QNX, WinCE, Windows Embedded, embedded Linux, Android, iOSQt, QML, QtQuick, Java AWT, Swing, SWT, RCP, JavaFx, Win32, MFC, WinForms, WPF, HTML5 (cross-browser), macOS Cocoa, iOS, Android, Tk The Qt Company (froglogic GmbH) Proprietary Yes6.7 [19] [20] Active
Test Studio WindowsWindows, Test Studio, Android, iOS Telerik by Progress Proprietary YesR1 2022 [21] Active
TestComplete WindowsWindows, Android, iOS, WebSmartBear Software Proprietary Yes14.10[ citation needed ]Active
Testing AnywhereUn­knownUn­known Automation Anywhere Proprietary Yes8.0[ citation needed ]Discontinued
TestPartner WindowsWindows Micro Focus Proprietary Yes6.3.2[ citation needed ]Discontinued
Tricentis Tosca WindowsWindows, iOS, Android, Web, Cross-Browser, Java AWT, Java SWT, API, Win32, WinForms, WPF, Siebel, Delphi, PowerBuilder, up to around 40 different technologiesTricentis Proprietary Yes16 [22] Active
Twist Un­knownUn­known ThoughtWorks Proprietary Un­known14.1.0[ citation needed ]Discontinued
Unified Functional Testing (UFT)
previously named HP QuickTest Professional (QTP)
WindowsWindows, Web, Mobile, Terminal Emulators, SAP, Siebel, Java, .NET, Flex, others... [23] Hewlett Packard Enterprise Proprietary Yes14.53 [24] Active
Watir WebWeb (cross-browser)(Collaborative project) BSD Yes6.16.5[ citation needed ]
Xnee UNIX X Window GNU Project, Henrik Sandklef GNU GPL Un­known3.19[ citation needed ]

Related Research Articles

In software testing, test automation is the use of software separate from the software being tested to control the execution of tests and the comparison of actual outcomes with predicted outcomes. Test automation can automate some repetitive but necessary tasks in a formalized testing process already in place, or perform additional testing that would be difficult to do manually. Test automation is critical for continuous delivery and continuous testing.

<span class="mw-page-title-main">AutoHotkey</span> Automation-focused scripting language for Windows

AutoHotkey is a free and open-source custom scripting language for Microsoft Windows, initially aimed at providing easy keyboard shortcuts or hotkeys, fast macro-creation and software automation that allows users of most levels of computer skill to automate repetitive tasks in any Windows application. User interfaces can easily be extended or modified by AutoHotkey. The AutoHotkey installation includes its own extensive help file, and web-based documentation is also available.

<span class="mw-page-title-main">AutoIt</span>

AutoIt is a freeware programming language for Microsoft Windows. In its earliest release, it was primarily intended to create automation scripts for Microsoft Windows programs but has since grown to include enhancements in both programming language design and overall functionality.

Selenium is an open source umbrella project for a range of tools and libraries aimed at supporting browser automation. It provides a playback tool for authoring functional tests across most modern web browsers, without the need to learn a test scripting language. It also provides a test domain-specific language (Selenese) to write tests in a number of popular programming languages, including JavaScript (Node.js), C#, Groovy, Java, Perl, PHP, Python, Ruby and Scala. Selenium runs on Windows, Linux, and macOS. It is open-source software released under the Apache License 2.0.

QF-Test from Quality First Software is a cross-platform software tool for automated testing of programs via the graphical user interface. The program is specialized on cross-browser test automation of static and dynamic web-based applications. Version 4.1 added support for MacOS and the Apple Safari and Microsoft Edge browsers via the Selenium WebDriver. RESTful web service testing. From version 5.0, Windows applications can also be tested and modern C++ applications. Version 5.3 added support for the Chrome DevTools protocol, which allows browsers to be controlled using CDP drivers.

<span class="mw-page-title-main">Ranorex Studio</span> Software test automation tool

Ranorex Studio is a GUI test automation framework provided by Ranorex GmbH, a software development company. The framework is used for the testing of desktop, web-based and mobile applications.

<span class="mw-page-title-main">Micro Focus Unified Functional Testing</span>

Micro Focus Unified Functional Testing (UFT), formerly known as QuickTest Professional (QTP), is software that provides functional and regression test automation for software applications and environments.

<span class="mw-page-title-main">TestComplete</span> Software test automation tool

TestComplete is a functional automated testing platform developed by SmartBear Software. TestComplete gives testers the ability to create automated tests for Microsoft Windows, Web, Android, and iOS applications. Tests can be recorded, scripted or manually created with keyword driven operations and used for automated playback and error logging.

RTTS is a professional services organization that provides software quality outsourcing, training, and resources for business applications. With offices in New York City, Philadelphia, Atlanta, and Phoenix, RTTS serves mid-sized to large corporations throughout North America. RTTS uses the software quality and test solutions from IBM, Hewlett Packard Enterprise, Microsoft and other vendors and open source tools to perform software performance testing, functional test automation, big data testing, data warehouse/ETL testing, mobile application testing, security testing and service virtualization.

<span class="mw-page-title-main">Jenkins (software)</span> Open source automation server

Jenkins is an open source automation server. It helps automate the parts of software development related to building, testing, and deploying, facilitating continuous integration, and continuous delivery. It is a server-based system that runs in servlet containers such as Apache Tomcat. It supports version control tools, including AccuRev, CVS, Subversion, Git, Mercurial, Perforce, ClearCase, and RTC, and can execute Apache Ant, Apache Maven, and sbt based projects as well as arbitrary shell scripts and Windows batch commands.

Continuous testing is the process of executing automated tests as part of the software delivery pipeline to obtain immediate feedback on the business risks associated with a software release candidate. Continuous testing was originally proposed as a way of reducing waiting time for feedback to developers by introducing development environment-triggered tests as well as more traditional developer/tester-triggered tests.

Sahi Pro is a test automation software for desktop applications, mobile applications and web applications. Sahi was conceived as an open source product in 2005 with specific focus on test automation management tools for web 2.0 technologies but as a test automation tool geared towards testers. Sahi Pro is shipped proprietary license software. The open-source version includes a basic tools set sufficient for most testing purposes, whereas the Pro version includes further features such as test distribution and report customization.

Squish is a commercial cross-platform GUI and regression testing tool that can test applications based on a variety of GUI technologies. It is developed and maintained by Froglogic.

Topology and Orchestration Specification for Cloud Applications (TOSCA), is an OASIS standard language to describe a topology of cloud based web services, their components, relationships, and the processes that manage them. The TOSCA standard includes specifications of a file archive format called CSAR.

<span class="mw-page-title-main">Tricentis</span> Austrian software testing company

Tricentis is a software testing company founded in 2007 and headquartered in Austin, Texas. It provides software testing automation and software quality assurance products for enterprise software.

Tricentis Tosca is a software testing tool that is used to automate end-to-end testing for software applications. It is developed by Tricentis.

Flood IO is a load testing platform that executes globally-distributed performance tests from open source tools, including JMeter, Gatling, and Selenium. It also runs test plans written with Ruby JMeter, an open source RubyGem.

<span class="mw-page-title-main">Katalon Studio</span> Automation testing software tool

Katalon Platform is an automation testing software tool developed by Katalon, Inc. The software is built on top of the open-source automation frameworks Selenium, Appium with a specialized IDE interface for web, API, mobile and desktop application testing. Its initial release for internal use was in January 2015. Its first public release was in September 2016. In 2018, the software acquired 9% of market penetration for UI test automation, according to The State of Testing 2018 Report by SmartBear.

<span class="mw-page-title-main">Oracle Advertising and Customer Experience (CX)</span> Cloud-based marketing service

Oracle Advertising and Customer Experience (CX) is a suite of cloud-based applications offered by Oracle Corporation that includes tools for advertising, marketing, sales, e-commerce, customer service.

References

  1. "AutoHotkey". AutoHotkey. May 24, 2020. Retrieved 2020-05-24.
  2. "AutoIt". autolt. June 3, 2014. Retrieved 2016-09-27.
  3. "The History of Appium". appium.io. Retrieved 2020-07-29.
  4. "Blisk browser". blisk.io. Retrieved 2019-07-09.
  5. "Dojo Toolkit". DOJO. Retrieved 2016-09-27.
  6. Brian (2017-10-26). "Best Automation Testing Tools for 2018 (Top 10 reviews)". Medium. Retrieved 2018-05-22.
  7. "Linux Desktop Testing Project". LDTP Website. Retrieved 2015-07-26.
  8. "Oracle - Oracle Application Testing Suite" . Retrieved 2016-11-08.
  9. "OATS - Oracle Application Testing Suite".
  10. "QF-Test Overview". QFS Website. Retrieved 2014-10-09.
  11. "Ranorex Release Notes". Ranorex Website. Retrieved 2020-11-26.
  12. "GUI Automation". Sorted Inf. Retrieved 2014-02-22.
  13. "Sahi Open Source Vs. Sahi Pro". Sahi Pro Website. Retrieved 2014-09-02.
  14. "Sahi — Web Automation and Test Tool". Open-source Sahi on Sourceforge. Retrieved 2014-09-02.
  15. "Sahi — The tester's Web Automation Tool". Sahi Pro Website. Retrieved 2014-09-02.
  16. "What is Selenium?". Selenium HQ. Retrieved 2014-09-02.
  17. "Silk Test Overview" (PDF).
  18. "Parasoft Launches SOATest: Raising the Bar on API Integrity". 2013-06-14. Retrieved 2018-10-16.
  19. "Squish GUI Tester". froglogic Website. Retrieved 2017-12-07.
  20. "Squish 6.7: Now Available!". froglogic. 2021-03-30.
  21. "Telerik Test Studio Ultimate Releases". www.componentsource.com. Retrieved 2022-03-18.
  22. "Tricentis Tosca". Tricentis Tosca. Retrieved 2017-04-12.
  23. "More Add-ins". uft-help.saas.hpe.com. Retrieved 2017-08-02.
  24. "What's New in UFT 14.00". uft-help.saas.hpe.com. Retrieved 2017-08-02.