LoadRunner

Last updated
LoadRunner
Developer(s) OpenText
Stable release
2022 R2
Operating system Microsoft Windows and Linux (Load Generator only)
Available in11 languages
List of languages
Simplified Chinese, Dutch, English, French, German, Italian, Japanese, Korean, Portuguese-Brazilian, Russian, Spanish.
Type Load testing tools
License Proprietary
Website

LoadRunner is a software testing tool from OpenText. It is used to test applications, measuring system behavior and performance under load.

Contents

LoadRunner can simulate millions of users concurrently using application software, recording and later analyzing the performance of key components of the application whilst under load.

LoadRunner simulates user activity by generating messages between application components or by simulating interactions with the user interface such as key presses or mouse movements. The messages and interactions to be generated are stored in scripts. LoadRunner can generate the scripts by recording them, such as logging HTTP requests between a client web browser and an application's web server. [1]

Hewlett Packard Enterprise acquired LoadRunner as part of its acquisition of Mercury Interactive in November 2006. [2] [3] In Sept 2016, Hewlett Packard Enterprise announced it is selling its software business, including Mercury products, to Micro Focus. [4] As of 01-Sept-2017, the acquisition was complete. [5]


On Dec 12, 2019, Micro Focus announced newer names for LoadRunner package and started following CalVer. [6]

Architecture

The key components of LoadRunner are:

Modules are available to enable LoadRunner to capture, replay and script different application and networking technologies. These include support for: [7]

LoadRunner can be run standalone or multiple instances can pooled for use by several people under the control of LoadRunner Enterprise, formerly known as HP PerformanceCenter.

History

VersionService PackRelease dateNotes
1.0November 1993Load Testing for X Windows applications
2.0July 1994 Windows support added
XL & RTEDecember 1994LoadRunner/XL (for large tests) and LoadRunner/RTE (RTE protocol support) introduced
3.0April 1995Added SQL Inspector (captures SQL statements sent from client applications to relational databases)
4.0May 1996Added Virtual User Generator, Controller, and Analysis tools
5.0February 1997Added SAP R/3 support
6.0July 1999Added Linux installation support
6.5June 2000Added "TurboLoad" technology (i.e. Run users as threads)
7.51June 2000Added Citrix ICA protocol support
7.8September 2003
7.8Feature Pack 1September 2003Added support for Windows XP.
8.0August 2004Added "Additional Attributes" to Runtime Settings.
8.1August 2004Added Web Click and Script technologies
9.0August 2004Re-branded to HP LoadRunner
9.10February 2008Added Web Services, Adobe AMF, and RDP
9.51July 6, 2009
9.52June 14, 2010
11.0September 2010
11.0Patch 1January 6, 2011
11.0Patch 2February 22, 2011Added support for Visual Studio 2010 and Protocol Updates to Ajax TruClient, Citrix, Flex, Web.
11.0Patch 3June 20, 2011Added support for IE9, Mobile protocols, GraniteDS.
11.0Patch 4November 2011HP SV (Service Virtualization Integration) with Controller, GWT-DFE(Google Web Toolkit- Data Format Extension), RTMP Tunneled, Messaging support, Streaming support, Flex Correlations.
11.50November 2011Added New VuGen IDE, Ajax TruClient for IE, Web Protocol Asynchronous Support, Flex, Mobile, .NET, Web Services, 64-bit applications recording, IPv6 support.
11.50Patch 1July 20, 2012Added Ajax TruClient IE protocol.
12.00March 18, 2014Added ability to instantiate instances on Amazon EC2 directly from LoadRunner UI.
12.02January 21, 2015Added ability to instantiate instances on Microsoft Azure directly from LoadRunner UI
12.50August 2015
  • JavaScript as a new scripting language for the Web-HTTP/HTML protocol
  • Chrome TruClient support added
  • Google Compute Engine supported as cloud provider
  • Ability to record a TruClient script with one browser and replay it with any
  • Integrated Network Virtualization solution (formerly known as Shunra)
  • Docker-based Linux installation
  • Generating scripts from HAR files
  • Major enhancements in .NET and Citrix protocols
12.50Patch 3May 5, 2016
  • Provides support for TruClient - Native Mobile protocol in HPE Mobile Center
  • Adds support for HPE Mobile Center 1.51
  • Fix for Amazon Cloud provisioning
12.53May 2016
  • Git integration in VuGen
  • Java 8 support, 64-bit replay support in Java protocols
  • New PCoIP protocol
  • HTTP Video Streaming (HTML5, HLS) support
  • HTTP/2 support
  • Enhanced SAPUI5 recording in TruClient
  • REST step-builder editor in VuGen
  • Support of Win 10 and recording using MS Edge browser
  • Built-in Linux compatibility test in VuGen
  • Improved performance of Linux Load Generators, support of additional Linux distributions
12.53Patch 1June 15, 2016Fixes a memory allocation issue that can impact Web HTTP/HTML protocols.
12.53Patch 2August 3, 2016
12.53Patch 3September 29, 2016
12.53Patch 4January 4, 2017LoadRunner 12.53 Patch 4 contains various enhancements, and provides support for the following:
  • HPE Mobile Center 2.20. For details, see the Mobile Center Help.
  • HPE Network Virtualization (NV) 12.53 Patch 1
  • Google Web Toolkit (GWT) support:
    • GWT Request Factory
    • GWT 2.7.0
    • Verified for use with GWT 2.8.0 (full support to be added in a future version).
12.55August 17, 2017Added MQTT Protocol, support for JMeter tests, support for Windows 10 creators, Windows Server 2016, and Ubuntu 16.04. Also added support for Chromium 55 for TruClient protocol. LoadRunner 12.55 supports HTTP/2 64-bit record and replay and many performance improvements and enhancements.
12.56February 26, 2018LoadRunner 12.56 contains various enhancements, and provides support for the following:
  • Runtime Settings Search
  • New supported technologies and platforms
  • Protocol enhancements
  • TruClient enhancements
  • VuGen enhancements
  • Controller and Analysis enhancements
12.57May 19, 2018LoadRunner 12.57 contains various enhancements, and provides support for the following:
  • New supported technologies and platforms
  • Remote Terminal Emulator protocol compatibility with Windows 10
  • TruClient enhancements, including support for ChromiumOS version 63
  • VuGen enhancements
  • Controller enhancements
12.60August 24, 2018LoadRunner 12.60 contains various enhancements, and provides support for the following:
  • A runtime setting to enable/disable HTTP/2 features
  • New runtime setting that enables connecting to one or multiple IP addresses for Oracle NCA protocol
  • Enhanced desktop pool support with the ability to sync on bitmap timeout per step for PCoIP protocol
  • Dockerized Load Generators
  • Network Virtualization is now free
  • Save a graph as an image file
12.63May 28, 2019LoadRunner 12.63 contains various enhancements, and provides support for the following:
  • Significant reduction in the overall time for Analysis to process raw results
  • Script Wizard added for MQTT
  • Snapshot viewer supported for TruWeb scripts
  • TruClient now includes a VTS API function that replaces a specific value inside a set of columns with a new value.
  • Reduced memory consumption in load mode for TruClient browser
2020December 17, 2019LoadRunner 2020
  • New protocol called DevWeb has been added
  • Webservices has new WDF toolkit
  • Partial modern user interface and icons
  • LoadRunner Enterprise Integration
  • Online graphs in Controller with rich UI controls
  • SAP - Web protocol now supports Recording Report, predefined DFE, Asynchronous communication, and HAR file generation after replay
  • TruClient protocol has new search and toolbox with the latest Chromium and TruClient browser support
  • TruClient has new client side performance measurements
2020 Service Pack 1April 2, 2020LoadRunner 2020 Service Pack 1
  • Enhancements have been done in DevWeb, TruClient, Web Services, Citrix ICA, VTS, and Integration with LoadRunner Enterprise.
2020 Service Pack 2July 1, 2020LoadRunner 2020 Service Pack 2
  • Enhancements have been done in DevWeb, TruClient, PCoIP protocol, PCAP recording, VTS, and Integration with LoadRunner Enterprise.
  • This version introduces OneLG, a combined load generator installation for all of the LoadRunner family products. You select the relevant LoadRunner family product during installation, and can later swap to a different product if required.
  • Support for the execution of Gatling performance testing assets as part of Controller scenarios. This feature is currently available as tech preview.
2020 Service Pack 3September 29, 2020LoadRunner 2020 Service Pack 3
  • Enhancements have been done in DevWeb, TruClient, .NET protocol.
  • TeamCity Plugin
  • Usage Analytics tool
2021January 12, 2021LoadRunner 2021
  • new DevWeb Engine
  • DevWeb gRPC support
  • DevWeb Correlation Candidates
  • Dynatrace SaaS and Managed Integration
  • Selenium scripts support
2021 R1R1April 29, 2021LoadRunner 2021 R1
  • Full code completion in DevWeb
  • CA certificate generation in DevWeb
  • DevWeb gRPC support
  • HLS Live Streaming Support in Web HTTP/HTML
  • Java scripts support in Linux LGs
  • Silk Performance support
  • Round robin distribution of Vusers
2021 R2R2October, 2021
  • Silk Performer integration
  • Azure Insights monitoring
  • LoadRunner Enterprise integration
2022February, 2022
  • Kafka Protocol
  • Support for Azure Key Vault
  • Chaos testing with Gremlin
  • LoadRunner Data Hub
  • UTF-8 encoding for non-English character display
2022 R1R1June, 2022
  • Prometheus integration
  • Controller online dashboard modernization
  • Citrix Workspace 2203 LTSR support
  • SLA support for Selenium scripts
2022 R2R2October, 2022
  • .NET Plus protocol
  • PCoIP protocol support for VMware Horizon 8
  • VTS support for Docker
  • Datadog integration
  • IPv6 communication support
  • Dynamic monitoring for Windows Resources monitor
  • Smart Vuser allocation
2023March, 2023
  • User experience
  • Data and analytics
  • VuGen, protocols, and LoadRunner Developer
  • Load testing and modeling
  • Cloud and SaaS
  • Integrations and ecosystem
  • Modernization
  • Security and infrastructure
  • PCoIP protocol support for VMware Horizon 8
  • VTS support for Docker
  • Datadog integration
  • IPv6 communication support
  • Dynamic monitoring for Windows Resources monitor
  • Smart Vuser allocation

[8]

2023R1R1July, 2023
  • Window size and location
  • Usage analytics report update
  • SLA support for APDEX
  • Load generator distribution for Vuser group scenarios
  • Ubuntu Server Linux 22.04 LTS 64-bit.
  • Load generators can now be installed on Red Hat Enterprise Linux 9
  • Chaos testing support for Steadybit on-premise server
  • Online monitor graphs enhancements
  • Automatic reconnect for load generators
  • Installation of Gatling and JMeter is now optional for load generators
  • VTS now supports LDAPS connection to the domain controller for NTLM authentication.
  • TruClient protocols include the following updates:Upgraded browser version support Chromium: Version 113 TruClient Browser: Equivalent to Firefox version 110
  • This release introduces the new Cloud for AWS protocol. With this protocol, you can create Vuser scripts to monitor the usage of Amazon Simple Queue Service (SQS)
  • DevWeb and Web protocol updates
  • SAPGUI updates
  • Kubernetes orchestrator updates
  • The LoadRunner Enterprise Administration REST API enables you to un-assign a user, specified by ID, from a specific project
24.124.1Feb, 2024
  • SteadyBit chaos integration
  • New simplified masthead
  • Redesigned module navigation menu.
  • The load test Dashboard was replaced with a Home Page
  • The LoadRunner Enterprise Administration dashboard now refreshes automatically to provide you with live updates and notifications.
  • REST APIs are now supported for updating passwords in various LoadRunner Enterprise components and configuration tools. This lets you change passwords more easily, with minimal user intervention.
  • To reduce the risk of credential-based attacks, LoadRunner Enterprise’s built-in authentication now includes user lockout settings. These settings let you determine how many unsuccessful login attempts are allowed within a specified time frame before a user is locked out.
  • LoadRunner Enterprise now supports working on a FIPS-enabled environment. It is compliant with the FIPS 140-2 standard, for the protection of sensitive or valuable data.
  • You can now install a LoadRunner Web Recorder extension in Chrome to record events for a Vuser script. This allows you to create scripts in cases where the security policy blocks the standard VuGen recorder.
  • This release includes an integration with CyberArk, providing support for use of CyberArk identity security for privileged accounts. A new LoadRunner API enables you to connect to the CyberArk vault and query for passwords.
  • VuGen contains a new script designer for creating AWS protocol scripts. Using the script designer, you can generate an SQS script without having to manually insert code
  • TruClient browser updates 118-120
  • Citrix, Java and SAP updates to latest versions
  • You can now push real-time data from a Controller scenario run to the Datadog platform. The sent data includes performance metrics and scenario details from the run.

Scripting Languages

LoadRunner client emulation scripts are usually created using the ANSI C programming language. [9] However, Java [10] and .Net programs can also be run by LoadRunner. Version 12.50 added the use of JavaScript for Web-HTTP/HTML scripts.

Scripts from other testing tools such as Apache JMeter, Gatling, NUnit, and Selenium can be run by LoadRunner by declaring an interface library. This enables scripts to send key-value pairs to the Controller as the script runs, enabling response times to be associated with specific conditions such as the number of items displayed in the User Interface.

LoadRunner scripts can also be called from within Jenkins.

Support for JMeter Tests

LoadRunner 12.55 enables testers to run Apache JMeter scripts from Controller, alongside Vuser scripts can view the results to LoadRunner measurements. This feature is provided as beta version. [11]

Related Research Articles

An application server is a server that hosts applications or software that delivers a business application through a communication protocol. For a typical web application, the application server sits behind the web servers.

<span class="mw-page-title-main">Visual programming language</span> Programming language written graphically by a user

In computing, a visual programming language, also known as diagrammatic programming, graphical programming or block coding, is a programming language that lets users create programs by manipulating program elements graphically rather than by specifying them textually. A VPL allows programming with visual expressions, spatial arrangements of text and graphic symbols, used either as elements of syntax or secondary notation. For example, many VPLs are based on the idea of "boxes and arrows", where boxes or other screen objects are treated as entities, connected by arrows, lines or arcs which represent relations. VPLs are generally the basis of low-code development platforms.

HP OpenView is the former name for a Hewlett-Packard product family that consisted of network and systems management products. In 2007, HP OpenView was rebranded as HP BTO Software when it became part of the HP Software Division. The products were available as various HP products, marketed through the HP Software Division. HP Software became part of HPE after the HP/HPE split and HPE Software was eventually sold to MicroFocus.

<span class="mw-page-title-main">Apache JMeter</span> Open-source performance testing software

Apache JMeter is an Apache project that can be used as a load testing tool for analyzing and measuring the performance of a variety of services, with a focus on web applications.

<span class="mw-page-title-main">Opsware</span> Software company

Opsware, Inc. was a software company based in Sunnyvale, California, that offered products for server and network device provisioning, configuration, and management targeted toward enterprise customers. Opsware had offices in New York City, Redmond, Washington, Cary, North Carolina, and an engineering office in Cluj, Romania.

TACL is the scripting programming language which acts as the shell in Tandem Computers/NonStop computers.

Silk Test is a tool for automated function and regression testing of enterprise applications. It was originally developed by Segue Software which was acquired by Borland in 2006. Borland was acquired by Micro Focus International in 2009 and Micro Focus was later acquired by OpenText in 2023. The original name for the product from 1993 through 1996 was QA Partner.

A web framework (WF) or web application framework (WAF) is a software framework that is designed to support the development of web applications including web services, web resources, and web APIs. Web frameworks provide a standard way to build and deploy web applications on the World Wide Web. Web frameworks aim to automate the overhead associated with common activities performed in web development. For example, many web frameworks provide libraries for database access, templating frameworks, and session management, and they often promote code reuse. Although they often target development of dynamic web sites, they are also applicable to static websites.

<span class="mw-page-title-main">Mercury Interactive</span> Israeli company

Mercury Interactive Corporation was an Israeli company acquired by the HP Software Division. Mercury offered software for application management, application delivery, change and configuration management, service-oriented architecture, change request, quality assurance, and IT governance.

OpenText Content Manager is a proprietary electronic document and records management system (EDRMS).

<span class="mw-page-title-main">IBM TPNS</span> Test automation tool developed by IBM

Teleprocessing Network Simulator (TPNS) is an IBM licensed program, first released in 1976 as a test automation tool to simulate the end-user activity of network terminal(s) to a mainframe computer system, for functional testing, regression testing, system testing, capacity management, benchmarking and stress testing.

SiteScope is agentless monitoring software focused on monitoring the availability and performance of distributed IT infrastructures, including Servers, Network devices and services, Applications and application components, operating systems and various IT enterprise components.

<span class="mw-page-title-main">UFT One</span> Software testing automation tool

OpenText™ UFT One, an AI-powered functional testing tool, accelerates test automation across desktop, web, mobile, mainframe, composite, and packaged enterprise-grade applications.

A single-page application (SPA) is a web application or website that interacts with the user by dynamically rewriting the current web page with new data from the web server, instead of the default method of loading entire new pages. The goal is faster transitions that make the website feel more like a native app.

OpenText Quality Center, formerly known as Micro Focus Quality Center and HP Quality Center, is a quality management software offered by OpenText who acquired Micro Focus in 2023. Micro Focus acquired the software division of Hewlett Packard Enterprise in 2017, with many capabilities acquired from Mercury Interactive Corporation. Quality Center offers software quality assurance, including requirements management, test management and business process testing for IT and application environments. Quality Center is a component of the Micro Focus Application Lifecycle Management software set.

Eucalyptus is a paid and open-source computer software for building Amazon Web Services (AWS)-compatible private and hybrid cloud computing environments, originally developed by the company Eucalyptus Systems. Eucalyptus is an acronym for Elastic Utility Computing Architecture for Linking Your Programs To Useful Systems. Eucalyptus enables pooling compute, storage, and network resources that can be dynamically scaled up or down as application workloads change. Mårten Mickos was the CEO of Eucalyptus. In September 2014, Eucalyptus was acquired by Hewlett-Packard and then maintained by DXC Technology. After DXC stopped developing the product in late 2017, AppScale Systems forked the code and started supporting Eucalyptus customers.

Silk Performer is a software performance testing tool that is used to test and ensure efficient performance across various platforms including web, mobile, and enterprise applications. The tool was originally developed by Segue Software, which was later acquired by Borland in 2006. Subsequently, Borland became a part of Micro Focus in 2009. Micro Focus was later acquired by OpenText in 2023.

<span class="mw-page-title-main">Gatling (software)</span>

Gatling is a load- and performance-testing framework based on Scala, Akka and Netty. The first stable release was published on January 13, 2012. In 2015, Gatling's founder, Stéphane Landelle, created a company, dedicated to the development of the open-source project. According to Gatling Corp's official website, Gatling was downloaded more than 20,000,000 times (2024). In June 2016, Gatling officially presented Gatling FrontLine, Gatling's Enterprise Version with additional features.

Micro Focus Service Manager is one of the applications acquired by Micro Focus when it purchased part of Hewlett-Packard Enterprise Software (HPES) in 2017. Before 2017, it was owned by HP when it purchased Peregrine Systems in 2005. The application was originally known as PNMS. After releasing the first version of PNMS, Peregrine Systems eventually added functionality such as Request Management, Call Management, and Change Management and rebranded the application as Peregrine ServiceCenter.

The term load testing or stress testing is used in different ways in the professional software testing community. Load testing generally refers to the practice of modeling the expected usage of a software program by simulating multiple users accessing the program concurrently. As such, this testing is most relevant for multi-user systems; often one built using a client/server model, such as web servers. However, other types of software systems can also be load tested. For example, a word processor or graphics editor can be forced to read an extremely large document; or a financial package can be forced to generate a report based on several years' worth of data. The most accurate load testing simulates actual use, as opposed to testing using theoretical or analytical modeling.

References

  1. Mar, Wilson. "LoadRunner architecture". Wilsonmar.com. Retrieved 2 April 2015.
  2. Krazit, Tom. "HP snaps up Mercury Interactive". CNET. CBS Interactive Inc. Retrieved 2 April 2015.
  3. "HP To Acquire Mercury Interactive For $4.5 Billion". Information Week. UBM Tech. 25 July 2006. Retrieved 2 April 2015.
  4. "HPE selling software business to Micro Focus". ZDNet . Retrieved 2016-11-30.
  5. "Micro Focus Completes Merger with HPE Software Business, Creating One of World's Largest Pure-play Software Companies | Micro Focus". www.microfocus.com. Retrieved 2017-10-19.
  6. "A New Beginning: Reflecting on 2019, Welcoming LoadRunner 2020| Micro Focus". www.microfocus.com. 17 December 2019. Retrieved 2019-12-17.
  7. Colantonio, Joe (30 August 2012). "LoadRunner 11.50 Licensing Change and Protocol Bundles". JoeColantonio.com. Retrieved 2 April 2015.
  8. "What's New in LoadRunner Enterprise".
  9. "C Vuser Scripts". Archived from the original on 2017-04-07. Retrieved 2017-04-06.
  10. "Java Vuser Protocol". Archived from the original on 2017-04-07. Retrieved 2017-04-06.
  11. "JMeter Tests". Archived from the original on 2017-08-18.