Ad hoc testing

Last updated

Ad hoc testing is a commonly used term for planned software testing that is performed without initial test case documentation; [1] however, ad hoc testing can also be applied to other scientific research and quality control efforts. [2] Ad hoc tests are useful for adding additional confidence to a resulting product or process, as well as quickly spotting important defects or inefficiencies, [1] [3] but they have some disadvantages, such as having inherent uncertainties in their performance [4] [5] and not being as useful without proper documentation post-execution and -completion. [1] [3] Occasionally, ad hoc testing is compared to exploratory testing as being less rigorous, though others argue that ad hoc testing still has value as "improvised testing that deals well with verifying a specific subject." [6]

Contents

Ad hoc testing of software

When testing software, that testing may be methodical or more improvisational. Methodical testing will include written test cases, which detail their own set of specified inputs, execution conditions, testing procedures, and expected results as a means of achieving a particular software testing objective. [7] Ad hoc testing may have a more "improvisational" feel to it as initial test cases are not documented and the tester's intuition, skillset, and experience are more relevant; [1] [3] however, ad hoc testing of software is still largely a planned activity. [1] The tester still intends to apply—as part of the overall software development process—their own methodology to find bugs not anticipated for by planned test cases using any means that seem appropriate given the situation. [1] [3] Ad hoc testing can, for example, be an extension of existing documented test cases but intend to apply invented variations of those test cases improvisationally without formally documenting the specifics beforehand. [3] However, as Desikan notes, to get the most from an ad hoc test and limit its downsides, the test should be properly documented post-execution and -completion, and the results report should address how any defects were identified in a step-by-step manner. [1]

Ad hoc testing in other scientific pursuits

Ad hoc testing is not limited to software development. Ad hoc testing has been applied in other scientific and quality management scenarios. For example, ad hoc testing has been applied in standardized on-site testing at healthcare facilities of "the electromagnetic immunity of medical devices and help identify interference issues that might exist with critical medical devices as a result of emissions from RF transmitters," using IEEE/ANSI C63.18-2014. [2] [4] [5] [8] Other areas where ad hoc testing has been applied include:

Related Research Articles

<span class="mw-page-title-main">Acceptance testing</span> Test to determine if the requirements of a specification or contract are met

In engineering and its various subdisciplines, acceptance testing is a test conducted to determine if the requirements of a specification or contract are met. It may involve chemical tests, physical tests, or performance tests.

In computer science, static program analysis is the analysis of computer programs performed without executing them, in contrast with dynamic program analysis, which is performed on programs during their execution in the integrated environment.

<span class="mw-page-title-main">Software testing</span> Checking software against a standard

Software testing is the act of checking whether software satisfies expectations.

<span class="mw-page-title-main">Wireless network</span> Computer network not fully connected by cables

A wireless network is a computer network that uses wireless data connections between network nodes. Wireless networking allows homes, telecommunications networks, and business installations to avoid the costly process of introducing cables into a building, or as a connection between various equipment locations. Admin telecommunications networks are generally implemented and administered using radio communication. This implementation takes place at the physical level (layer) of the OSI model network structure.

<span class="mw-page-title-main">Spread spectrum</span> Spreading the frequency domain of a signal

In telecommunications, especially radio communication, spread spectrum are techniques by which a signal generated with a particular bandwidth is deliberately spread in the frequency domain over a wider frequency band. Spread-spectrum techniques are used for the establishment of secure communications, increasing resistance to natural interference, noise, and jamming, to prevent detection, to limit power flux density, and to enable multiple-access communications.

Conformance testing — an element of conformity assessment, and also known as compliance testing, or type testing — is testing or other activities that determine whether a process, product, or service complies with the requirements of a specification, technical standard, contract, or regulation. Testing is often either logical testing or physical testing. The test procedures may involve other criteria from mathematical testing or chemical testing. Beyond simple conformance, other requirements for efficiency, interoperability, or compliance may apply. Conformance testing may be undertaken by the producer of the product or service being assessed, by a user, or by an accredited independent organization, which can sometimes be the author of the standard being used. When testing is accompanied by certification, the products or services may then be advertised as being certified in compliance with the referred technical standard. Manufacturers and suppliers of products and services rely on such certification including listing on the certification body's website, to assure quality to the end user and that competing suppliers are on the same level.

Unit testing, a.k.a. component or module testing, is a form of software testing by which isolated source code is tested to validate expected behavior.

<span class="mw-page-title-main">Medical device</span> Device to be used for medical purposes

A medical device is any device intended to be used for medical purposes. Significant potential for hazards are inherent when using a device for medical purposes and thus medical devices must be proved safe and effective with reasonable assurance before regulating governments allow marketing of the device in their country. As a general rule, as the associated risk of the device increases the amount of testing required to establish safety and efficacy also increases. Further, as associated risk increases the potential benefit to the patient must also increase.

<span class="mw-page-title-main">Electrotherapy</span> Use of electricity for medical purposes, and to stimulate Muscle for more strength.

Electrotherapy is the use of electrical energy as a medical treatment. In medicine, the term electrotherapy can apply to a variety of treatments, including the use of electrical devices such as deep brain stimulators for neurological disease. The term has also been applied specifically to the use of electric current to speed up wound healing. The use of electromagnetic stimulation or EMS is also very wide for dealing with muscular pain. Additionally, the term "electrotherapy" or "electromagnetic therapy" has also been applied to a range of alternative medical devices and treatments. Evidence supporting the effectiveness of electrotherapy is limited.

A test plan is a document detailing the objectives, resources, and processes for a specific test session for a software or hardware product. The plan typically contains a detailed understanding of the eventual workflow.

Exploratory testing is an approach to software testing that is concisely described as simultaneous learning, test design and test execution. Cem Kaner, who coined the term in 1984, defines exploratory testing as "a style of software testing that emphasizes the personal freedom and responsibility of the individual tester to continually optimize the quality of his/her work by treating test-related learning, test design, test execution, and test result interpretation as mutually supportive activities that run in parallel throughout the project."

A quasi-peak detector is a type of electronic detector or rectifier. Quasi-peak detectors for specific purposes have usually been standardized with mathematically precisely defined dynamic characteristics of attack time, integration time, and decay time or fall-back time.

A wireless ad hoc network (WANET) or mobile ad hoc network (MANET) is a decentralized type of wireless network. The network is ad hoc because it does not rely on a pre-existing infrastructure, such as routers or wireless access points. Instead, each node participates in routing by forwarding data for other nodes. The determination of which nodes forward data is made dynamically on the basis of network connectivity and the routing algorithm in use.

Manual testing is the process of manually testing software for defects. It requires a tester to play the role of an end user where by they use most of the application's features to ensure correct behaviour. To guarantee completeness of testing, the tester often follows a written test plan that leads them through a set of important test cases.

Verification and validation are independent procedures that are used together for checking that a product, service, or system meets requirements and specifications and that it fulfills its intended purpose. These are critical components of a quality management system such as ISO 9000. The words "verification" and "validation" are sometimes preceded with "independent", indicating that the verification and validation is to be performed by a disinterested third party. "Independent verification and validation" can be abbreviated as "IV&V".

<span class="mw-page-title-main">Monitoring (medicine)</span> Observation of a disease, condition or one or several medical parameters over time

In medicine, monitoring is the observation of a disease, condition or one or several medical parameters over time.

Bioelectromagnetic medicine deals with the phenomenon of resonance signaling and discusses how specific frequencies modulate cellular function to restore or maintain health. Such electromagnetic (EM) signals are then called medical information, which are used in health informatics.

<span class="mw-page-title-main">Donald Heirman</span> American engineer

Donald Nestor Heirman was an American electrical engineer and military officer.

The risk-based approach is an enhanced system of the regulation and standardization of Electromagnetic compatibility (EMC) in electronic devices before their commercialization. EMC is essential for ensuring the safety, performance, and quality of electronic devices. However, achieving and maintaining EMC presents a significant challenge due to the rapid development of new products with evolving technologies and features.

References

  1. 1 2 3 4 5 6 7 Desikan, Srinivasan (2006). "Chapter 10: Ad hoc testing". Software testing : principles and practices. Gopalaswamy Ramesh. Bangalore, India: Dorling Kindersley (India). ISBN   81-7758-121-X. OCLC   560339747.
  2. 1 2 Coletta, J.N.; Boivin, W.S.; Boyd, S.M.; et al. (April 2000). "Test Results from Using the American National Standards Institute (ANSI) C63.18 Ad Hoc Test Method for Estimating Radiated Electromagnetic Immunity of Medical Devices to Specific Radio Frequency (RF) Transmitters". Laboratory Information Bulletin. 16 (4). 4209. Retrieved 21 September 2022.
  3. 1 2 3 4 5 Lewis, William E. (2009). Software testing and continuous quality improvement. David Dobbs, Gunasekaran Veerapillai (3rd ed.). Boca Raton: Auerbach Publications. pp. 68–71. ISBN   978-1-4398-3436-7. OCLC   471136117.
  4. 1 2 Turcotte, J.; Witters, D. (1998). "A practical technique for assessing electromagnetic interference in the clinical setting: ad hoc testing". Biomedical Instrumentation & Technology. 32 (3): 241–252. ISSN   0899-8205. PMID   9619253.
  5. 1 2 Nogueira-Neto, G.N.; Nohama, P.; de Moura, M.A.; de Paula, S.B. (2003). "Ad hoc test protocols for determination of electromagnetic interference caused by cell phones on electro-medical devices". Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439). Cancun, Mexico: IEEE. pp. 3621–3624. doi:10.1109/IEMBS.2003.1280937. ISBN   978-0-7803-7789-9. S2CID   60581450.
  6. "Systems VVT Methods: Testing", Verification, Validation, and Testing of Engineered Systems, Hoboken, NJ, USA: John Wiley & Sons, Inc., p. 447, 2010-07-29, doi:10.1002/9780470618851.ch5, ISBN   978-0-470-61885-1
  7. 24765-2010 - ISO/IEC/IEEE International Standard - Systems and software engineering -- Vocabulary. IEEE. 2010. ISBN   978-0-7381-6205-8. OCLC   1112398949.
  8. "IEEE/ANSI C63.18-2014". American National Standards Institute. Retrieved 21 September 2022.
  9. Spreen, Otfried (2003). "Chapter 5: Clinical Bedside Examination". Assessment of aphasia. Anthony H. Risser. Oxford: Oxford University Press. p. 46. ISBN   978-0-19-803225-0. OCLC   314216057.
  10. Jeffery-Smith, Anna; Rowland, Thomas A J; Patel, Monika; Whitaker, Heather; Iyanger, Nalini; Williams, Sarah V; Giddings, Rebecca; Thompson, Leah; Zavala, Maria; Aiano, Felicity; Ellis, Joanna; Lackenby, Angie; Höschler, Katja; Brown, Kevin; Ramsay, Mary E (2021). "Reinfection with new variants of SARS-CoV-2 after natural infection: a prospective observational cohort in 13 care homes in England". The Lancet Healthy Longevity. 2 (12): e811 –e819. doi:10.1016/S2666-7568(21)00253-1. PMC   8635459 . PMID   34873592.
  11. Powell, Andy; Baker-Austin, Craig; Wagley, Sariqa; Bayley, Amanda; Hartnell, Rachel (2013). "Isolation of Pandemic Vibrio parahaemolyticus from UK Water and Shellfish Produce". Microbial Ecology. 65 (4): 924–927. Bibcode:2013MicEc..65..924P. doi: 10.1007/s00248-013-0201-8 . ISSN   0095-3628. PMID   23455432. S2CID   253768828.
  12. Holst-Jensen, A. (2012). "Chapter 37: Testing for genetically modified organisms (GMOs) revealed the real source of rice imported to Norway". Case studies in food safety and authenticity: Lessons from real-life situations. J. Hoorfar. Oxford: Woodhead Pub. p. 338. ISBN   978-0-85709-693-7. OCLC   805627736.
  13. Ashford, Robert D.; Brown, Austin M.; Curtis, Brenda (2018). "Systemic barriers in substance use disorder treatment: A prospective qualitative study of professionals in the field". Drug and Alcohol Dependence. 189: 62–69. doi:10.1016/j.drugalcdep.2018.04.033. PMID   29883870. S2CID   47011510.
  14. Humphries, Romney M (2022-09-01). "Ad Hoc Antimicrobial Susceptibility Testing from MALDI-TOF MS Spectra in the Clinical Microbiology Laboratory". Clinical Chemistry. 68 (9): 1118–1120. doi: 10.1093/clinchem/hvac044 . ISSN   0009-9147. PMID   35352088.