Ad hoc testing

Last updated

Ad hoc testing is a commonly used term for planned software testing that is performed without initial test case documentation; [1] however, ad hoc testing can also be applied to other scientific research and quality control efforts. [2] Ad hoc tests are useful for adding additional confidence to a resulting product or process, as well as quickly spotting important defects or inefficiencies, [1] [3] but they have some disadvantages, such as having inherent uncertainties in their performance [4] [5] and not being as useful without proper documentation post-execution and -completion. [1] [3] Occasionally, ad hoc testing is compared to exploratory testing as being less rigorous, though others argue that ad hoc testing still has value as "improvised testing that deals well with verifying a specific subject." [6]

Contents

Ad hoc testing of software

When testing software, that testing may be methodical or more improvisational. Methodical testing will include written test cases, which detail their own set of specified inputs, execution conditions, testing procedures, and expected results as a means of achieving a particular software testing objective. [7] Ad hoc testing may have a more "improvisational" feel to it as initial test cases are not documented and the tester's intuition, skillset, and experience are more relevant; [1] [3] however, ad hoc testing of software is still largely a planned activity. [1] The tester still intends to apply—as part of the overall software development process—their own methodology to find bugs not anticipated for by planned test cases using any means that seem appropriate given the situation. [1] [3] Ad hoc testing can, for example, be an extension of existing documented test cases but intend to apply invented variations of those test cases improvisationally without formally documenting the specifics beforehand. [3] However, as Desikan notes, to get the most from an ad hoc test and limit its downsides, the test should be properly documented post-execution and -completion, and the results report should address how any defects were identified in a step-by-step manner. [1]

Ad hoc testing in other scientific pursuits

Ad hoc testing is not limited to software development. Ad hoc testing has been applied in other scientific and quality management scenarios. For example, ad hoc testing has been applied in standardized on-site testing at healthcare facilities of "the electromagnetic immunity of medical devices and help identify interference issues that might exist with critical medical devices as a result of emissions from RF transmitters," using IEEE/ANSI C63.18-2014. [2] [4] [5] [8] Other areas where ad hoc testing has been applied include:

Related Research Articles

<span class="mw-page-title-main">Acceptance testing</span> Test to determine if the requirements of a specification or contract are met

In engineering and its various subdisciplines, acceptance testing is a test conducted to determine if the requirements of a specification or contract are met. It may involve chemical tests, physical tests, or performance tests.

In computer science, static program analysis is the analysis of computer programs performed without executing them, in contrast with dynamic program analysis, which is performed on programs during their execution.

Software testing is the act of examining the artifacts and the behavior of the software under test by validation and verification. Software testing can also provide an objective, independent view of the software to allow the business to appreciate and understand the risks of software implementation. Test techniques include, but are not necessarily limited to:

<span class="mw-page-title-main">Wireless network</span> Computer network not fully connected by cables

A wireless network is a computer network that uses wireless data connections between network nodes. Wireless networking allows homes, telecommunications networks and business installations to avoid the costly process of introducing cables into a building, or as a connection between various equipment locations. Admin telecommunications networks are generally implemented and administered using radio communication. This implementation takes place at the physical level (layer) of the OSI model network structure.

<span class="mw-page-title-main">Electromagnetic radiation and health</span> Aspect of public health

Electromagnetic radiation can be classified into two types: ionizing radiation and non-ionizing radiation, based on the capability of a single photon with more than 10 eV energy to ionize atoms or break chemical bonds. Extreme ultraviolet and higher frequencies, such as X-rays or gamma rays are ionizing, and these pose their own special hazards: see radiation poisoning.

Conformance testing — an element of conformity assessment, and also known as compliance testing, or type testing — is testing or other activities that determine whether a process, product, or service complies with the requirements of a specification, technical standard, contract, or regulation. Testing is often either logical testing or physical testing. The test procedures may involve other criteria from mathematical testing or chemical testing. Beyond simple conformance, other requirements for efficiency, interoperability or compliance may apply. Conformance testing may be undertaken by the producer of the product or service being assessed, by a user, or by an accredited independent organization, which can sometimes be the author of the standard being used. When testing is accompanied by certification, the products or services may then be advertised as being certified in compliance with the referred technical standard. Manufacturers and suppliers of products and services rely on such certification including listing on the certification body's website, to assure quality to the end user and that competing suppliers are on the same level.

In computer programming, unit testing is a software testing method by which individual units of source code—sets of one or more computer program modules together with associated control data, usage procedures, and operating procedures—are tested to determine whether they are fit for use.

In software engineering, a test case is a specification of the inputs, execution conditions, testing procedure, and expected results that define a single test to be executed to achieve a particular software testing objective, such as to exercise a particular program path or to verify compliance with a specific requirement. Test cases underlie testing that is methodical rather than haphazard. A battery of test cases can be built to produce the desired coverage of the software being tested. Formally defined test cases allow the same tests to be run repeatedly against successive versions of the software, allowing for effective and consistent regression testing.

<span class="mw-page-title-main">Medical device</span> Device to be used for medical purposes

A medical device is any device intended to be used for medical purposes. Significant potential for hazards are inherent when using a device for medical purposes and thus medical devices must be proved safe and effective with reasonable assurance before regulating governments allow marketing of the device in their country. As a general rule, as the associated risk of the device increases the amount of testing required to establish safety and efficacy also increases. Further, as associated risk increases the potential benefit to the patient must also increase.

<span class="mw-page-title-main">Electrotherapy</span> Use of electricity for medical purposes

Electrotherapy is the use of electrical energy as a medical treatment. In medicine, the term electrotherapy can apply to a variety of treatments, including the use of electrical devices such as deep brain stimulators for neurological disease. The term has also been applied specifically to the use of electric current to speed wound healing. Additionally, the term "electrotherapy" or "electromagnetic therapy" has also been applied to a range of alternative medical devices and treatments.

A test plan is a document detailing the objectives, resources, and processes for a specific test for a software or hardware product. The plan typically contains a detailed understanding of the eventual workflow.

Exploratory testing is an approach to software testing that is concisely described as simultaneous learning, test design and test execution. Cem Kaner, who coined the term in 1984, defines exploratory testing as "a style of software testing that emphasizes the personal freedom and responsibility of the individual tester to continually optimize the quality of his/her work by treating test-related learning, test design, test execution, and test result interpretation as mutually supportive activities that run in parallel throughout the project."

Nambudripad's Allergy Elimination Techniques (NAET) is a form of alternative medicine which proponents claim can treat allergies and related disorders. The techniques were devised by Devi Nambudripad, a California-based chiropractor and acupuncturist, in 1983, drawing on a combination of ideas from applied kinesiology, acupuncture, acupressure, nutritional management, and chiropractic methods.

Functional testing is a quality assurance (QA) process and a type of black-box testing that bases its test cases on the specifications of the software component under test. Functions are tested by feeding them input and examining the output, and internal program structure is rarely considered. Functional testing is conducted to evaluate the compliance of a system or component with specified functional requirements. Functional testing usually describes what the system does.

A wireless ad hoc network (WANET) or mobile ad hoc network (MANET) is a decentralized type of wireless network. The network is ad hoc because it does not rely on a pre-existing infrastructure, such as routers or wireless access points. Instead, each node participates in routing by forwarding data for other nodes. The determination of which nodes forward data is made dynamically on the basis of network connectivity and the routing algorithm in use.

Manual testing is the process of manually testing software for defects. It requires a tester to play the role of an end user where by they use most of the application's features to ensure correct behaviour. To guarantee completeness of testing, the tester often follows a written test plan that leads them through a set of important test cases.

Verification and validation are independent procedures that are used together for checking that a product, service, or system meets requirements and specifications and that it fulfills its intended purpose. These are critical components of a quality management system such as ISO 9000. The words "verification" and "validation" are sometimes preceded with "independent", indicating that the verification and validation is to be performed by a disinterested third party. "Integration verification and validation" can be abbreviated as "IV&V".

<span class="mw-page-title-main">Monitoring (medicine)</span> Observation of a disease, condition or one or several medical parameters over time

In medicine, monitoring is the observation of a disease, condition or one or several medical parameters over time.

Ulrich Jakobus is Senior Vice President - Electromagnetic Solutions of Altair, Germany and was awarded Fellow of the Institute of Electrical and Electronics Engineers (IEEE) in 2013 for leadership in hybrid computational tool development and commercialization. His research laid the foundations for the commercial electromagnetics code FEKO which is used in antenna design, antenna placement, electromagnetic compatibility, microwave components, bioelectromagnetics, radar cross section and related fields.

Bioelectromagnetic medicine deals with the phenomenon of resonance signaling and discusses how specific frequencies modulate cellular function to restore or maintain health. Such electromagnetic (EM) signals are then called "medical information" that is used in health informatics.

References

  1. 1 2 3 4 5 6 7 Desikan, Srinivasan (2006). "Chapter 10: Ad hoc testing". Software testing : principles and practices. Gopalaswamy Ramesh. Bangalore, India: Dorling Kindersley (India). ISBN   81-7758-121-X. OCLC   560339747.
  2. 1 2 Coletta, J.N.; Boivin, W.S.; Boyd, S.M.; et al. (April 2000). "Test Results from Using the American National Standards Institute (ANSI) C63.18 Ad Hoc Test Method for Estimating Radiated Electromagnetic Immunity of Medical Devices to Specific Radio Frequency (RF) Transmitters". Laboratory Information Bulletin. 16 (4). 4209. Retrieved 21 September 2022.
  3. 1 2 3 4 5 Lewis, William E. (2009). Software testing and continuous quality improvement. David Dobbs, Gunasekaran Veerapillai (3rd ed.). Boca Raton: Auerbach Publications. pp. 68–71. ISBN   978-1-4398-3436-7. OCLC   471136117.
  4. 1 2 Turcotte, J.; Witters, D. (1998). "A practical technique for assessing electromagnetic interference in the clinical setting: ad hoc testing". Biomedical Instrumentation & Technology. 32 (3): 241–252. ISSN   0899-8205. PMID   9619253.
  5. 1 2 Nogueira-Neto, G.N.; Nohama, P.; de Moura, M.A.; de Paula, S.B. (2003). "Ad hoc test protocols for determination of electromagnetic interference caused by cell phones on electro-medical devices". Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439). Cancun, Mexico: IEEE. pp. 3621–3624. doi:10.1109/IEMBS.2003.1280937. ISBN   978-0-7803-7789-9. S2CID   60581450.
  6. "Systems VVT Methods: Testing", Verification, Validation, and Testing of Engineered Systems, Hoboken, NJ, USA: John Wiley & Sons, Inc., p. 447, 2010-07-29, doi:10.1002/9780470618851.ch5, ISBN   978-0-470-61885-1
  7. 24765-2010 - ISO/IEC/IEEE International Standard - Systems and software engineering -- Vocabulary. IEEE. 2010. ISBN   978-0-7381-6205-8. OCLC   1112398949.
  8. "IEEE/ANSI C63.18-2014". American National Standards Institute. Retrieved 21 September 2022.
  9. Spreen, Otfried (2003). "Chapter 5: Clinical Bedside Examination". Assessment of aphasia. Anthony H. Risser. Oxford: Oxford University Press. p. 46. ISBN   978-0-19-803225-0. OCLC   314216057.
  10. Jeffery-Smith, Anna; Rowland, Thomas A J; Patel, Monika; Whitaker, Heather; Iyanger, Nalini; Williams, Sarah V; Giddings, Rebecca; Thompson, Leah; Zavala, Maria; Aiano, Felicity; Ellis, Joanna; Lackenby, Angie; Höschler, Katja; Brown, Kevin; Ramsay, Mary E (2021). "Reinfection with new variants of SARS-CoV-2 after natural infection: a prospective observational cohort in 13 care homes in England". The Lancet Healthy Longevity. 2 (12): e811–e819. doi:10.1016/S2666-7568(21)00253-1. PMC   8635459 . PMID   34873592.
  11. Powell, Andy; Baker-Austin, Craig; Wagley, Sariqa; Bayley, Amanda; Hartnell, Rachel (2013). "Isolation of Pandemic Vibrio parahaemolyticus from UK Water and Shellfish Produce". Microbial Ecology. 65 (4): 924–927. doi:10.1007/s00248-013-0201-8. ISSN   0095-3628. PMID   23455432. S2CID   253768828.
  12. Holst-Jensen, A. (2012). "Chapter 37: Testing for genetically modified organisms (GMOs) revealed the real source of rice imported to Norway". Case studies in food safety and authenticity: Lessons from real-life situations. J. Hoorfar. Oxford: Woodhead Pub. p. 338. ISBN   978-0-85709-693-7. OCLC   805627736.
  13. Ashford, Robert D.; Brown, Austin M.; Curtis, Brenda (2018). "Systemic barriers in substance use disorder treatment: A prospective qualitative study of professionals in the field". Drug and Alcohol Dependence. 189: 62–69. doi:10.1016/j.drugalcdep.2018.04.033. PMID   29883870. S2CID   47011510.
  14. Humphries, Romney M (2022-09-01). "Ad Hoc Antimicrobial Susceptibility Testing from MALDI-TOF MS Spectra in the Clinical Microbiology Laboratory". Clinical Chemistry. 68 (9): 1118–1120. doi:10.1093/clinchem/hvac044. ISSN   0009-9147. PMID   35352088.