Data mining is the process of extracting and discovering patterns in large data sets involving methods at the intersection of machine learning, statistics, and database systems. Data mining is an interdisciplinary subfield of computer science and statistics with an overall goal of extracting information from a data set and transforming the information into a comprehensible structure for further use. Data mining is the analysis step of the "knowledge discovery in databases" process, or KDD. Aside from the raw analysis step, it also involves database and data management aspects, data pre-processing, model and inference considerations, interestingness metrics, complexity considerations, post-processing of discovered structures, visualization, and online updating.
Text mining, text data mining (TDM) or text analytics is the process of deriving high-quality information from text. It involves "the discovery by computer of new, previously unknown information, by automatically extracting information from different written resources." Written resources may include websites, books, emails, reviews, and articles. High-quality information is typically obtained by devising patterns and trends by means such as statistical pattern learning. According to Hotho et al. (2005) we can distinguish between three different perspectives of text mining: information extraction, data mining, and a knowledge discovery in databases (KDD) process. Text mining usually involves the process of structuring the input text, deriving patterns within the structured data, and finally evaluation and interpretation of the output. 'High quality' in text mining usually refers to some combination of relevance, novelty, and interest. Typical text mining tasks include text categorization, text clustering, concept/entity extraction, production of granular taxonomies, sentiment analysis, document summarization, and entity relation modeling.
SAS is a statistical software suite developed by SAS Institute for data management, advanced analytics, multivariate analysis, business intelligence, criminal investigation, and predictive analytics. SAS' analytical software is built upon artificial intelligence and utilizes machine learning, deep learning and generative AI to manage and model data. The software is widely used in industries such as finance, insurance, health care and education.
Unstructured data is information that either does not have a pre-defined data model or is not organized in a pre-defined manner. Unstructured information is typically text-heavy, but may contain data such as dates, numbers, and facts as well. This results in irregularities and ambiguities that make it difficult to understand using traditional programs as compared to data stored in fielded form in databases or annotated in documents.
Paul (Pawel) Lewicki is a cognitive scientist, an entrepreneur, and investor. He was a professor of cognitive psychology at the University of Tulsa from 1984 through 2009, where he established the Nonconscious Information Processing Laboratory, funded by NSF and NIH. After leaving the university in 2009, he assumed the full-time role of CEO of StatSoft, a multinational analytics software company that he founded and where he was a majority shareholder. On March 24, 2014, StatSoft was sold to Dell.
In the social sciences, coding is an analytical process in which data, in both quantitative form or qualitative form are categorized to facilitate analysis.
Cision Ltd. is a public relations and earned media software company and services provider. The company is incorporated in the Cayman Islands and headquartered in Chicago, Illinois. In addition to offering Cision-branded services, the company owns a portfolio of companies including PRNewswire, PRWeb, Bulletin Intelligence, L'Argus de la presse, Help a Reporter Out (HARO), CEDROM-SNI, Prime Research, and Canada Newswire.
NVivo is a qualitative data analysis (QDA) computer software package produced by Lumivero. NVivo is used across a diverse range of fields, including social sciences such as anthropology, psychology, communication, sociology, as well as fields such as forensics, tourism, criminology and marketing.
XSight was a software for qualitative data analysis. Its last version was released in 2006, which was supported until January 2014. Developed by QSR International for qualitative data analysis (QDA), it is a tool for researchers or individuals who are undertaking short term qualitative research analysis on projects involving non-numerical data. Qualitative research can encompass business intelligence, marketing research or data analysis. It was superseded by NVivo 10 for Windows, which offers equivalent functionality with greater flexibility and enables researchers to work with more data types likes PDFs, surveys, images, video, audio, web and social media content.
Computer-assistedqualitative data analysis software (CAQDAS) offers tools that assist with qualitative research such as transcription analysis, coding and text interpretation, recursive abstraction, content analysis, discourse analysis, grounded theory methodology, etc.
Qualtrics is an American experience management company, with co-headquarters in Seattle, Washington, and Provo, Utah, in the United States. The company was founded in 2002 by Scott M. Smith, Ryan Smith, Jared Smith, and Stuart Orgill.
QSR International is a qualitative research software developer based in Burlington, Massachusetts, with offices in Australia, Germany, New Zealand, and the United Kingdom. QSR International is the developer of qualitative data analysis (QDA) software products, NVivo, NVivo Server, Interpris and XSight. These are designed to help qualitative researchers organize and analyze non-numerical or unstructured data.
Aquad is open source computer-assisted qualitative data analysis software (CAQDAS). It supports analysis of text, audio, video, and graphical data.
QDA Miner is mixed methods and qualitative data analysis software developed by Provalis Research. The program was designed to assist researchers in managing, coding and analyzing qualitative data.
WordStat is a content analysis and text mining software. It was first released in 1998 after being developed by Normand Peladeau from Provalis Research. The latest version 9 was released in 2021.
Quantitative Discourse Analysis Package (qdap) is an R package for computer assisted qualitative data analysis, particularly quantitative discourse analysis, transcript analysis and natural language processing. Qdap is installable from, and runs within, the R system.
Cassandre is a free open source software for computer assisted qualitative data analysis and interpretation in humanities and social sciences. Although it refers, like other CAQDAS-software, to Grounded Theory Method, it also allows to conduct discourse analysis or quantitative content analysis. The software is designed as a server to support collaborative work. Formerly focused on semi-automatic coding, it now provides diaries assisting qualitative analysis.
KH Coder is an open source software for computer assisted qualitative data analysis, particularly quantitative content analysis and text mining. It can be also used for computational linguistics. It supports processing and etymological information of text in several languages, such as Japanese, English, French, German, Italian, Portuguese and Spanish. Specifically, it can contribute factual examination co-event system hub structure, computerized arranging guide, multidimensional scaling and comparative calculations. Word frequency statistics, part-of-speech analysis, grouping, correlation analysis, and visualization are among the features offered by KH Coder.
Cryptojacking is the act of exploiting a computer to mine cryptocurrencies, often through websites, against the user's will or while the user is unaware. One notable piece of software used for cryptojacking was Coinhive, which was used in over two-thirds of cryptojacks before its March 2019 shutdown. The cryptocurrencies mined the most often are privacy coins—coins with hidden transaction histories—such as Monero and Zcash.
