Techila Grid

Last updated
Techila Distributed Computing Engine
Developer(s) Techila Technologies Ltd
Operating system Windows, Linux
Type distributed computing, grid computing, middleware
License Proprietary
Website www.techilatechnologies.com

The Techila Distributed Computing Engine (earlier known as Techila Grid) is a commercial grid computing software product. Techila Distributed Computing Engine is developed and licensed by Techila Technologies Ltd, a privately held company headquartered in Tampere, Finland. The product is also available as an on-demand solution in Google Cloud Launcher, the online marketplace created and operated by Google.

Contents

According to IDC, Techila enables organizations to create HPC infrastructure without the capital investments and operating expenses required by new HPC hardware. [1]

Product features

Techila Distributed Computing Engine is a distributed computing middleware and management solution, which can be used to access and manage on-premises and cloud IT resources for various high-performance computing (HPC) uses, including high-throughput computing (HTC) scenarios. It creates a scalable computing service and execution environment that can also support applications that are deployed within production environments.

The technology of Techila Distributed Computing Engine is built on an autonomic computing architecture that is patented by Techila Technologies. This has facilitated the development of features such as automated system management and fault tolerance, which can simplify the deployment, use, and administration of large-scale distributed computing systems.

Architecture

Techila Server

Techila Server is a Java-based software product, which is designed to optimize the performance of a Techila Distributed Computing Engine environment and the jobs in it. The optimization done by Techila Server supports large jobs, and can also make the system suitable for running small computational jobs. The performance of Techila Distributed Computing Engine in different scenarios was evaluated in a thesis at the Tampere University of Technology. [2]

Originally, the Techila Server was delivered as an embedded appliance. The embedded appliance product was discontinued in 2012. Currently, Techila Server is delivered either as a virtual appliance or using cloud-specific deployment tools. [3]

Techila Worker

Techila Worker is the software agent that must be installed on each computer that will participate in a Techila Distributed Computing Engine environment. The computers can be physical, or they can be virtualized computers running on a hypervisor or in a cloud virtual machine. Techila Distributed Computing Engine supports following public cloud services: Microsoft Azure, Amazon ec2 and Google Compute Engine. Once the Techila Worker software is installed on a computer, it will authenticate the computer to the Techila Server using a certificate, and the system will use self-management to automatically configure the computer to run jobs received from the Techila Server. [ citation needed ]

Techila Worker is a Java-based client middleware component that can be run on Microsoft Windows or Linux. Because of this, the client computers participating in the Techila Distributed Computing Engine system can have different hardware and software platforms. Techila Worker software runs on the lowest possible priority on the computer. [ citation needed ] The Techila Worker is also interoperable with batch-queuing systems, like the SLURM, TORQUE, or Oracle Grid Engine (previously known as Sun Grid Engine, SGE). [ citation needed ] This interoperability allows existing HPC users to use their existing infrastructures as a part of a Techila Distributed Computing Engine system without the Techila Worker interfering with the other system.

Techila SDK

Techila SDK (earlier known as Techila Grid Management Kit or Techila GMK) is a library of software components that connect applications to the Techila Distributed Computing Engine environment. The SDK includes plug-ins for many commonly used research and development tools and languages, such as MATLAB, R, Python, Perl, Java, C#/ .NET C/ C++, FORTRAN, and Command-line interface script. The applications that have been developed using application programming interfaces in the Techila SDK can also be deployed within production environments and run as a service in a SOA environment. Techila SDK supports both Windows and Linux operating systems.

Administrator User Interface

A web-based Administrator User Interface provides administrators an interface to the Techila Server. The Administrator User Interface allows monitoring system activity, view and control job execution, execution policy, monitor and control Techila Workers and Techila Worker Groups, control security settings, and manage users.

History

The motivation for Techila Distributed Computing Engine was to simplify grid computing, enabling fast simulations, and analyses without the complexity associated with traditional high-performance computing systems.

The security of the Techila Distributed Computing Engine was evaluated by Nixu Ltd in 2008. Following this evaluation, the technology gained acceptance in security-sensitive industries, including Finance and Insurance, Engineering, and Pharmaceuticals.

In 2011, a research team at the University of Helsinki demonstrated the Techila Distributed Computing Engine’s ability to autonomously manage large-scale computing environments, including extensive deployments of Windows Azure cloud instances. The University also showcased how the engine enhances the usability and efficiency of large-scale cluster resources in projects utilizing MATLAB, R, Python, Java, and C/ C++/ C#.

The Techila Distributed Computing Engine system allows computational resources to be organized into device groups, to improve control for organizational, security, compliance, and administrative needs. Despite its capacity for managing large-scale systems such as CSC – IT Center For Science, the engine is equally effective in smaller environments. For instance, the TUTGrid at Tampere University of Technology uses Techila to harness idle capacity from desktop PC s and other computers for scientific computing tasks.

Related Research Articles

In computing, cross-platform software is computer software that is designed to work in several computing platforms. Some cross-platform software requires a separate build for each platform, but some can be directly run on any platform without special preparation, being written in an interpreted language or compiled to portable bytecode for which the interpreters or run-time packages are common or standard components of all supported platforms.

<span class="mw-page-title-main">High-performance computing</span> Computing with supercomputers and clusters

High-performance computing (HPC) uses supercomputers and computer clusters to solve advanced computation problems.

Oracle Grid Engine, previously known as Sun Grid Engine (SGE), CODINE or GRD, was a grid computing computer cluster software system, acquired as part of a purchase of Gridware, then improved and supported by Sun Microsystems and later Oracle. There have been open source versions and multiple commercial versions of this technology, initially from Sun, later from Oracle and then from Univa Corporation.

A Rich Internet Application is a web application that has many of the characteristics of desktop application software. The concept is closely related to a single-page application, and may allow the user interactive features such as drag and drop, background menu, WYSIWYG editing, etc. The concept was first introduced in 2002 by Macromedia to describe Macromedia Flash MX product. Throughout the 2000s, the term was generalized to describe browser-based applications developed with other competing browser plugin technologies including Java applets, Microsoft Silverlight.

UNICORE (UNiform Interface to COmputing REsources) is a grid computing technology for resources such as supercomputers or cluster systems and information stored in databases. UNICORE was developed in two projects funded by the German ministry for education and research (BMBF). In European-funded projects UNICORE evolved to a middleware system used at several supercomputer centers. UNICORE served as a basis in other research projects. The UNICORE technology is open source under BSD licence and available at SourceForge.

Warewulf is a computer cluster implementation toolkit that facilitates the process of installing a cluster and long term administration.

Apache Hadoop is a collection of open-source software utilities for reliable, scalable, distributed computing. It provides a software framework for distributed storage and processing of big data using the MapReduce programming model. Hadoop was originally designed for computer clusters built from commodity hardware, which is still the common use. It has since also found use on clusters of higher-end hardware. All the modules in Hadoop are designed with a fundamental assumption that hardware failures are common occurrences and should be automatically handled by the framework.

Within cluster and parallel computing, a cluster manager is usually backend graphical user interface (GUI) or command-line interface (CLI) software that runs on a set of cluster nodes that it manages. The cluster manager works together with a cluster management agent. These agents run on each node of the cluster to manage and configure services, a set of services, or to manage and configure the complete cluster server itself In some cases the cluster manager is mostly used to dispatch work for the cluster to perform. In this last case a subset of the cluster manager can be a remote desktop application that is used not for configuration but just to send work and get back work results from a cluster. In other cases the cluster is more related to availability and load balancing than to computational or specific service clusters.

<span class="mw-page-title-main">Univa</span> Software company

Univa was a software company that developed workload management and cloud management products for compute-intensive applications in the data center and across public, private, and hybrid clouds, before being acquired by Altair Engineering in September 2020.

<span class="mw-page-title-main">Google App Engine</span> Cloud-based web application hosting service

Google App Engine is a cloud computing platform used as a service for developing and hosting web applications. Applications are sandboxed and run across multiple Google-managed servers. GAE supports automatic scaling for web applications, allocating more resources to the web application as the amount of requests increases. It was released as a preview in April 2008 and launched officially in September 2011.

Platform as a service (PaaS) or application platform as a service (aPaaS) or platform-based service is a cloud computing service model where users provision, instantiate, run and manage a modular bundle of a computing platform and applications, without the complexity of building and maintaining the infrastructure associated with developing and launching application(s), and to allow developers to create, develop, and package such software bundles.

<span class="mw-page-title-main">Computer cluster</span> Set of computers configured in a distributed computing system

A computer cluster is a set of computers that work together so that they can be viewed as a single system. Unlike grid computers, computer clusters have each node set to perform the same task, controlled and scheduled by software. The newest manifestation of cluster computing is cloud computing.

Web-based simulation (WBS) is the invocation of computer simulation services over the World Wide Web, specifically through a web browser. Increasingly, the web is being looked upon as an environment for providing modeling and simulation applications, and as such, is an emerging area of investigation within the simulation community.

<span class="mw-page-title-main">Cloud computing</span> Form of shared internet-based computing

"Cloud computing is a paradigm for enabling network access to a scalable and elastic pool of shareable physical or virtual resources with self-service provisioning and administration on-demand," according to ISO.

BeeGFS is a parallel file system developed for high-performance computing. BeeGFS includes a distributed metadata architecture for scalability and flexibility reasons. It specializes in data throughput.

HPCC, also known as DAS, is an open source, data-intensive computing system platform developed by LexisNexis Risk Solutions. The HPCC platform incorporates a software architecture implemented on commodity computing clusters to provide high-performance, data-parallel processing for applications utilizing big data. The HPCC platform includes system configurations to support both parallel batch data processing (Thor) and high-performance online query applications using indexed data files (Roxie). The HPCC platform also includes a data-centric declarative programming language for parallel data processing called ECL.

<span class="mw-page-title-main">DIET</span>

DIET is a software for grid-computing. As middleware, DIET sits between the operating system and the application software. DIET was created in 2000. It was designed for high-performance computing. It is currently developed by INRIA, École Normale Supérieure de Lyon, CNRS, Claude Bernard University Lyon 1, SysFera. It is open-source software released under the CeCILL license.

"Serverless computing is a cloud service category in which the customer can use different cloud capabilities types without the customer having to provision, deploy and manage either hardware or software resources, other than providing customer application code or providing customer data. Serverless computing represents a form of virtualized computing." according to ISO/IEC 22123-2 Function as a service and serverless database are two forms of serverless computing.

References

  1. Wu, Jie (2010). The Rise of Grid-Based High-Performance Computing: A Cost-Effective Approach to HPC Acquisition. IDC. p. 7.
  2. Koskinen, Marko (2010). Evaluating the performance of job management systems in different distributed computing environments (PDF). Tampere University of Technology. p. 63.
  3. "Techila - Product". www.techilatechnologies.com. Retrieved 2024-12-12.