Common modeling infrastructure

Last updated

Common modeling infrastructure refers to software libraries that can be shared across multiple institutions in order to increase software reuse and interoperability in complex modeling systems. Early initiatives were in the climate and weather domain, where software components representing distinct physical domains (for example, ocean or atmosphere) tended to be developed by domain specialists, often at different organizations. In order to create complete applications, these needed to be combined, using for instance a general circulation model, that transfers data between different components. An additional challenge is that these models generally require supercomputers to run, to account for the collected data and for data analyses. Thus, it was important to provide an efficient massively parallel computer system, and the processing hardware and software, to account for all the different workloads and communication channels. [1]

Contents

General

Common modeling infrastructure projects include the Network Common Data Form (NetCDF) library, the Spherical Coordinate Remapping and Interpolation Package (SCRIP), the Flexible Modeling System (FMS), [2] the OASIS coupler developed at CERFACS, and the multi-agency Earth System Modeling Framework (ESMF).

The Earth System Modeling Framework (ESMF) is considered a technical layer, integrated into a common modeling infrastructure. Other aspects of interoperability and shared infrastructure include: common experimental protocols, common analytic methods, common documentation standards for data and data provenance, shared workflow, and shared model components. [3]

History

In the late 1990s and early 2000s, a series of journal papers and government reports described common modeling infrastructure as necessary to the competitiveness and evolution of the U.S. Earth science modeling community. These reports resulted in a number of new community projects. The Earth System Modeling Framework (ESMF) and the Earth System Modeling (ESM) are two of the largest modeling approaches. Similar projects were initiated in related domains, including the Space Weather Modeling Framework (SWMF/CESM), to study conditions including the Sun, solar wind, magnetosphere, ionosphere, and thermosphere that potentially can influence performance and reliability of space-borne and ground-based technological systems or can endanger human life or health.

See also

Related Research Articles

Interoperability is a characteristic of a product or system, whose interfaces are completely understood, to work with other products or systems, at present or in the future, in either implementation or access, without any restrictions. While the term was initially defined for information technology or systems engineering services to allow for information exchange, a broader definition takes into account social, political, and organizational factors that impact system-to-system performance. Hence, interoperability involves the task of building coherent services for users when the individual components are technically different and managed by different organizations. Types of interoperability include syntactic interoperability, where two systems can communicate with each other, and [[cross-domain interoperability, where multiple organizations work together and exchange information. In any collaborative effort, cross-domain interoperability is important because a lack of communication can cause misunderstandings and greatly reduce efficiency. This would especially be a problem in organizations that are meant to respond to emergencies as quickly as possible, such as law enforcement, fire fighting, EMS, and other public health and safety departments.

In computer programming, a software framework is an abstraction in which software, providing generic functionality, can be selectively changed by additional user-written code, thus providing application-specific software. It provides a standard way to build and deploy applications and is a universal, reusable software environment that provides particular functionality as part of a larger software platform to facilitate the development of software applications, products and solutions. Software frameworks may include support programs, compilers, code libraries, toolsets, and application programming interfaces (APIs) that bring together all the different components to enable development of a project or system.

Quattor is a generic open-source tool-kit used to install, configure, and manage computers. Quattor was originally developed in the framework of European Data Grid project (2001-2004). Since its first release in 2003, Quattor has been maintained and extended by a volunteer community of users and developers, primarily from the community of grid system administrators. The Quattor tool-kit, like other configuration management systems, reduces the manpower required to maintain a cluster and facilitates reliable change management. However, three unique features make it particularly attractive for managing grid resources:

The Earth System Modeling Framework (ESMF) is open-source software for building climate, numerical weather prediction, data assimilation, and other Earth science software applications. These applications are computationally demanding and usually run on supercomputers. The ESMF is considered a technical layer, integrated into a sophisticated common modeling infrastructure for interoperability. Other aspects of interoperability and shared infrastructure include: common experimental protocols, common analytic methods, common documentation standards for data and data provenance, shared workflow, and shared model components.

Component-based software engineering

Component-based software engineering (CBSE), also called components-based development (CBD), is a branch of software engineering that emphasizes the separation of concerns with respect to the wide-ranging functionality available throughout a given software system. It is a reuse-based approach to defining, implementing and composing loosely coupled independent components into systems. This practice aims to bring about an equally wide-ranging degree of benefits in both the short-term and the long-term for the software itself and for organizations that sponsor such software.

A software factory is a structured collection of related software assets that aids in producing computer software applications or software components according to specific, externally defined end-user requirements through an assembly process. A software factory applies manufacturing techniques and principles to software development to mimic the benefits of traditional manufacturing. Software factories are generally involved with outsourced software creation.

Fedora Commons

Fedora is a digital asset management (DAM) content repository architecture upon which institutional repositories, digital archives, and digital library systems might be built. Fedora is the underlying architecture for a digital repository, and is not a complete management, indexing, discovery, and delivery application. It is a modular architecture built on the principle that interoperability and extensibility are best achieved by the integration of data, interfaces, and mechanisms as clearly defined modules.

Copernicus Programme Programme of the European Commission

Copernicus is the European Union's Earth observation programme coordinated and managed by the European Commission in partnership with the European Space Agency (ESA), the EU Member States and EU agencies.

The Spacecraft Monitoring & Control (SM&C) Working Group of the Consultative Committee for Space Data Systems (CCSDS), which sees the active participation of the main space agencies, is defining a service-oriented architecture consisting of a set of standard end-to-end services between functions resident on board a spacecraft or based on the ground, that are responsible for mission operations.

View model

A view model or viewpoints framework in systems engineering, software engineering, and enterprise engineering is a framework which defines a coherent set of views to be used in the construction of a system architecture, software architecture, or enterprise architecture. A view is a representation of a whole system from the perspective of a related set of concerns.

The Handle System is the Corporation for National Research Initiatives's proprietary registry assigning persistent identifiers, or handles, to information resources, and for resolving "those handles into the information necessary to locate, access, and otherwise make use of the resources".

Live, Virtual, & Constructive (LVC) Simulation is a broadly used taxonomy for classifying Models and Simulation (M&S). However, categorizing a simulation as a live, virtual, or constructive environment is problematic since there is no clear division between these categories. The degree of human participation in a simulation is infinitely variable, as is the degree of equipment realism. The categorization of simulations also lacks a category for simulated people working real equipment.

The National Unified Operational Prediction Capability (NUOPC) is a collaboration of modeling centers. The group is currently developing a new ensemble forecasting system for operational numerical weather prediction.

The Climate and Forecast (CF) metadata conventions are conventions for the description of Earth sciences data, intended to promote the processing and sharing of data files. The metadata defined by the CF conventions are generally included in the same file as the data, thus making the file "self-describing". The conventions provide a definitive description of what the data values found in each netCDF variable represent, and of the spatial and temporal properties of the data, including information about grids, such as grid cell bounds and cell averaging methods. This enables users of files from different sources to decide which variables are comparable, and is a basis for building software applications with powerful data extraction, grid remapping, data analysis, and data visualization capabilities.

The SHIWA is a project led by the LPDS of MTA Computer and Automation Research Institute. The project coordinator is Prof. Dr. Peter Kacsuk, it started on 1 July 2010 and lasted two years. SHIWA was supported by a Grant from the European Commission's FP7 INFRASTRUCTURES-2010-2 call under grant agreement n°261585.

The NOAA National Operational Model Archive and Distribution System (NOMADS) is a Web-services based project providing both real-time and retrospective format independent access to climate and weather model data.

Model Driven Interoperability (MDI) is a methodological framework, which provides a conceptual and technical support to make interoperable enterprises using ontologies and semantic annotations, following model driven development (MDD) principles.

Modelling frameworks are used in modelling and simulation and can consist of a software infrastructure to develop and run mathematical models. They have provided a substantial step forward in the area of biophysical modelling with respect to monolithic implementations. The separation of algorithms from data, the reusability of I/O procedures and integration services, and the isolation of modelling solutions in discrete units has brought a solid advantage in the development of simulation systems. Modelling frameworks for agriculture have evolved over time, with different approaches and targets

D4Science

D4Science is an organisation operating a Data Infrastructure offering a rich array of services by community-driven virtual research environments. In particular, it supports communities of practice willing to implement open science practices. The infrastructure follows the system of systems approach, where the constituent systems offer “resources” assembled together to implement the overall set of D4Science services. In particular, D4Science aggregates “domain agnostic” service providers as well as community-specific ones to build a unifying space where the aggregated resources can be exploited via Virtual research Environments and their services.

References

  1. Dickinson, R. E.; S. E. Zebiak; J. L. Anderson; M. L. Blackmon; C. DeLuca; T. F. Hogan; M. Iredell; M. Ji; R. B. Rood; M. J. Suarez; K. E. Taylor (2002). "How Can We Advance Our Climate and Weather Models as a Community?" (PDF). Bulletin of the American Meteorological Society. 83: 431–434. doi:10.1175/1520-0477(2002)083<0431:hcwaow>2.3.co;2.
  2. "Flexible Modeling System (GFDL)".
  3. NOAA/CPO MAPP (March 31, 2014). "Scientific Basis for Common Infrastructure" (PDF). p. 15.