Yahoo! Pipes

Last updated

Yahoo! Pipes
Pipes Logo.jpg
Yahoo Pipes screenshot.png
Typical Yahoo Pipes
Type of site
Remix Developer
Dissolved 30 August 2015 (2015-08-30)
Owner Yahoo!
Created byPasha Sadri, Ed Ho, Jonathan Trevor, Ido Green and Daniel Raffel
URL http://pipes.yahoo.com/pipes/
CommercialYes
RegistrationRequired
Launched7 February 2007;17 years ago (2007-02-07)
Current statusDefunct as of 30 June 2015 (2015-06-30)

Yahoo! Pipes was a web application from Yahoo! that provided a graphical user interface for building data mashups that aggregate web feeds, web pages, and other services; creating Web-based apps from various sources; and publishing those apps. The application worked by enabling users to "pipe" information from different sources and then set up rules for how that content should be modified (for example, filtering). In addition to the pipe editing page, the website had a documentation page and a discussion page. The documentation page contained information about pipes including guides for the pipe editor and troubleshooting. The discussion page enabled users to discuss the pipes with other users.

Contents

History

Yahoo! Pipes was released to the public in beta on 7 February 2007. It was built by Pasha Sadri, Ed Ho, Jonathan Trevor, Ido Green, and Daniel Raffel of Yahoo! It is described by its creators as:

…a hosted service that lets you remix feeds and create new data mashups in a visual programming environment. The name of the service pays tribute to Unix pipes, which make it easy to chain simple utilities together on the command line.

Official Yahoo! Pipes Blog, [1]

On 4 June 2015, it was announced that Pipes would be in read-only mode from 30 August 2015, and shut down on 30 September 2015. [2] Yahoo did not offer a paid version, but instead shut down the program entirely.

Purpose

The purpose of Yahoo! Pipes was to create new pages by aggregating RSS feeds from different sources. Yahoo! Pipes had many modules which could be used either to grab data from sources or to edit the data that was grabbed from the sources. These modules were grouped into categories: sources, user inputs, operators, URL, string, date, location, and number.

Creating and editing a Pipe

To create or edit a pipe, the user had to sign up with a Yahoo! ID. Creation and editing of the pipes was completely online; the user didn't have to download a plug-in, program or app. The user selected the "Create a pipe" option to open the Pipe Editor. The pipe editor was composed of three panes: the canvas, the library, and the debugger. The pipe was created using these panes. After creation, the pipe was saved and run. The user was then able to give a name and short description to the pipe. If the creator of the pipe decided to publish the pipe, it would become visible for everyone. Other users had the ability to clone the pipe, which they could then edit for their own use.

The Canvas

The canvas was the main pane where the editing of pipes was done. It was in the center of the page. Modules that were selected from the Library pane were dragged on this pane and connected together. After the modules were wired in the desired order, the pipe was ready to be used.

The Library

The Library was the place where the modules are selected to be dragged on the Canvas. These modules were grouped by their functions. The library pane was on the left hand side.

Sources

In this category, there were modules which were used to grab data from one or multiple sources on internet.

User Inputs

The modules in this category enabled user to add an input in the pipe. By using the modules in this category, user could add date, location, number, text, or URL input to the pipe.

Operators

The modules in this category were used either to filter or to transform the data that is flowing in the pipe. It contained filter, count, location extractor, loop, regex, rename, reverse, sort, split, sub-element, tail, truncate, union, unique, and web service modules.

URL

There was only a URL builder module in this category. Pipes needed to have URLs of RSS to get the content. This URL builder enabled users to create URLs instead of typing the URL address. It used a base URL and query parameters to generate other URLs.

String

The modules in this category were used to either to change or combine the strings. String builder, string regex, string replace, sub string, term extractor, and translate were the modules of this category.

Date

There were only two modules in this category. They were date builder and date formatter. Date builder module converted a text to a date when there was text in the date format such as "yesterday" or "tomorrow". Date formatter module took a date as input date and changed it to the desired format.

Location

This category contained only the location builder module. This module recognized the strings which were the description of a location and converted them to geographical location. Its input was in string form and output in location form.

Number

This category only had the simple math module. It applied simple math operations to the number input it takes and outputs the result of math operation. Both the input and the output were numbers.

The Debugger

This is the pane which shows the output of the selected module on the pipe. While designing a pipe, when user clicks on a module on the canvas, the debugger pane shows the output of the selected module. It shows both the title and the content of each item.

Mashups

A Web Mashup is a Web application that combines data from more than one Web data source into a single integrated Web application. Just as Unix pipes are often used to quickly combine several different data sources but are generally not sufficient to create a useful application, Yahoo! Pipes is a data mashup tool rather than a complete mashup editor. [3]

See also

Related Research Articles

<span class="mw-page-title-main">AWK</span> Programming language

AWK is a domain-specific language designed for text processing and typically used as a data extraction and reporting tool. Like sed and grep, it is a filter, and is a standard feature of most Unix-like operating systems.

In computing, Common Gateway Interface (CGI) is an interface specification that enables web servers to execute an external program to process HTTP or HTTPS user requests.

In software, an XML pipeline is formed when XML processes, especially XML transformations and XML validations, are connected.

<span class="mw-page-title-main">Redirection (computing)</span> Form of interprocess communication

In computing, redirection is a form of interprocess communication, and is a function common to most command-line interpreters, including the various Unix shells that can redirect standard streams to user-specified locations.

<span class="mw-page-title-main">CMS Pipelines</span>

CMS Pipelines is a feature of the VM/CMS operating system that allows the user to create and use a pipeline. The programs in a pipeline operate on a sequential stream of records. A program writes records that are read by the next program in the pipeline. Any program can be combined with any other because reading and writing is done through a device independent interface.

<span class="mw-page-title-main">Pipeline (Unix)</span> Mechanism for inter-process communication using message passing

In Unix-like computer operating systems, a pipeline is a mechanism for inter-process communication using message passing. A pipeline is a set of processes chained together by their standard streams, so that the output text of each process (stdout) is passed directly as input (stdin) to the next one. The second process is started as the first process is still executing, and they are executed concurrently. The concept of pipelines was championed by Douglas McIlroy at Unix's ancestral home of Bell Labs, during the development of Unix, shaping its toolbox philosophy. It is named by analogy to a physical pipeline. A key feature of these pipelines is their "hiding of internals". This in turn allows for more clarity and simplicity in the system.

In software engineering, a pipeline consists of a chain of processing elements, arranged so that the output of each element is the input of the next; the name is by analogy to a physical pipeline. Usually some amount of buffering is provided between consecutive elements. The information that flows in these pipelines is often a stream of records, bytes, or bits, and the elements of a pipeline may be called filters; this is also called the pipe(s) and filters design pattern. Connecting elements into a pipeline is analogous to function composition.

Yahoo! Maps was a free online mapping portal provided by Yahoo! Functionality included local weather powered by The Weather Channel, printing maps, and local reviews powered by Yelp. It shut down on June 30, 2015. For a time in 2019, Yahoo! Maps could be accessed in the United States on https://search.yahoo.com/, albeit powered by Here WeGo. However, that is no longer possible.

The DTX range consists of electronic drum kits and percussion controllers manufactured by the Yamaha Corporation. They currently cover levels from entry-level to pro-range. DTX kits use sampling for their sounds, meaning each kit has built-in digital recordings of real drums, and cymbals. When the drum or cymbal pads are hit, the digital recordings are played back to replicate what is being played. On all kits, the sounds are editable – the pitch can be made higher or lower (tuned) and many other features. The higher the range of the DTX, the more functions there are editable.

In computing, tee is a command in command-line interpreters (shells) using standard streams which reads standard input and writes it to both standard output and one or more files, effectively duplicating its input. It is primarily used in conjunction with pipes and filters. The command is named after the T-splitter used in plumbing.

A mashup, in web development, is a web page or web application that uses content from more than one source to create a single new service displayed in a single graphical interface. For example, a user could combine the addresses and photographs of their library branches with a Google map to create a map mashup. The term implies easy, fast integration, frequently using open application programming interfaces and data sources to produce enriched results that were not necessarily the original reason for producing the raw source data. The term mashup originally comes from creating something by combining elements from two or more sources.

<span class="mw-page-title-main">Web API</span> HTTP-based application programming interface used in web development

A web API is an application programming interface (API) for either a web server or a web browser. As a web development concept, it can be related to a web application's client side. A server-side web API consists of one or more publicly exposed endpoints to a defined request–response message system, typically expressed in JSON or XML by means of an HTTP-based web server. A server API (SAPI) is not considered a server-side web API, unless it is publicly accessible by a remote web application.

A webform, web form or HTML form on a web page allows a user to enter data that is sent to a server for processing. Forms can resemble paper or database forms because web users fill out the forms using checkboxes, radio buttons, or text fields. For example, forms can be used to enter shipping or credit card data to order a product, or can be used to retrieve search results from a search engine.

<span class="mw-page-title-main">Numbers (spreadsheet)</span> Spreadsheet application by Apple Inc.

Numbers is a spreadsheet application developed by Apple Inc. as part of the iWork productivity suite alongside Keynote and Pages. Numbers is available for iOS and macOS High Sierra or newer. Numbers 1.0 on Mac OS X was announced on August 7, 2007, making it the newest application in the iWork suite. The iPad version was released on January 27, 2010. The app was later updated to support iPhone and iPod Touch.

XOMGL (eXtensible Open Municipal Geodata Language) is an XML-based open standard for the exchange of large amounts of government data between a municipal agency and regular citizens and developers creating web-based mapping applications. It is part of the OMG Standard, which seeks to promote the free flow of information between government agencies and citizens by establishing a common set of technical standards for organizing and sharing public data.

WSO2 Mashup Server, an open-source mashup platform that used to host JavaScript-based mashups, is now deprecated and no longer in use. It was based on Apache Axis2 and other open-source projects, and allowed JavaScript to consume, compose and emit web services, feeds, scraped web pages, email, and instant messages. The source code was freely available under the open-source Apache License. It provided a runtime platform for developing and deploying mashups and could be downloaded and deployed locally or within an organization.

Yahoo! Query Language (YQL) is an SQL-like query language created by Yahoo! as part of their Developer Network. YQL is designed to retrieve and manipulate data from APIs through a single Web interface, thus allowing mashups that enable developers to create their own applications using Yahoo! Pipes online tool.

EMML, or Enterprise Mashup Markup Language, is an XML markup language for creating enterprise mashups, which are software applications that consume and mash data from variety of sources. These applications often perform logical or mathematical operations as well as present the data.

Mashups are a combination of two or more data sources that have been integrated into one source. They typically consist of graphics, texts, audio clips, and video that have been sourced from various media such as blogs, wikis, YouTube, Google Maps, etc., into a new product. Remix is a related term, referring to how data sources have been combined to produce a constellation of elements that were not originally intended by the creators. Mashups rely on open and discoverable resources, open and transparent licensing, and open and remixable formats.

Data scraping is a technique where a computer program extracts data from human-readable output coming from another program.

References

  1. The Pipes Development Team (7 February 2007). "Introducing Pipes". Yahoo Pipes Blog. Archived from the original on 5 June 2015. Retrieved 26 April 2021.
  2. Pipes End-of-life Announcement, archived from the original on 4 June 2015, retrieved 6 September 2017
  3. "Yahoo! Pipes Overview".