![]() | A request that this article title be changed to Yahoo Pipes is under discussion . Please do not move this article until the discussion is closed. |
This article needs additional citations for verification .(October 2016) |
![]() | |
![]() Typical Yahoo Pipes | |
Type of site | Remix Developer |
---|---|
Dissolved | 30 August 2015 |
Owner | Yahoo! |
Created by | Pasha Sadri, Ed Ho, Jonathan Trevor, Ido Green and Daniel Raffel |
URL | http://pipes.yahoo.com/pipes/ |
Commercial | Yes |
Registration | Required |
Launched | 7 February 2007 |
Current status | Defunct as of 30 June 2015 |
Yahoo! Pipes was a web application from Yahoo! that provided a graphical user interface for building data mashups that aggregate web feeds, web pages, and other services; creating Web-based apps from various sources; and publishing those apps. The application worked by enabling users to "pipe" information from different sources and then set up rules for how that content should be modified (for example, filtering). In addition to the pipe editing page, the website had a documentation page and a discussion page. The documentation page contained information about pipes including guides for the pipe editor and troubleshooting. The discussion page enabled users to discuss the pipes with other users.
Yahoo! Pipes was released to the public in beta on 7 February 2007. It was built by Pasha Sadri, Ed Ho, Jonathan Trevor, Ido Green, and Daniel Raffel of Yahoo! It is described by its creators as:
…a hosted service that lets you remix feeds and create new data mashups in a visual programming environment. The name of the service pays tribute to Unix pipes, which make it easy to chain simple utilities together on the command line.
— Official Yahoo! Pipes Blog, [1]
On 4 June 2015, it was announced that Pipes would be in read-only mode from 30 August 2015, and shut down on 30 September 2015. [2] Yahoo did not offer a paid version, but instead shut down the program entirely.
The purpose of Yahoo! Pipes was to create new pages by aggregating RSS feeds from different sources. Yahoo! Pipes had many modules which could be used either to grab data from sources or to edit the data that was grabbed from the sources. These modules were grouped into categories: sources, user inputs, operators, URL, string, date, location, and number.
To create or edit a pipe, the user had to sign up with a Yahoo! ID. Creation and editing of the pipes was completely online; the user didn't have to download a plug-in, program or app. The user selected the "Create a pipe" option to open the Pipe Editor. The pipe editor was composed of three panes: the canvas, the library, and the debugger. The pipe was created using these panes. After creation, the pipe was saved and run. The user was then able to give a name and short description to the pipe. If the creator of the pipe decided to publish the pipe, it would become visible for everyone. Other users had the ability to clone the pipe, which they could then edit for their own use.
The canvas was the main pane where the editing of pipes was done. It was in the center of the page. Modules that were selected from the Library pane were dragged on this pane and connected together. After the modules were wired in the desired order, the pipe was ready to be used.
The Library was the place where the modules are selected to be dragged on the Canvas. These modules were grouped by their functions. The library pane was on the left hand side.
In this category, there were modules which were used to grab data from one or multiple sources on internet.
The modules in this category enabled user to add an input in the pipe. By using the modules in this category, user could add date, location, number, text, or URL input to the pipe.
The modules in this category were used either to filter or to transform the data that is flowing in the pipe. It contained filter, count, location extractor, loop, regex, rename, reverse, sort, split, sub-element, tail, truncate, union, unique, and web service modules.
There was only a URL builder module in this category. Pipes needed to have URLs of RSS to get the content. This URL builder enabled users to create URLs instead of typing the URL address. It used a base URL and query parameters to generate other URLs.
The modules in this category were used to either to change or combine the strings. String builder, string regex, string replace, sub string, term extractor, and translate were the modules of this category.
There were only two modules in this category. They were date builder and date formatter. Date builder module converted a text to a date when there was text in the date format such as "yesterday" or "tomorrow". Date formatter module took a date as input date and changed it to the desired format.
This category contained only the location builder module. This module recognized the strings which were the description of a location and converted them to geographical location. Its input was in string form and output in location form.
This category only had the simple math module. It applied simple math operations to the number input it takes and outputs the result of math operation. Both the input and the output were numbers.
This is the pane which shows the output of the selected module on the pipe. While designing a pipe, when user clicks on a module on the canvas, the debugger pane shows the output of the selected module. It shows both the title and the content of each item.
A Web Mashup is a Web application that combines data from more than one Web data source into a single integrated Web application. Just as Unix pipes are often used to quickly combine several different data sources but are generally not sufficient to create a useful application, Yahoo! Pipes is a data mashup tool rather than a complete mashup editor. [3]
AWK is a domain-specific language designed for text processing and typically used as a data extraction and reporting tool. Like sed and grep, it is a filter, and is a standard feature of most Unix-like operating systems.
In computing, Common Gateway Interface (CGI) is an interface specification that enables web servers to execute an external program to process HTTP or HTTPS user requests.
In software, an XML pipeline is formed when XML processes, especially XML transformations and XML validations, are connected.
File Explorer, previously known as Windows Explorer, is a file manager application and default desktop environment that is included with releases of the Microsoft Windows operating system from Windows 95 onwards. It provides a graphical user interface for accessing the file systems, as well as user interface elements such as the taskbar and desktop.
CMS Pipelines is a feature of the VM/CMS operating system that allows the user to create and use a pipeline. The programs in a pipeline operate on a sequential stream of records. A program writes records that are read by the next program in the pipeline. Any program can be combined with any other because reading and writing is done through a device independent interface.
In Unix-like computer operating systems, a pipeline is a mechanism for inter-process communication using message passing. A pipeline is a set of processes chained together by their standard streams, so that the output text of each process (stdout) is passed directly as input (stdin) to the next one. The second process is started as the first process is still executing, and they are executed concurrently.
In software engineering, a pipeline consists of a chain of processing elements, arranged so that the output of each element is the input of the next. The concept is analogous to a physical pipeline. Usually some amount of buffering is provided between consecutive elements. The information that flows in these pipelines is often a stream of records, bytes, or bits, and the elements of a pipeline may be called filters. This is also called the pipe(s) and filters design pattern which is monolithic. Its advantages are simplicity and low cost while its disadvantages are lack of elasticity, fault tolerance and scalability. Connecting elements into a pipeline is analogous to function composition.
Yahoo! Maps was a free online mapping portal provided by Yahoo! Functionality included local weather powered by The Weather Channel, printing maps, and local reviews powered by Yelp. It shut down on June 30, 2015. For a time in 2019, Yahoo! Maps could be accessed in the United States on https://search.yahoo.com/, albeit powered by Here WeGo. However, that is no longer possible.
A problem solving environment (PSE) is a completed, integrated and specialised computer software for solving one class of problems, combining automated problem-solving methods with human-oriented tools for guiding the problem resolution. A PSE may also assist users in formulating problem resolution. A PSE may also assist users in formulating problems, selecting algorithm, simulating numerical value and viewing and analysing results.
In computing, tee
is a command in command-line interpreters (shells) using standard streams which reads standard input and writes it to both standard output and one or more files, effectively duplicating its input. It is primarily used in conjunction with pipes and filters. The command is named after the T-splitter used in plumbing.
A mashup, in web development, is a web page or web application that uses content from more than one source to create a single new service displayed in a single graphical interface. For example, a user could combine the addresses and photographs of their library branches with a Google map to create a map mashup. The term implies easy, fast integration, frequently using open application programming interfaces and data sources to produce enriched results that were not necessarily the original reason for producing the raw source data. The term mashup originally comes from creating something by combining elements from two or more sources.
A web API is an application programming interface (API) for either a web server or a web browser. As a web development concept, it can be related to a web application's client side. A server-side web API consists of one or more publicly exposed endpoints to a defined request–response message system, typically expressed in JSON or XML by means of an HTTP-based web server. A server API (SAPI) is not considered a server-side web API, unless it is publicly accessible by a remote web application.
A webform, web form or HTML form on a web page allows a user to enter data that is sent to a server for processing. Forms can resemble paper or database forms because web users fill out the forms using checkboxes, radio buttons, or text fields. For example, forms can be used to enter shipping or credit card data to order a product, or can be used to retrieve search results from a search engine.
Numbers is a spreadsheet application developed by Apple Inc. as part of the iWork productivity suite alongside Keynote and Pages. Numbers is available for iOS and macOS High Sierra or newer. Numbers 1.0 on Mac OS X was announced on August 7, 2007, making it the newest application in the iWork suite. The iPad version was released on January 27, 2010. The app was later updated to support iPhone and iPod Touch.
XOMGL (eXtensible Open Municipal Geodata Language) is an XML-based open standard for the exchange of large amounts of government data between a municipal agency and regular citizens and developers creating web-based mapping applications. It is part of the OMG Standard, which seeks to promote the free flow of information between government agencies and citizens by establishing a common set of technical standards for organizing and sharing public data.
WSO2 Mashup Server, an open-source mashup platform that used to host JavaScript-based mashups, is now deprecated and no longer in use. It was based on Apache Axis2 and other open-source projects, and allowed JavaScript to consume, compose and emit web services, feeds, scraped web pages, email, and instant messages. The source code was freely available under the open-source Apache License. It provided a runtime platform for developing and deploying mashups and could be downloaded and deployed locally or within an organization.
Yahoo! Query Language (YQL) is an SQL-like query language created by Yahoo! as part of their Developer Network. YQL is designed to retrieve and manipulate data from APIs through a single Web interface, thus allowing mashups that enable developers to create their own applications using Yahoo! Pipes online tool.
EMML, or Enterprise Mashup Markup Language, is an XML markup language for creating enterprise mashups, which are software applications that consume and mash data from variety of sources. These applications often perform logical or mathematical operations as well as present the data.
Mashups are a combination of two or more data sources that have been integrated into one source. They typically consist of graphics, texts, audio clips, and video that have been sourced from various media such as blogs, wikis, YouTube, Google Maps, etc., into a new product. Remix is a related term, referring to how data sources have been combined to produce a constellation of elements that were not originally intended by the creators. Mashups rely on open and discoverable resources, open and transparent licensing, and open and remixable formats.
Data scraping is a technique where a computer program extracts data from human-readable output coming from another program.