Internet Message Access Protocol

Last updated

In computing, the Internet Message Access Protocol (IMAP) is an Internet standard protocol used by email clients to retrieve email messages from a mail server over a TCP/IP connection. [1] IMAP is defined by RFC   9051.

Contents

IMAP was designed with the goal of permitting complete management of an email box by multiple email clients, therefore clients generally leave messages on the server until the user explicitly deletes them. An IMAP server typically listens on port number 143. IMAP over SSL/TLS (IMAPS) is assigned the port number 993. [2] [3]

Virtually all modern e-mail clients and servers support IMAP, which along with the earlier POP3 (Post Office Protocol) are the two most prevalent standard protocols for email retrieval. [4] Many webmail service providers such as Gmail and Outlook.com also provide support for both IMAP and POP3.

Email protocols

The Internet Message Access Protocol is an application layer Internet protocol that allows an e-mail client to access email on a remote mail server. The current version is defined by RFC   9051. An IMAP server typically listens on well-known port 143, while IMAP over SSL/TLS (IMAPS) uses 993. [2] [3]

Incoming email messages are sent to an email server that stores messages in the recipient's email box. The user retrieves the messages with an email client that uses one of a number of email retrieval protocols. While some clients and servers preferentially use vendor-specific, proprietary protocols, [5] almost all support POP and IMAP for retrieving email – allowing many free choice between many e-mail clients such as Pegasus Mail or Mozilla Thunderbird to access these servers, and allows the clients to be used with other servers.

Email clients using IMAP generally leave messages on the server until the user explicitly deletes them. This and other characteristics of IMAP operation allow multiple clients to manage the same mailbox. Most email clients support IMAP in addition to Post Office Protocol (POP) to retrieve messages. [6] IMAP offers access to the mail storage. Clients may store local copies of the messages, but these are considered to be a temporary cache.

History

IMAP was designed by Mark Crispin in 1986 as a remote access mailbox protocol, in contrast to the widely used POP, a protocol for simply retrieving the contents of a mailbox.

It went through a number of iterations before the current VERSION 4rev1 (IMAP4), as detailed below:

Original IMAP

The original Interim Mail Access Protocol was implemented as a Xerox Lisp Machine client and a TOPS-20 server.

No copies of the original interim protocol specification or its software exist. [7] [8] Although some of its commands and responses were similar to IMAP2, the interim protocol lacked command/response tagging and thus its syntax was incompatible with all other versions of IMAP.

IMAP2

The interim protocol was quickly replaced by the Interactive Mail Access Protocol (IMAP2), defined in RFC   1064 (in 1988) and later updated by RFC   1176 (in 1990). IMAP2 introduced the command/response tagging and was the first publicly distributed version.

IMAP3

IMAP3 is an extremely rare variant of IMAP. [9] It was published as RFC   1203 in 1991. It was written specifically as a counter proposal to RFC   1176, which itself proposed modifications to IMAP2. [10] IMAP3 was never accepted by the marketplace. [11] [12] The IESG reclassified RFC1203 "Interactive Mail Access Protocol – Version 3" as a Historic protocol in 1993. The IMAP Working Group used RFC 1176 (IMAP2) rather than RFC 1203 (IMAP3) as its starting point. [13] [14]

IMAP2bis

With the advent of MIME, IMAP2 was extended to support MIME body structures and add mailbox management functionality (create, delete, rename, message upload) that was absent from IMAP2. This experimental revision was called IMAP2bis; its specification was never published in non-draft form. An internet draft of IMAP2bis was published by the IETF IMAP Working Group in October 1993. This draft was based upon the following earlier specifications: unpublished IMAP2bis.TXT document, RFC   1176, and RFC   1064 (IMAP2). [15] The IMAP2bis.TXT draft documented the state of extensions to IMAP2 as of December 1992. [16] Early versions of Pine were widely distributed with IMAP2bis support [9] (Pine 4.00 and later supports IMAP4rev1).

IMAP4

An IMAP Working Group formed in the IETF in the early 1990s took over responsibility for the IMAP2bis design. The IMAP WG decided to rename IMAP2bis to IMAP4 to avoid confusion.

Advantages over POP

Connected and disconnected modes

When using POP, clients typically connect to the e-mail server briefly, only as long as it takes to download new messages. When using IMAP4, clients often stay connected as long as the user interface is active and download message content on demand. For users with many or large messages, this IMAP4 usage pattern can result in faster response times.

Reporting of external changes

After successful authentication, the POP protocol provides a completely static view of the current state of the mailbox, and does not provide a mechanism to show any external changes in state during the session. In contrast, the IMAP protocol provides a dynamic view, and requires that external changes in state, including newly arrived messages, as well as changes made to the mailbox by other concurrently connected clients, are detected and appropriate responses are sent between commands as well as during an IDLE command, as described in RFC   2177. See also RFC   3501 section 5.2 which specifically cites "simultaneous access to the same mailbox by multiple agents".

Access to MIME message parts and partial fetch

Usually all Internet e-mail is transmitted in MIME format, allowing messages to have a tree structure where the leaf nodes are any of a variety of single part content types and the non-leaf nodes are any of a variety of multipart types. The IMAP4 protocol allows clients to retrieve any of the individual MIME parts separately and also to retrieve portions of either individual parts or the entire message. These mechanisms allow clients to retrieve the text portion of a message without retrieving attached files or to stream content as it is being fetched.

Message state information

Through the use of flags defined in the IMAP4 protocol, clients can keep track of message state: for example, whether or not the message has been read, replied to, or deleted. These flags are stored on the server, so different clients accessing the same mailbox at different times can detect state changes made by other clients. POP provides no mechanism for clients to store such state information on the server so if a single user accesses a mailbox with two different POP clients (at different times), state information—such as whether a message has been accessed—cannot be synchronized between the clients. The IMAP4 protocol supports both predefined system flags and client-defined keywords. System flags indicate state information such as whether a message has been read. Keywords, which are not supported by all IMAP servers, allow messages to be given one or more tags whose meaning is up to the client. IMAP keywords should not be confused with proprietary labels of web-based e-mail services which are sometimes translated into IMAP folders by the corresponding proprietary servers.

Multiple mailboxes on the server

IMAP4 clients can create, rename, and delete mailboxes (usually presented to the user as folders) on the server, and copy messages between mailboxes. Multiple mailbox support also allows servers to provide access to shared and public folders. The IMAP4 Access Control List (ACL) Extension ( RFC   4314) may be used to regulate access rights.

Server-side searches

IMAP4 provides a mechanism for a client to ask the server to search for messages meeting a variety of criteria. This mechanism avoids requiring clients to download every message in the mailbox in order to perform these searches.

Built-in extension mechanism

Reflecting the experience of earlier Internet protocols, IMAP4 defines an explicit mechanism by which it may be extended. Many IMAP4 extensions to the base protocol have been proposed and are in common use. IMAP2bis did not have an extension mechanism, and POP now has one defined by RFC   2449.

Server push notifications

IMAP IDLE provides a way for the mail server to notify connected clients that there were changes to a mailbox, for example because a new mail has arrived. POP provides no comparable feature, and email clients need to periodically connect to the POP server to check for new mail.

Disadvantages

While IMAP remedies many of the shortcomings of POP, this inherently introduces additional complexity. Much of this complexity (e.g., multiple clients accessing the same mailbox at the same time) is compensated for by server-side workarounds such as Maildir or database backends.

The IMAP specification has been criticised for being insufficiently strict and allowing behaviours that effectively negate its usefulness. For instance, the specification states that each message stored on the server has a "unique id" to allow the clients to identify messages they have already seen between sessions. However, the specification also allows these UIDs to be invalidated with almost no restrictions, practically defeating their purpose. [17]

From an administrative and resource point of view, the IMAP protocol can be viewed as an early implementation of cloud computing, as the intent and purpose of IMAP is to maintain your mailbox structure (content, folder structure, individual message state, etc) on the mail server, whereas with POP, this is all maintained on the user's local device. Thus, IMAP requires far more server side resources, incurring a significantly higher cost per mailbox.

Unless the mail storage, indexing and searching algorithms on the server are carefully implemented, a client can potentially consume large amounts of server resources when searching massive mailboxes.

IMAP4 clients need to maintain a TCP/IP connection to the IMAP server in order to be notified of the arrival of new mail. Notification of mail arrival is done through in-band signaling, which contributes to the complexity of client-side IMAP protocol handling somewhat. [18] A private proposal, push IMAP, would extend IMAP to implement push e-mail by sending the entire message instead of just a notification. However, push IMAP has not been generally accepted and current IETF work has addressed the problem in other ways (see the Lemonade Profile for more information).

Unlike some proprietary protocols which combine sending and retrieval operations, sending a message and saving a copy in a server-side folder with a base-level IMAP client requires transmitting the message content twice, once to SMTP for delivery and a second time to IMAP to store in a sent mail folder. This is addressed by a set of extensions defined by the IETF Lemonade Profile for mobile devices: URLAUTH ( RFC   4467) and CATENATE ( RFC   4469) in IMAP, and BURL ( RFC   4468) in SMTP-SUBMISSION. In addition to this, Courier Mail Server offers a non-standard method of sending using IMAP by copying an outgoing message to a dedicated outbox folder. [19]

Security

To cryptographically protect IMAP connections between the client and server, IMAPS on TCP port 993 can be used, which utilizes SSL/TLS. [2] [3] As of January 2018, TLS is the recommended mechanism. [20]

Alternatively, STARTTLS can be used to encrypt the connection when connecting to port 143 after initially communicating over plaintext.

Dialog example

This is an example IMAP connection as taken from RFC 3501 section 8:

C: <open connection> S:   * OK IMAP4rev1 Service Ready C:   a001 login mrc secret S:   a001 OK LOGIN completed C:   a002 select inbox S:   * 18 EXISTS S:   * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) S:   * 2 RECENT S:   * OK [UNSEEN 17] Message 17 is the first unseen message S:   * OK [UIDVALIDITY 3857529045] UIDs valid S:   a002 OK [READ-WRITE] SELECT completed C:   a003 fetch 12 full S:   * 12 FETCH (FLAGS (\Seen) INTERNALDATE "17-Jul-1996 02:44:25 -0700"       RFC822.SIZE 4286 ENVELOPE ("Wed, 17 Jul 1996 02:23:25 -0700 (PDT)"       "IMAP4rev1 WG mtg summary and minutes"       (("Terry Gray" NIL "gray" "cac.washington.edu"))       (("Terry Gray" NIL "gray" "cac.washington.edu"))       (("Terry Gray" NIL "gray" "cac.washington.edu"))       ((NIL NIL "imap" "cac.washington.edu"))       ((NIL NIL "minutes" "CNRI.Reston.VA.US")       ("John Klensin" NIL "KLENSIN" "MIT.EDU")) NIL NIL       "<B27397-0100000@cac.washington.edu>")       BODY ("TEXT" "PLAIN" ("CHARSET" "US-ASCII") NIL NIL "7BIT" 3028       92)) S:   a003 OK FETCH completed C:   a004 fetch 12 body[header] S:   * 12 FETCH (BODY[HEADER] {342} S:   Date:Wed, 17 Jul 1996 02:23:25 -0700(PDT) S:   From:TerryGray<gray@cac.washington.edu> S:   Subject:IMAP4rev1WGmtgsummaryandminutes S:   To:imap@cac.washington.edu S:   Cc:minutes@CNRI.Reston.VA.US,JohnKlensin<KLENSIN@MIT.EDU> S:   Message-Id:<B27397-0100000@cac.washington.edu> S:   MIME-Version:1.0 S:   Content-Type:TEXT/PLAIN;CHARSET=US-ASCII S: S:   ) S:   a004 OK FETCH completed C    a005 store 12 +flags \deleted S:   * 12 FETCH (FLAGS (\Seen \Deleted)) S:   a005 OK +FLAGS completed C:   a006 logout S:   * BYE IMAP4rev1 server terminating connection S:   a006 OK LOGOUT completed

See also

Related Research Articles

<span class="mw-page-title-main">Email</span> Mail sent using electronic means

Electronic mail is a method of transmitting and receiving messages using electronic devices. It was conceived in the late–20th century as the digital version of, or counterpart to, mail. Email is a ubiquitous and very widely used communication medium; in current use, an email address is often treated as a basic and necessary part of many processes in business, commerce, government, education, entertainment, and other spheres of daily life in most countries.

Within the Internet email system, a message transfer agent (MTA), mail transfer agent, or mail relay is software that transfers electronic mail messages from one computer to another using the Simple Mail Transfer Protocol. In some contexts, the alternative names mail server, mail exchanger, or MX host are used to describe an MTA.

In computing, the Post Office Protocol (POP) is an application-layer Internet standard protocol used by e-mail clients to retrieve e-mail from a mail server. Today, POP version 3 (POP3) is the most commonly used version. Together with IMAP, it is one of the most common protocols for email retrieval.

The Simple Mail Transfer Protocol (SMTP) is an Internet standard communication protocol for electronic mail transmission. Mail servers and other message transfer agents use SMTP to send and receive mail messages. User-level email clients typically use SMTP only for sending messages to a mail server for relaying, and typically submit outgoing email to the mail server on port 587 or 465 per RFC 8314. For retrieving messages, IMAP is standard, but proprietary servers also often implement proprietary protocols, e.g., Exchange ActiveSync.

<span class="mw-page-title-main">Email client</span> Computer program used to access and manage a users email

An email client, email reader or, more formally, message user agent (MUA) or mail user agent is a computer program used to access and manage a user's email.

<span class="mw-page-title-main">Maildir</span> E-mail format

The Maildir e-mail format is a common way of storing email messages on a file system, rather than in a database. Each message is assigned a file with a unique name, and each mail folder is a file system directory containing these files. Maildir was designed by Daniel J. Bernstein circa 1995, with a major goal of eliminating the need for program code to handle file locking and unlocking through use of the local filesystem.

An email address identifies an email box to which messages are delivered. While early messaging systems used a variety of formats for addressing, today, email addresses follow a set of specific rules originally standardized by the Internet Engineering Task Force (IETF) in the 1980s, and updated by RFC 5322 and 6854. The term email address in this article refers to just the addr-spec in Section 3.4 of RFC 5322. The RFC defines address more broadly as either a mailbox or group. A mailbox value can be either a name-addr, which contains a display-name and addr-spec, or the more common addr-spec alone.

The UW IMAP server was the reference server implementation of the Internet Message Access Protocol. It was developed at the University of Washington by Mark Crispin and others.

Sieve is a programming language that can be used for email filtering. It owes its creation to the CMU Cyrus Project, creators of Cyrus IMAP server.

Push email is an email system that provides an always-on capability, in which when new email arrives at the mail delivery agent (MDA), it is immediately, actively transferred (pushed) by the MDA to the mail user agent (MUA), also called the email client, so that the end-user can see incoming email immediately. This is in contrast with systems that check for new incoming mail every so often, on a schedule. Email clients include smartphones and, less strictly, IMAP personal computer mail applications.

Push-IMAP, which is otherwise known as P-IMAP or Push extensions for Internet Message Access Protocol, is an email protocol designed as a faster way to synchronise a mobile device like a PDA or smartphone to an email server.

The Lemonade Profile is a set of protocols and mandatory extensions which provides email access to diverse environments, including mobile handsets and other resource constrained devices. It is the product of an IETF Working Group, and is largely based on pre-existing specifications, including IMAP and the Message Submission profile of SMTP. It was first published in 2006 as RFC 4550, and updated in 2009 as RFC 5550.

Ned Freed was an IETF participant and Request for Comments author who contributed to a significant number of Internet Protocol standards, mostly related to email. He is best known as the co-inventor of email MIME attachments, with Nathaniel Borenstein.

A mailbox is the destination to which electronic mail messages are delivered. It is the equivalent of a letter box in the postal system.

<span class="mw-page-title-main">Barry Leiba</span> American computer scientist and software researcher

Barry Leiba is a computer scientist and software researcher. He retired from IBM's Thomas J. Watson Research Center in Hawthorne, New York in February 2009, and now works for FutureWei Technologies as a Director of Internet Standards. His work has focused for many years on electronic mail and anti-spam technology, on mobile computing and the Internet of things, and on Internet standards.

<span class="mw-page-title-main">Email agent (infrastructure)</span>

An e-mail agent is a program that is part of the e-mail infrastructure, from composition by sender, to transfer across the network, to viewing by recipient. The best-known are message user agents and message transfer agents, but finer divisions exist.

SMTP Authentication, often abbreviated SMTP AUTH, is an extension of the Simple Mail Transfer Protocol (SMTP) whereby a client may log in using any authentication mechanism supported by the server. It is mainly used by submission servers, where authentication is mandatory.

Exchange ActiveSync is a proprietary protocol designed for the synchronization of email, contacts, calendar, tasks, and notes from a messaging server to a smartphone or other mobile devices. The protocol also provides mobile device management and policy controls. The protocol is based on XML. The mobile device communicates over HTTP or HTTPS.

A mailbox provider, mail service provider or, somewhat improperly, email service provider is a provider of email hosting. It implements email servers to send, receive, accept, and store email for other organizations or end users, on their behalf.

The JSON Meta Application Protocol (JMAP) is a set of related open Internet Standard protocols for handling email. JMAP is implemented using JSON APIs over HTTP and has been developed as an alternative to IMAP/SMTP and proprietary email APIs such as Gmail and Outlook. Additional protocols and data models being built on top of the core of JMAP for handling contacts and calendar synchronization are meant to be potential replacements for CardDAV and CalDAV, and other support is currently in the works.

References

  1. ↑ Dean, Tamara (2010). Network+ Guide to Networks. Delmar. p. 519. ISBN   978-1-42390245-4. Archived from the original on 2021-02-05. Retrieved 2020-12-25.
  2. 1 2 3 Blum, Richard (December 15, 2002). Open Source E-mail Security. Sams Publishing. ISBN   9780672322372. Archived from the original on February 5, 2021. Retrieved December 25, 2020– via Google Books.
  3. 1 2 3 Garfinkel, Simson; Spafford, Gene; Schwartz, Alan (December 15, 2003). Practical UNIX and Internet Security. "O'Reilly Media, Inc.". ISBN   9780596003234. Archived from the original on February 5, 2021. Retrieved December 25, 2020– via Google Books.
  4. ↑ Komarinski, Mark (2000). Red Hat Linux System Administration Handbook. Prentice Hall. p. 179.
  5. ↑ For example, Microsoft's Outlook client uses MAPI, a Microsoft proprietary protocol, to communicate with a Microsoft Exchange Server. IBM's Notes client works in a similar fashion when communicating with a Domino server.
  6. ↑ Mullet, Diana (2000). Managing IMAP. O'Reilly. p. 25. ISBN   0-596-00012-X.
  7. ↑ Crispin, Mark (13 February 2012). "Re: [imap5] Designing a new replacement protocol for IMAP". imap5 (Mailing list). alpine.OSX.2.00.1202131243200.38441@hsinghsing.panda.com. Archived from the original on 24 September 2015. Retrieved 26 November 2014. Knowledge of the original IMAP (before IMAP2) exists primarily in my mind as all the original IMAP specifications and implementations were replaced with IMAP2.
  8. ↑ Service Name and Transport Protocol Port Number Registry Archived 2010-04-18 at the Wayback Machine . Iana.org (2013-07-12). Retrieved on 2013-07-17.
  9. 1 2 "RFC 2061 – IMAP4 compatibility with IMAP2BIS". IETF. 1996. Archived from the original on 2011-06-23. Retrieved 2010-08-21.
  10. ↑ "Interactive Mail Access Protocol – Version 3". IETF. 1991. Archived from the original on 2010-03-04. Retrieved 2010-08-21.
  11. ↑ "IMAP2, IMAP2bis, IMAP3, IMAP4, IMAP4rev1 (LAN Mail Protocols)". Archived from the original on 2010-06-15. Retrieved 2010-08-21.
  12. ↑ "IMAP Overview, History, Versions and Standards". Archived from the original on 2010-11-29. Retrieved 2010-08-21.
  13. ↑ "Protocol Action: Interactive Mail Access Protocol — Version 3 to Historic (IETF mail archive)". 1993. Archived from the original on 2012-08-11. Retrieved 2010-08-21.
  14. ↑ "Innosoft and POP/IMAP protocols? (mail archive)". 1993. Archived from the original on 2011-07-15. Retrieved 2010-08-21.
  15. ↑ "Interactive Mail Access Protocol – Version 2bis (internet draft)". IETF. 1993. Archived from the original on 2012-10-08. Retrieved 2010-08-21.
  16. ↑ "IMAP2BIS – Extensions to the IMAP2 protocol (draft)". 1992. Archived from the original on 2011-07-18. Retrieved 2010-08-21.
  17. ↑ "IMAP implementation in Sup, an e-mail client written in Ruby". rubyforge.com. Archived from the original on 2007-12-12. Retrieved 2011-02-22.
  18. ↑ "IMAP IDLE: The best approach for 'push' e-mail". Isode.com. Archived from the original on 2009-02-28. Retrieved 2009-07-30.
  19. ↑ "Courier-IMAP: Sending mail via an IMAP connection". Double Precision, Inc. Archived from the original on 2013-09-27. Retrieved 2013-09-24.
  20. ↑ RFC 8314. doi: 10.17487/RFC8314 .

Further reading

This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.