The Puzzle Palace

Last updated
The Puzzle Palace
The Puzzle Palace.jpg
First edition
Author James Bamford
CountryUnited States
LanguageEnglish
Genre Investigative journalism, Political history
Publisher Houghton-Mifflin
Publication date
September 19, 1982 [1]
Media typePrint (hardcover and paperback)
Pages466 (Houghton-Mifflin first edition) [1]
656 (Penguin Books paperback) [2]
ISBN 978-0140067484
OCLC 8345302
Preceded byNone (first major work) 
Followed by Body of Secrets: Anatomy of the Ultra-Secret National Security Agency (2002) 

The Puzzle Palace is a book written by James Bamford and published in 1982. It is the first major, popular work devoted entirely to the history and workings of the National Security Agency (NSA), a United States intelligence organization. The title refers to a nickname for the NSA, which is headquartered in Fort Meade, Maryland. [3] In addition to describing the role of the NSA and explaining how it was organized, the book exposed details of a massive eavesdropping operation called Operation Shamrock. According to security expert Bruce Schneier, the book was popular within the NSA itself, as "the agency's secrecy prevents its employees from knowing much about their own history". [4]

Contents

Research and publication

The papers of the late William Friedman, who had served as the NSA's chief cryptologist, were a valuable source for Bamford. The NSA later confiscated the documents from the library at which they were held. William-Friedman.jpg
The papers of the late William Friedman, who had served as the NSA's chief cryptologist, were a valuable source for Bamford. The NSA later confiscated the documents from the library at which they were held.

The NSA describes Bamford's research process in a partially declassified history of postwar American cryptography. [5] The history begins by describing how Bamford approached Houghton-Mifflin with a proposal to write a book on the NSA. The publisher accepted and paid Bamford a $7,500 advance.

According to the NSA's historical account, "Public Law 86-36 had served as a useful barrier against this type of research, but Bamford proved to be cleverer than others. He began with a barrage of requests for information under the Freedom of Information Act (FOIA)." Bamford eventually discovered "the Mother Lode," a collection of documents deposited at the George C. Marshall Foundation Library by former NSA chief cryptologist William Friedman. These documents included copies of the NSA Newsletter, addressed to "NSA Employees and their families." The account continues, "Bamford then submitted a FOIA request for the entire collection, using as his rationale the offending phrase indicating that the information had been intended for dissemination to uncleared people." The FOIA requests gave Bamford access to an only lightly redacted set of documents, and a former NSA employee later gave Bamford access to an almost complete collection.

During the 1975 Church Committee hearings, the United States Department of Justice (DOJ) had investigated the legal culpability of various intelligence agencies. Bamford submitted a FOIA request for resulting documents, and received most of their report on the NSA. The DOJ did not inform the NSA of the release because the investigation was ongoing, and the NSA was a possible target. The released papers were later to become the subject of threatened litigation, and their release prompted eventual rule changes that allowed for document reclassification. According to the NSA's history, "the document, with some Justice redactions, contained a good deal of information about the NSA-GCHQ [Government Communications Headquarters, a British intelligence agency] relationship, and served as the basis for Bamford's information on Second Party issues [i.e., issues regarding outside agencies with which the NSA had partnered]." The NSA history dryly notes that "GCHQ was not amused" about the disclosure.

Bamford also interviewed retired NSA senior officials, including former director Marshall Carter, with whom he talked for a day and a half. None of the discussed subject matter was classified, but, according to the NSA, "it helped Bamford to complete his mosaic." The NSA account also describes how Bamford drove through the NSA parking lot, recording diplomatic license plates and cross-checking them against known lists to determine which countries maintained representatives at Fort Meade.

The NSA's historical account summarizes Bamford's work thusly: "James Bamford broke new ground in intelligence agency research, and his techniques were adopted by others seeking to investigate reclusive federal agencies. He did it all within the limits of the law – through attributable interviews, FOIA'ed documents, and meticulous research in public libraries and newspapers. ... He 'wrote the book' on how to put together a comprehensive picture of an organization that wanted no such comprehensive picture."

Before the book's publication, the Reagan administration claimed that unclassified source documents were released to Bamford in error, and threatened him with prosecution if he did not return 250 pages of documents he had obtained through Freedom of Information Act (FOIA) requests. The documents in question related to a 1975-76 DOJ investigation, and described the NSA's widespread illegal monitoring of domestic communication, warrantless surveillance of Americans, and monitoring of commercial cable and telex traffic. [1] Bamford's attorney, believing that they would prevail in court, invited the DOJ to prosecute, but no case was ever brought. [5] In the wake of the dispute, classification rules were revised to allow document reclassification, and the contested documents were reclassified. NSA agents then visited libraries to remove other source documents from circulation. [6] [7] [8] [9] [10] [11]

The new rules allowing document reclassification were outlined in Executive Order 12356. Previously, Executive Order 12065, issued by Jimmy Carter in 1978, had prohibited document reclassification. [12] Executive Order 12356, issued by Ronald Reagan in 1982, eliminated the reclassification prohibition and described situations in which documents could be reclassified. Released documents could be reclassified as long as they could be reasonably recovered (meaning that documents available to the public at large would not meet this criterion). It also allowed documents requested under the FOIA or Privacy Act to be classified or reclassified provided they met specified requirements (e.g., certain matters related to national security). [13] [14] According to Bamford, he could not be prosecuted under the new rules because of the principle of ex post facto . [15]

Reclassified source documents and American Library Association lawsuit

Reclassified and re-sequestered source documents that Bamford had used when writing The Puzzle Palace were the subject of subsequent litigation. The NSA's historical account states that documents removed from the Marshall Library were "sequestered portions of the Friedman collection," i.e., the collection that included the copies of the NSA Newsletter that spurred one of Bamford's FOIA requests. The materials removed from circulation included three government publications and 31 pieces of Friedman's private correspondence. The American Library Association (ALA) challenged the document removal in court, and in 1987 the U.S. Court of Appeals for the District of Columbia dismissed the case. Ruth Bader Ginsburg, who was at that time a Court of Appeals judge, ruled that the ALA lacked standing in the case. A lower court ruling had already affirmed that the NSA had authority to remove the reclassified documents, but criticized the NSA's "cavalier attitude" toward the classification determination of those documents. [5] [16] [17]

Reviews and reception

The New York Times reviewed the book favorably, writing that "Until now no one has published a comprehensive and detailed report on the agency. The quality and depth of Mr. Bamford's research are remarkable." The review concluded, "By revealing the scope and opening up the operations of the N.S.A. without giving away its most sensitive secrets, Mr. Bamford has performed an important public service in this impressive book." [1]

In a review of Shane Harris' book The Watchers: The Rise of America's Surveillance State, New York Times reporter Eric Lichtblau described The Puzzle Palace as "the benchmark study of the N.S.A. [that] first pulled back the curtain to provide a glint of unwanted sunlight on the place". [18] Michael Duffy, reviewing Bamford's 2004 book Pretext for War, wrote in Time magazine that The Puzzle Palace "is still considered the classic account of the mysterious National Security Agency." [19]

The Puzzle Palace has been generally well received by experts, and has been used as a textbook at the Defense Intelligence Agency's National Intelligence University. [20] The NSA itself says the book "brought a new focus to the efforts of journalists and independent writers to break down the Agency's vaunted anonymity," and describes the book as "the most significant breach in NSA's anonymity since David Kahn's The Codebreakers in 1967." [5] In the years between the book's publication and 9/11, the relationship between Bamford and the NSA grew less adversarial. The NSA cooperated with Bamford on a later book titled Body of Secrets , and in April 2001 the NSA hosted a book-signing event for Bamford at their Maryland headquarters. [20] Bamford was critical of NSA actions in the years following 9/11, and the relationship between the two once again cooled.[ citation needed ]

Editions

Notes and references

  1. 1 2 3 4 Taubman, Philip (19 September 1982). "Sons of the Black Chamber". The New York Times. Retrieved 11 May 2012.
  2. "The Puzzle Palace listing on Amazon.com" . Retrieved 3 July 2012.
  3. The term has also been used to refer to the Federal Bureau of Investigation in the 1995 book The Bureau by Diarmuid Jeffreys.
  4. Schneier, Bruce (2001). "Body of Secrets review".
  5. 1 2 3 4 NSA Center for Cryptologic History (1999). American Cryptology during the Cold War, 1945–1989: Book IV: Cryptologic Rebirth, 1981–1989. National Security Agency. p. 426.
  6. Foerstel, Herbert N (1999). Freedom of Information and the Right to Know: The Origins and Applications of the Freedom of Information Act . Westport, CT: Greenwood Press. pp.  115–116. ISBN   0-313-28546-2.
  7. Miller, Judith (15 March 1982). "Author fights Justice's reneging on data". Sarasota Herald-Tribune. NY Times News Service. Retrieved January 17, 2012. Letters from Schroeder dated Sept. 22 and Nov. 27 suggest that Bamford might be subject to federal legal action if he proceeds to publish the information as planned.
  8. Associated Press (March 15, 1982). "Justice wants spy documents returned: Times". St. Joseph Gazette. Retrieved 17 January 2012.
  9. Bamford, James. "1984 interview". Charlie Rose Show via YouTube.
  10. Taubman, Philip (1983). "NSA stamps SECRET on library records critical of agency actions". The Spokesman-Review.
  11. Taubman, Philip (April 28, 1983). "Security agency bars access to nonsecret materials, library records show". The New York Times. While they were at Marshall library, NSA officials told the library that the visit was part of a systematic effort to track down and, if necessary, remove from circulation research materials about sensitive matters that were used in Bamford's book, library officials said.
  12. "Executive Order 12065". 28 June 1978. 1-607. Classification may not be restored to documents already declassified and released to the public under this Order or prior Orders.
  13. "Executive Order 12356". 2016-08-15. p. Section 1.6. Information may be classified or reclassified after an agency has received a request for it under the Freedom of Information Act (5 U.S.C. 552) or the Privacy Act of 1974 (5 U.S.C. 552a), or the mandatory review provisions of this Order (Section 3.4) if such classification meets the requirements of this Order and is accomplished personally and on a document-by-document basis by the agency head, the deputy agency head, the senior agency official designated under Section 5.3(a)(1),2 or an official with original Top Secret classification authority.
  14. Schroeder, Gerald A. "An Overview of Executive Order 12356". FOIA Update. Department of Justice. Retrieved 11 May 2012. The new order also eliminates the prohibition against the reclassification of information previously declassified and released by providing that such information can be reclassified if it 'may reasonably be recovered.' This provision permits the Government to attempt to correct erroneous disclosures, but only where the information can be recovered from the person or persons to whom it was disclosed. Obviously, that would be impossible in the case of an erroneous disclosure to the general public. But when, for example, an erroneous release is made to a single FOIA requester, this new provision provides the Government with needed flexibility that it did not have under the previous order. This new authority, however, may only be exercised by the President and agency heads and officials designated by the President as original classification authorities. Such determinations must also be reported to the Information Security Oversight Office, which continues to have Government-wide oversight of the information security program under the new order.
  15. Goodman, Amy (21 March 2012). "Exposed: Inside the NSA's Largest and Most Expansive Secret Domestic Spy Center in Bluffdale, Utah". Democracy Now!. Retrieved 11 May 2012. I was never arrested or prosecuted or anything, but I was threatened twice by the Justice Department to return documents that they said were classified. But these were documents that had been released to me by the attorney general under the Carter administration, Attorney General Civiletti. And so, I never returned the documents, because they were unclassified when they were given to me. And what the Reagan administration did was reclassify them as top secret and then order that I give them back. But we found a passage in the executive order on secrecy that said once a document has been declassified, it can't be reclassified. So then Reagan changed the executive order to say that it could be reclassified, but that couldn't apply to my case because of the principle of ex post facto.
  16. "ALA Freedom to Read Foundation Timeline, 1980-1989". American Library Association. Retrieved 18 May 2012. Ultimately, on the appeal, U.S. Circuit Court Judge Ruth Bader Ginsburg ruled that the library associations and other plaintiffs lacked standing to bring their lawsuit in the first instance. In the proceedings below, the U.S. District Court for the District of Columbia had ruled that the U.S. National Security Agency had authority to withdraw the papers in question from the Virginia Military Institute library.
  17. Green, June L. "AMERICAN LIBRARY ASS'N v. FAURER, 631 F.Supp. 416 (1986)" . Retrieved 18 May 2012. The Court's decision is not altered in this instance by NSA's apparent failure to comply strictly with the classification scheme authorized in Executive Order No. 12,356.4 The Court does not condone by any means NSA's cavalier attitude toward its classification determination of the materials at issue, especially the 31 pieces of correspondence. However, the Court believes that this factor alone should not be used as a means to accomplish by the back door what the Court would not permit by the front door — invalidation of NSA's classification determination and disclosure of the information in question. The threat posed to the national security is just too great.
  18. Lichtblau, Eric (February 22, 2010). "The People We Pay to Look over Our Shoulders". New York Times.
  19. Duffy, Michael (June 14, 2004). "One Expert's Verdict: The CIA Caved Under Pressure". Time. Archived from the original on October 12, 2007.
  20. 1 2 Random House, Inc. (2001). "Body of Secrets: About the Author".

Related Research Articles

<span class="mw-page-title-main">National Security Agency</span> U.S. signals intelligence organization

The National Security Agency (NSA) is a national-level intelligence agency of the United States Department of Defense, under the authority of the Director of National Intelligence (DNI). The NSA is responsible for global monitoring, collection, and processing of information and data for foreign and domestic intelligence and counterintelligence purposes, specializing in a discipline known as signals intelligence (SIGINT). The NSA is also tasked with the protection of U.S. communications networks and information systems. The NSA relies on a variety of measures to accomplish its mission, the majority of which are clandestine. The existence of the NSA was not revealed until 1975. The NSA has roughly 32,000 employees.

Freedom of information in the United States relates to the public's ability to access government records, meetings, and other information. In the United States, freedom of information legislation exists at the federal level and at the local level.

<i>The Codebreakers</i>

The Codebreakers – The Story of Secret Writing (ISBN 0-684-83130-9) is a book by David Kahn, published in 1967, comprehensively chronicling the history of cryptography from ancient Egypt to the time of its writing. The United States government attempted to have the book altered before publication, and it succeeded in part.

<span class="mw-page-title-main">David Kahn (writer)</span> American historian, journalist and writer (born 1930)

David Kahn is an American historian, journalist, and writer. He has written extensively on the history of cryptography and military intelligence.

<span class="mw-page-title-main">President's Daily Brief</span> Daily intelligence briefing for the U.S. President

The President's Daily Brief, sometimes referred to as the President's Daily Briefing or the President's Daily Bulletin, is a top-secret document produced and given each morning to the president of the United States; it is also distributed to a small number of top-level US officials who are approved by the president. It includes highly classified intelligence analysis, information about covert operations, and reports from the most sensitive US sources or those shared by allied intelligence agencies. At the discretion of the president, the PDB may also be provided to the president-elect of the United States, between election day and inauguration, and to former presidents on request.

<span class="mw-page-title-main">Freedom of Information Act (United States)</span> 1967 US statute regarding access to information held by the US government

The Freedom of Information Act, 5 U.S.C. § 552, is the United States federal freedom of information law that requires the full or partial disclosure of previously unreleased or uncirculated information and documents controlled by the U.S. government, state, or other public authority upon request. The act defines agency records subject to disclosure, outlines mandatory disclosure procedures, and includes nine exemptions that define categories of information not subject to disclosure. The act was intended to make U.S. government agencies' functions more transparent so that the American public could more easily identify problems in government functioning and put pressure on Congress, agency officials, and the president to address them. The FOIA has been changed repeatedly by both the legislative and executive branches.

<span class="mw-page-title-main">Declassification</span> Publication of formerly secret information

Declassification is the process of ceasing a protective classification, often under the principle of freedom of information. Procedures for declassification vary by country. Papers may be withheld without being classified as secret, and eventually made available.

<span class="mw-page-title-main">National Security Archive</span> Open government advocacy and investigative journalism nonprofit at George Washington University

The National Security Archive is a 501(c)(3) non-governmental, non-profit research and archival institution located on the campus of the George Washington University in Washington, D.C. Founded in 1985 to check rising government secrecy. The National Security Archive is an investigative journalism center, open government advocate, international affairs research institute, and the largest repository of declassified U.S. documents outside the federal government. The National Security Archive has spurred the declassification of more than 15 million pages of government documents by being the leading non-profit user of the U.S. Freedom of Information Act (FOIA), filing a total of more than 70,000 FOIA and declassification requests in its over 35+ years of history.

<span class="mw-page-title-main">James Bamford</span> American author, journalist and documentary producer

James Bamford is an American author, journalist and documentary producer noted for his writing about United States intelligence agencies, especially the National Security Agency (NSA). The New York Times has called him "the nation's premier journalist on the subject of the National Security Agency" and The New Yorker named him "the NSA's chief chronicler."

The United States government classification system is established under Executive Order 13526, the latest in a long series of executive orders on the topic beginning in 1951. Issued by President Barack Obama in 2009, Executive Order 13526 replaced earlier executive orders on the topic and modified the regulations codified to 32 C.F.R. 2001. It lays out the system of classification, declassification, and handling of national security information generated by the U.S. government and its employees and contractors, as well as information received from other governments.

Special access programs (SAPs) in the U.S. Federal Government are security protocols that provide highly classified information with safeguards and access restrictions that exceed those for regular (collateral) classified information. SAPs can range from black projects to routine but especially-sensitive operations, such as COMSEC maintenance or presidential transportation support. In addition to collateral controls, a SAP may impose more stringent investigative or adjudicative requirements, specialized nondisclosure agreements, special terminology or markings, exclusion from standard contract investigations (carve-outs), and centralized billet systems. Within the Department of Defense, SAP is better known as "SAR" by the mandatory Special Access Required (SAR) markings.

<i>Body of Secrets</i>

Body of Secrets: Anatomy of the Ultra-Secret National Security Agency is a book by James Bamford about the NSA and its operations. It also covers the history of espionage in the United States from uses of the Fulton surface-to-air recovery system to retrieve personnel on Arctic Ocean drift stations to Operation Northwoods, a declassified US military plan that Bamford describes as a "secret and bloody war of terrorism against their own country in order to trick the American public into supporting an ill-conceived war they intended to launch against Cuba."

The Cryptographic Quarterly is an internal, classified journal of the U.S. National Security Agency (NSA).

<i>The Shadow Factory</i> 2008 nonfiction book by James Bamford

The Shadow Factory: The Ultra-Secret NSA from 9/11 to the Eavesdropping on America is a book on the National Security Agency by author James Bamford.

<i>Electronic Privacy Information Center v. Department of Justice</i>

EPIC v. Department of Justice is a 2014 case in the United States District Court for the District of Columbia between the Electronic Privacy Information Center (EPIC) and the U.S. Department of Justice (DOJ) where EPIC seeks court action to enforce their Freedom of Information Act request for documents that the Department of Justice has withheld pertaining to George W. Bush's authorization of NSA warrantless surveillance.

<span class="mw-page-title-main">Martin and Mitchell defection</span> 1960 defection of two U.S. National Security Agency cryptologists to the Soviet Union

In September 1960, two U.S. National Security Agency (NSA) cryptologists, William Hamilton Martin and Bernon F. Mitchell, defected to the Soviet Union. A secret 1963 NSA study said that: "Beyond any doubt, no other event has had, or is likely to have in the future, a greater impact on the Agency's security program."

Executive Order 13526 was issued on December 29, 2009, by United States President Barack Obama. It is one of a series of executive orders from US Presidents outlining how classified information should be handled. It revokes and replaces the previous Executive Orders in effect for this, which were EO 12958 (text) and EO 13292 (text).

<span class="mw-page-title-main">Thomas A. Drake</span> Former NSA senior executive, military veteran, and whistleblower (born 1957)

Thomas Andrews Drake is a former senior executive of the National Security Agency (NSA), a decorated United States Air Force and United States Navy veteran, and a whistleblower. In 2010, the government alleged that Drake mishandled documents, one of the few such Espionage Act cases in U.S. history. Drake's defenders claim that he was instead being persecuted for challenging the Trailblazer Project. He is the 2011 recipient of the Ridenhour Prize for Truth-Telling and co-recipient of the Sam Adams Associates for Integrity in Intelligence (SAAII) award.

The United States' National Security Agency (NSA), an intelligence agency of the federal government, publishes many documents on the history and technology of cryptology, cryptography, and cryptanalysis through various publications.

<i>Jewel v. National Security Agency</i>

Jewel v. National Security Agency, 673 F.3d 902, was a class action lawsuit argued before the District Court for the Northern District of California and the Court of Appeals for the Ninth Circuit, filed by Electronic Frontier Foundation (EFF) on behalf of American citizens who believed that they had been surveilled by the National Security Agency (NSA) without a warrant. The EFF alleged that the NSA's surveillance program was an "illegal and unconstitutional program of dragnet communications surveillance" and claimed violations of the Fourth Amendment.