Mike Shapiro (programmer)

Last updated
Mike Shapiro
Born
Michael W. Shapiro
Occupation Software engineer

Michael W. Shapiro is an American computer programmer who worked in operating systems and storage at Sun Microsystems, Oracle, and EMC.

Contents

While working at Sun Microsystems, Shapiro developed pgrep, the Modular Debugger (MDB), DTrace, fault management and diagnosis, and other software for Sun's Solaris operating system. [1]

The pgrep and pkill utilities Shapiro created are today found in every major Unix operating system, including Linux, [2] BSD, [3] and macOS, [4] and are commonly used by system administrators and developers. [5] [6]

Shapiro and the DTrace team received a Technology Innovation Award and Overall Gold Medal for Innovation for DTrace from The Wall Street Journal in 2006. [7] DTrace was also recognized by USENIX with the Software Tools User Group (STUG) award in 2008. [8] Over the next 10 years, DTrace was ported and incorporated into other major operating systems, including BSD [9] and Apple's macOS. [10]

Starting in 2006, Shapiro led Sun's engineering effort to build a commercial storage product using Solaris and Sun's ZFS filesystem, announced in 2008. [11] In interviews with the New York Times [12] and Fortune, [13] Shapiro explained how a small engineering team at Sun dubbed "Fishworks" pitched the project to Sun's executives and developed the product outside of Sun's organizational structure.

After Oracle Corporation acquired Sun, Shapiro managed engineering for storage products as Vice President for Storage. Oracle reported in 2015 that the ZFS Storage product line had surpassed $1B in revenue. [14]

Shapiro announced his departure from Oracle in a 2010 blog posting, [15] and was revealed several years later as a member of the founding team of DSSD when EMC purchased the startup. [16] He developed the DSSD software architecture with fellow Sun engineer Jeff Bonwick, and served as DSSD's vice president for software. Shapiro explained how DSSD built the industry's first NVM Express pooled storage system for multiple host computers in a 2016 interview with the Hot Aisle podcast. [17] The DSSD product was used in the TACC 2015 "Wrangler" computer cluster [18] and received HPCwire's Editor's Choice Award later that year. [19]

After EMC was acquired by Dell Technologies, the DSSD group was folded into the EMC storage product division in 2017. [20]

Shapiro was a co-author of the NVM Express over Fabrics storage protocol announced in 2014. [21] By 2019, IDC analysts reported that NVMeoF was disrupting SAN purchasing by offering significant performance improvements for networked SSDs. [22]

Publications

Related Research Articles

<span class="mw-page-title-main">Sun Microsystems</span> American computer company, 1982–2010

Sun Microsystems, Inc., was an American technology company that sold computers, computer components, software, and information technology services and created the Java programming language, the Solaris operating system, ZFS, the Network File System (NFS), and SPARC microprocessors. Sun contributed significantly to the evolution of several key computing technologies, among them Unix, RISC processors, thin client computing, and virtualized computing. Notable Sun acquisitions include Cray Business Systems Division, Storagetek, and Innotek GmbH, creators of VirtualBox. Sun was founded on February 24, 1982. At its height, the Sun headquarters were in Santa Clara, California, on the former west campus of the Agnews Developmental Center.

<span class="mw-page-title-main">Oracle Solaris</span> Unix operating system originally developed by Sun Microsystems

Solaris is a proprietary Unix operating system originally developed by Sun Microsystems. After the Sun acquisition by Oracle in 2010, it was renamed Oracle Solaris.

<span class="mw-page-title-main">InfiniBand</span> Network standard

InfiniBand (IB) is a computer networking communications standard used in high-performance computing that features very high throughput and very low latency. It is used for data interconnect both among and within computers. InfiniBand is also used as either a direct or switched interconnect between servers and storage systems, as well as an interconnect between storage systems. It is designed to be scalable and uses a switched fabric network topology. By 2014, it was the most commonly used interconnect in the TOP500 list of supercomputers, until about 2016.

NetApp, Inc. is an American data storage and data management services company headquartered in San Jose, California. It has ranked in the Fortune 500 from 2012 to 2021. Founded in 1992 with an initial public offering in 1995, NetApp offers cloud data services for management of applications and data both online and physically.

<span class="mw-page-title-main">DTrace</span> Dynamic tracing framework for kernel and applications

DTrace is a comprehensive dynamic tracing framework originally created by Sun Microsystems for troubleshooting kernel and application problems on production systems in real time. Originally developed for Solaris, it has since been released under the free Common Development and Distribution License (CDDL) in OpenSolaris and its descendant illumos, and has been ported to several other Unix-like systems.

The Common Development and Distribution License (CDDL) is a free and open-source software license, produced by Sun Microsystems, based on the Mozilla Public License (MPL). Files licensed under the CDDL can be combined with files licensed under other licenses, whether open source or proprietary. In 2005 the Open Source Initiative approved the license. The Free Software Foundation (FSF) considers it a free software license, but one which is incompatible with the GNU General Public License (GPL).

<span class="mw-page-title-main">Bryan Cantrill</span> American computer scientist

Bryan M. Cantrill is an American software engineer who worked at Sun Microsystems and later at Oracle Corporation following its acquisition of Sun. He left Oracle on July 25, 2010, to become the Vice President of Engineering at Joyent, transitioning to Chief Technology Officer at Joyent in April 2014, until his departure on July 31 of 2019. He is now the CTO of Oxide Computer company.

Data scrubbing is an error correction technique that uses a background task to periodically inspect main memory or storage for errors, then corrects detected errors using redundant data in the form of different checksums or copies of data. Data scrubbing reduces the likelihood that single correctable errors will accumulate, leading to reduced risks of uncorrectable errors.

pgrep is a command-line utility initially written for use with the Solaris 7 operating system by Mike Shapiro. It has since been available in illumos and reimplemented for the Linux and BSDs. It searches for all the named processes that can be specified as extended regular expression patterns, and—by default—returns their process ID. Alternatives include pidof and ps.

<span class="mw-page-title-main">Adam Leventhal (programmer)</span> American software engineer

Adam Leventhal is an American software engineer, and one of the three authors of DTrace, a dynamic tracing facility in Solaris 10 which allows users to observe, debug and tune system behavior in real time. Available to the public since November 2003, DTrace has since been used to find opportunities for performance improvements in production environments. Adam joined the Solaris kernel development team after graduating cum laude from Brown University in 2001 with his B.Sc. in Math and Computer Science. In 2006, Adam and his DTrace colleagues were chosen Gold winners in The Wall Street Journal's Technology Innovation Awards contest by a panel of judges representing industry as well as research and academic institutions. A year after Sun Microsystems was acquired by Oracle Corp, Leventhal announced he was leaving the company. He served as Chief Technology Officer at Delphix from 2010 to 2016.

Sun Open Storage was an open source computer data storage platform developed by Sun Microsystems. Sun Open Storage was advertised as avoiding vendor lock-in.

Jeff Bonwick invented and led development of the ZFS file system, which was used in Oracle Corporation's ZFS storage products as well as startups including Nexenta, Delphix, Joyent, and Datto, Inc. Bonwick is also the inventor of slab allocation, which is used in many operating systems including MacOS and Linux, and the LZJB compression algorithm.

Data Integrity Field (DIF) is an approach to protect data integrity in computer data storage from data corruption. It was proposed in 2003 by the T10 subcommittee of the International Committee for Information Technology Standards. A similar approach for data integrity was added in 2016 to the NVMe 1.2.1 specification.

NVM Express (NVMe) or Non-Volatile Memory Host Controller Interface Specification (NVMHCIS) is an open, logical-device interface specification for accessing a computer's non-volatile storage media usually attached via the PCI Express bus. The initialism NVM stands for non-volatile memory, which is often NAND flash memory that comes in several physical form factors, including solid-state drives (SSDs), PCIe add-in cards, and M.2 cards, the successor to mSATA cards. NVM Express, as a logical-device interface, has been designed to capitalize on the low latency and internal parallelism of solid-state storage devices.

<span class="mw-page-title-main">Brendan Gregg</span>

Brendan Gregg is a computer engineer known for his work on computing performance. He works for Intel, and previously worked at Netflix, Sun Microsystems, Oracle Corporation, and Joyent. He was born in Newcastle, New South Wales and graduated from the University of Newcastle, Australia.

<span class="mw-page-title-main">OpenZFS</span> Open-source implementation of the ZFS file system

OpenZFS is an open-source implementation of the ZFS file system and volume manager initially developed by Sun Microsystems for the Solaris operating system and now maintained by the OpenZFS Project. It supports features like data compression, data deduplication, copy-on-write clones, snapshots, and RAID-Z. It also supports the creation of virtual devices, which allows for the creation of file systems that span multiple disks.

<span class="mw-page-title-main">Nexenta Systems</span> Software company

Nexenta by DDN, Inc., is a subsidiary of DataDirect Networks that markets computer software for data storage and backup, headquartered in San Jose, California. Nexenta develops the products NexentaStor, NexentaCloud, NexentaFusion, and NexentaEdge. It was founded as Nexenta Systems, Inc., in 2005.

ZFS is a file system with volume management capabilities. It began as part of the Sun Microsystems Solaris operating system in 2001. Large parts of Solaris – including ZFS – were published under an open source license as OpenSolaris for around 5 years from 2005, before being placed under a closed source license when Oracle Corporation acquired Sun in 2009–2010. During 2005 to 2010, the open source version of ZFS was ported to Linux, Mac OS X and FreeBSD. In 2010, the illumos project forked a recent version of OpenSolaris, to continue its development as an open source project, including ZFS. In 2013, OpenZFS was founded to coordinate the development of open source ZFS. OpenZFS maintains and manages the core ZFS code, while organizations using ZFS maintain the specific code and validation processes required for ZFS to integrate within their systems. OpenZFS is widely used in Unix-like systems.

References

  1. ↑ https://blogs.oracle.com/mws/entry/introduction Mike Shapiro's Blog
  2. ↑ "Pgrep(1) - Linux man page".
  3. ↑ "Pkill(1) - OpenBSD manual pages".
  4. ↑ "Proctools".
  5. ↑ "Greater Grokking of pgrep". www.linux-magazine.com. 2016.
  6. ↑ "Sniffing Out Unix Processes Using pgrep". www.networkworld.com. 2017-02-27.
  7. ↑ Totty, Michael (September 2006). "The Winners Are..." The Wall Street Journal. Dow Jones & Company, Inc. Retrieved 2007-03-31.
  8. ↑ "2008 USENIX Annual Technical Conference (USENIX '08)". 2008. Retrieved 2008-11-26.
  9. ↑ "Chapter 25. DTrace".
  10. ↑ "Mac OS X Leopard gets Sun's DTrace". www.zdnet.com. 2006-08-08.
  11. ↑ "Sun rolls out its own storage appliances". techworld.com.au. 2008-11-11. Retrieved 2013-11-13.
  12. ↑ "Sun Microsystems Hopes to Shake Up Storage Industry". The New York Times . 2008-09-05.
  13. ↑ "Sun gambles big as outlook darkens". fortune.com. 2008-11-12.
  14. ↑ "Oracle Announces That Its ZFS Storage Appliance Has Surpassed $1 Billion In Revenue". storagereview.com. 2015-10-09.
  15. ↑ "End of File". 2010-10-22. Retrieved 2016-02-25.
  16. ↑ Why DSSD is a Game Changer
  17. ↑ "The Hot Aisle – Re-Architecting the Storage Stack with DSSD's Mike Shapiro". www.inthedc.com. 2016-04-26.
  18. ↑ "TACC's "Wrangler" Uses DSSD Technology for Data-Intensive Computing". insidehpc.com. 2015-04-22.
  19. ↑ "TACC Recognized in HPCwire Readers' and Editors' Choice Awards". www.hpcwire.com. 2015-11-17.
  20. ↑ Chris Mellor (March 2, 2017). "Dell kills off standalone DSSD D5, scatters remains into other gear". The Register. Retrieved March 4, 2017.
  21. ↑ "NVM Express Organization Initiates "NVM Express over Fabrics" Effort; NVMe Specification Revision 1.2 Approaching Ratification". Press release. September 3, 2014. Retrieved March 4, 2017.
  22. ↑ "NVMe over Fabrics creates data-center storage disruption". www.networkworld.com. 2019-05-14.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.