Developer(s) | dbt-Labs |
---|---|
Initial release | December 3, 2021 |
Stable release | 1.8.4 / July 18, 2024 [1] |
Repository | |
Written in | Python |
Operating system | Microsoft Windows, macOS, Linux |
Available in | Python |
Type | Data analytics, data management |
License | Apache License 2.0 |
Website | docs |
Data build tool (dbt) is an open-source command line tool that helps analysts and engineers transform data in their warehouse more effectively. [2]
It started at RJMetrics in 2016 as a solution to add basic transformation capabilities to Stitch (acquired by Talend in 2018). [3] The earliest versions of dbt allowed analysts to contribute to the data transformation process following the best practices of software engineering. [4]
From the beginning, dbt was open source. [5] In 2018, the dbt Labs team (then called Fishtown Analytics) released a commercial product on top of dbt Core. [6]
In April 2020, dbt Labs announced its Series A led by Andreessen Horowitz. [7] In November, dbt Labs announced its Series B led by Andreessen Horowitz and Sequoia. [8] And in June 2021, dbt Labs raised its Series C led by Altimeter, Sequoia, and Andreessen Horowitz. [9] In February 2022, the company raised $222 million for its Series D, at a $4.2 billion valuation [10]
Dbt enables analytics engineers to transform data in their warehouses by writing select statements, and turns these select statements into tables and views. Dbt does the transformation (T) in extract, load, transform (ELT) processes – it does not extract or load data, but is designed to be performant at transforming data already inside of a warehouse. Dbt has the goal of allowing analysts to work more like software engineers, in line with the dbt viewpoint. [11]
Dbt uses YAML files to declare properties. seed
is a type of reference table used in dbt for static or infrequently changed data, like for example country codes or lookup tables), which are CSV based and typically stored in a seeds folder.
Marc Lowell Andreessen is an American businessman and former software engineer. He is the co-author of Mosaic, the first widely used web browser with a graphical user interface; co-founder of Netscape; and co-founder and general partner of Silicon Valley venture capital firm Andreessen Horowitz. He co-founded and later sold the software company Opsware to Hewlett-Packard; he also co-founded Ning, a company that provides a platform for social networking websites. He is an inductee in the World Wide Web Hall of Fame. Andreessen's net worth is estimated at $1.7 billion.
Andreessen Horowitz is a private American venture capital firm, founded in 2009 by Marc Andreessen and Ben Horowitz. The company is headquartered in Menlo Park, California. As of April 2023, Andreessen Horowitz ranks first on the list of venture capital firms by assets under management, with $42 billion as of May 2024.
SnapLogic is a commercial software company that provides integration platform as a service (iPaaS) tools for connecting cloud data sources, SaaS applications, and on-premises business software applications. Founded in 2006, the company is headquartered in San Mateo, California. SnapLogic is headed by Gaurav Dhillon, ex-CEO and co-founder of Informatica, and is venture-backed by Andreessen Horowitz, Ignition Partners, Floodgate Fund, Brian McClendon, and Naval Ravikant.
Peter J. Levine is an American software executive and venture capitalist.
Apptio, Inc. is a Bellevue, Washington-based company founded in 2007 that develops technology business management (TBM) software as a service (SaaS) applications. Apptio enterprise apps are designed to assess and communicate the cost of IT services for planning, budgeting and forecasting purposes; Apptio's services offer tools for CIOs to manage technology departments' storage, applications, energy usage, cybersecurity, and reporting obligations; manage the costs of public cloud, migration to public cloud and SaaS portfolios; and adopt and scale Agile across the enterprise.
DigitalOcean Holdings, Inc. is an American multinational technology company and cloud service provider. The company is headquartered in New York City, New York, US, with 15 globally distributed data centers. DigitalOcean provides developers, startups, and SMBs with cloud infrastructure-as-a-service platforms.
Valar Ventures is a US-based venture capital fund founded by Andrew McCormack, James Fitzgerald and Peter Thiel in 2010. Historically, the majority of the firm's investments have been in technology startups based outside of Silicon Valley, including in Europe, the UK, the US and Canada. Valar Ventures originally spun out of Thiel Capital, Peter Thiel's global parent company based in San Francisco, and is now headquartered near Madison Square in Manhattan. The firm's namesake is the Valar of J. R. R. Tolkien's legendarium, who are god-like immortal spirits that chose to enter the mortal world to prepare it for their living creations.
Mixpanel is an event analytics service company that tracks user interactions with web and mobile applications.
RJMetrics is an American software company headquartered in Philadelphia, Pennsylvania. The company offers big data analytics to small and midsize businesses.
Databricks, Inc. is a global data, analytics, and artificial intelligence company founded by the original creators of Apache Spark.
GitLab Inc. is an open-core company that operates GitLab, a DevOps software package that can develop, secure, and operate software. GitLab includes a distributed version control based on Git, including features such as access control, bug tracking, software feature requests, task management, and wikis for every project, as well as snippets.
Imply Data, Inc. is an American software company. It develops and provides commercial support for the open-source Apache Druid, a real-time database designed to power analytics applications.
Okta, Inc. is an American identity and access management company based in San Francisco. It provides cloud software that helps companies manage and secure user authentication into applications, and for developers to build identity controls into applications, website, web services, and devices. It was founded in 2009 and had its initial public offering in 2017, reaching a valuation of over $6 billion.
Netlify is a remote-first cloud computing company that offers a development platform that includes build, deploy, and serverless backend services for web applications and dynamic websites.
Applied Intuition is an American software company specializing in products for creating autonomous vehicles (AVs) and advanced driver-assistance systems (ADAS). Founded in 2017 and based in Mountain View, California, Applied Intuition develops tools for the development, testing, and deployment of AV and ADAS technologies in various industries, including automotive, trucking, defense, agriculture, construction, and mining. The company leverages artificial intelligence (AI) technology to provide automakers and other entities with solutions to simulate driving scenarios in the development of autonomous systems.
Samsara Inc. is an American IoT company headquartered in San Francisco, California that provides software and insights for physical operations. The company has customers across North America and Europe. Samsara developed a connected operations cloud platform that provides insights to physical operations organizations in the transportation, construction, energy, utilities, public sector and retail industries, and supports the safety and efficiency of those operations.
Deel is an Israeli-American payroll and outsourcing company based in San Francisco, California. The company provides hiring, payments, and outsourcing services for companies hiring international employees and contractors.
Wiz, Inc. is an American cloud security startup headquartered in New York City. The company was founded in January 2020 by Assaf Rappaport, Yinon Costica, Roy Reznik, and Ami Luttwak, all of whom previously founded Adallom. Rappaport is CEO, Costica is VP of Product, Reznik is VP of Engineering, and Luttwak is CTO. The company's platform analyzes computing infrastructure hosted in Amazon Web Services, Microsoft Azure, Google Cloud Platform, Oracle Cloud Infrastructure, and Kubernetes for combinations of risk factors that could allow malicious actors to gain control of cloud resources and/or exfiltrate valuable data.
Loom, Inc. is a technology company that provides video communication software for work. Its technology includes screen and camera recording, video editing, transcription, and the ability to share the recorded video link with others.
The Philadelphia-based data analytics startup revealed Thursday that it had settled on a $4.2 billion valuation as part of a $222 million Series D funding round