data lake
A large repository of accumulated individual-level data tended by specialized staff; metaphorically prone to leaking or 'cracking' and releasing data into the world.
As defined in 278 | Kieran Healy on the Technology of Ranking People
Other definitions
A storage repository that holds large volumes of raw data in its native format for later analysis.
Henry Schuck - Building ZoomInfo - [Invest Like the Best, EP.330]Storage system holding large volumes of raw data in its native format, typically unstructured, to be processed later.
Databricks: From Data to Decisions
Where it comes up · 6
- Databricks: From Data to Decisions5 claims
- Ali Ghodsi – The Past, Present, and Future of Big Data – [Founder’s Field Guide, EP.18]5 claims
- How Claude's AI Financial Analyst is Changing Investing (Insider Unveils)4 claims
- Bajaj Finance: Strategies of a Lending Giant3 claims
- Building Europe’s Next Software Champion1 claim
- 278 | Kieran Healy on the Technology of Ranking People1 claim
Most important claims · 10 of 19Search all claims for “data lake” →
- Falling storage prices, combined with the example of Google extracting value from data, led enterprises to collect everything into data lakes, and early success was measured by data volume (one petabyte, then two) rather than by business outcomes.Ali Ghodsi – The Past, Present, and Future of Big Data – [Founder’s Field Guide, EP.18]
- Snowflake was the next-generation cloud version of an existing data warehouse market, whereas Databricks' data lake market had never been well established because of inadequate technology.Databricks: From Data to Decisions
- Enterprises commonly use Databricks first to process data and then store it in Snowflake, because Snowflake has moved upstream into data processing while Databricks has moved downstream into data warehousing, so the two tools increasingly overlap but often coexist.Databricks: From Data to Decisions
- Falling storage prices made it cheap to keep massive volumes of data, so organizations stopped deleting data and built large data lakes, even without a clear use for it.Ali Ghodsi – The Past, Present, and Future of Big Data – [Founder’s Field Guide, EP.18]
- The most exciting future development is the lakehouse paradigm, merging data lakes used for AI with data warehouses used for data management into one platform, which would give enterprises the end-to-end capabilities that Silicon Valley tech companies had in the early 2000s.Ali Ghodsi – The Past, Present, and Future of Big Data – [Founder’s Field Guide, EP.18]
- Bajaj now uses about 1,000 data points on each customer, across roughly 200 million Indians in its database, creating around 200 billion data points, and this automated decision engine is a moat that would be very hard for competitors to build.Bajaj Finance: Strategies of a Lending Giant
- The value in AI-driven operations comes from piping different databases together in a secure, data-protected way, running the right model on a unified data lake, and deploying processes that stakeholders accept, rather than from the insight or storytelling itself.Building Europe’s Next Software Champion
- A major obstacle to AI adoption in financial services is that many institutions have not built great data lakes, making it necessary to invest in data infrastructure before applying AI capabilities.How Claude's AI Financial Analyst is Changing Investing (Insider Unveils)
- Success with public market use cases comes partly from Norges having built a mature data lake and ingesting core data sources, which is necessary for coherent public equities investment strategy.How Claude's AI Financial Analyst is Changing Investing (Insider Unveils)
- Databricks coined the term Lakehouse to combine data lakes and data warehouses, which was ridiculed as too clever at the time, but through education of the market the Lakehouse became a defined industry category, a marketing achievement Alan believes is underappreciated.Databricks: From Data to Decisions