Big Data Videos
Big Data Videos
Big Data Pulse
EMAIL DIGESTS
Daily
Every morning
Weekly
Tuesday recap
EMAIL DIGESTS
Daily
Every morning
Weekly
Tuesday recap
The Denodo webinar, hosted by Legal IT Insider’s Caroline Hill, examined why legal‑focused artificial intelligence projects frequently stall despite sophisticated tools. Speakers argued that the root cause is not algorithmic weakness but the inability of law firms to rely on the data feeding those models. Participants highlighted fragmented data across core databases, legacy systems, and transient real‑time feeds, which undermines governance, confidentiality, and jurisdictional compliance. Pilot implementations succeed in sandboxed environments, yet when scaled they falter because the underlying data is incomplete, outdated, or lacks proper permission controls. The discussion also warned that emerging agentic AI will intensify these trust requirements. Errol Rodri emphasized, "Legal AI doesn’t stall because models are weak; it stalls because the data beneath them isn’t trusted," and added that legal decisions must survive both the moment of recommendation and later audit scrutiny. He cited a case where a firm spent hours reconciling billing history, matter experience, and regulatory insights spread across disparate repositories, losing responsiveness and opportunities. The takeaway for firms is clear: invest in a unified, governed data layer—such as Denodo’s integration platform—to provide explainable, permission‑aware, and traceable information. Doing so not only enables AI to move from proof‑of‑concept to production but also safeguards the profession’s core requirement for defensible advice.
Bain & Company highlighted that telecom operators sit on a massive, under‑exploited data trove, ranging from event attendance to travel routes. One carrier piloted a program that anonymized this information, satisfying strict regulator requirements while delivering personalized discount offers. The...
The video tackles the hot question of whether artificial intelligence will supplant data engineers, concluding that AI is a powerful augmenting tool rather than a job‑killer. Using a crane analogy, the speaker illustrates how new technology speeds construction without eliminating...
During Digital Health Week 2025, Acting CIO Darren Douglass outlined Health New Zealand’s 10‑year Health Digital Investment Plan. He emphasized that while data volumes are growing, data quality remains a barrier, and that stabilising legacy systems is as vital as...
Data engineers are at a crossroads in 2025, as the speaker argues that lingering skepticism about AI's impact is holding professionals back. He urges data practitioners to replace doubt with diligent research into labor market trends and compensation data. The talk...
The video warns that fear is a hidden, multi‑million‑dollar drain on data‑focused careers. Drawing on a 2025 study of over 100,000 professionals, the speaker highlights that roughly nine‑tenths of respondents have been dissatisfied with their roles for more than two...
The video announces Alibaba’s Qwen 3.5 397B A7B, the first open‑weight model in the Qwen 3.5 series, designed as a native multimodal engine for language, vision, and real‑world agentic workflows. By publishing the model under an Apache 2.0 license, Alibaba signals a strategic shift toward...
The video advises seasoned software‑support professionals to pivot into data engineering, arguing that the transition can unlock a substantial salary boost—often exceeding $50,000. With 15 years of experience, a support engineer earning $130,000 can realistically target $180,000 as a data engineer....
The video tackles a common concern among software, backend, and QA professionals: whether their existing skill set positions them competitively for data engineering roles. It highlights that formal data‑engineering degrees or certificates are still scarce in most universities, meaning the...
The video urges tech professionals to abandon title chasing and focus on compensation. The speaker cites stark examples: a 20‑year veteran earning $120,000 while he earned $500,000 with just five years of experience, and junior roles often paying two to...
The video walks viewers through building a Retrieval‑Augmented Generation (RAG) system that can be deployed in real‑world enterprises. It starts by defining RAG as a technique that feeds a company’s internal documents into a large language model so the model...
The video argues that staying relevant in data engineering hinges on two complementary abilities – the capacity to think like an architect and the ability to execute efficiently using AI tools. First, the speaker stresses that designing system architectures requires deep...
The video introduces MicroGPT, a minimalist implementation of a GPT‑style transformer written in just 243 lines of pure Python. Created by Andrej Karpathy, the project strips away all external dependencies—no PyTorch, TensorFlow, NumPy or other libraries—so that the entire model,...
The video argues that, contrary to the buzz surrounding the latest generative‑AI gadgets, the strongest hiring signal today is a surge in data‑engineering talent. Citing the World Economic Forum’s Jobs Report, the presenter notes that data‑warehousing, data engineering and big‑data...
The video contends that artificial intelligence will not eliminate data‑engineering roles; instead, it will generate new opportunities as AI systems depend on high‑quality data. The speaker explains that data is the primary moat for any AI product, and only humans can...
The video walks through Databricks’ Intelligent Document Processing (IDP) solution, demonstrating how to build an end‑to‑end pipeline that extracts key financial data from PDF invoices. Using a fictitious company, Green Sheen, the presenter shows how raw PDF files are uploaded...
The video explains how data analysts can transition into data engineering roles, a move that can nearly quadruple compensation. Chris Garzone outlines the fundamental differences between the two positions, emphasizing that analysts typically work with Excel, SQL, and dashboards, while...
The video tackles the pervasive myth that the data‑engineering job market is either booming or collapsing, urging viewers to see it as a constantly shifting landscape. The speaker recounts hearing opposite excuses—from “the market is great, no need to upskill”...
The video warns small data teams about five common, costly missteps that can cripple analytics and scalability. It emphasizes that even lean teams need a disciplined data architecture, not an ad‑hoc collection of queries, and that early adoption of a...
David Talby of Pacific AI showcases Spark NLP, an Apache‑2.0 open‑source library that enables enterprise‑grade natural language processing at petabyte scale on standard Spark clusters. He highlights three core use cases: generating embeddings for retrieval‑augmented generation vector stores, performing batch...
Hammerspace’s core capability is aggregating metadata from diverse underlying storage systems—object and NAS—into metadata servers that sit outside the data path to create a single global namespace. The platform assimilates metadata (a process that takes days, not instant) so organizations...
Hammerspace offers a data-management platform that decouples data from underlying infrastructure, creating a virtually infinite, location-agnostic storage layer across clouds and on-prem systems. The company aggregates metadata across the data estate to eliminate silos, speed pipelines and enable seamless use...
As TV budgets shift from linear to connected TV, marketers are increasingly using direct-to-audience targeting in CTV while linear TV is embracing big-data planning to build campaigns against advanced audiences rather than broad demographics. For healthcare advertisers, on-target reach, frequency...
The video warns data engineers and other tech professionals that staying in the same role without updating their skill set often leads to stagnant wages. It argues that the abilities a company hired you for may no longer align with...
The video walks through the foundational storage paradigms and architectural patterns that underpin modern data engineering platforms, from raw data lakes to structured warehouses and the emerging lakehouse model. It explains that data lakes—often implemented with Azure Data Lake Storage or...
The video spotlights a growing niche of AI‑driven analytics platforms that go beyond generic chatbots like ChatGPT, offering data teams purpose‑built capabilities for faster insight generation. It introduces five relatively unknown tools—AI‑enhanced notebooks, Julius AI, ThoughtSpot Spotfire, Sigma Computing, and...
The video explains the fundamental distinction between online transaction processing (OLTP) and online analytical processing (OLAP) using a supermarket analogy. It shows how a checkout counter represents OLTP—rapid, accurate updates to inventory and payments—while end‑of‑day sales reports illustrate OLAP’s focus...
The video introduces the medallion architecture, a data‑engineering pattern that organizes datasets into three progressive layers—bronze, silver, and gold—to avoid overwriting raw inputs. It stresses that ingesting data should not be cleaned in a single pass because doing so erodes flexibility,...
The video provides a rapid overview of Snowflake, the cloud‑native data‑warehouse that debuted with the largest software IPO in 2020, raising $3.36 billion. It highlights Snowflake’s rapid adoption—used by 751 of Forbes’ top 2,000 global firms and spawning tens of thousands...
The podcast spotlights the shifting landscape of AI and data careers as we look toward 2026, featuring Databricks product manager Archika Dogra and PM director Danny Lee. They examine which skills, roles, and platforms will dominate and how professionals can...
Databricks has launched a free, no‑credit‑card edition aimed at students and professionals seeking hands‑on experience with its cloud‑based data platform. The environment runs on AWS, mirrors the standard UI, and bundles introductory videos, notebooks, and a Unity catalog, allowing users...
The video introduces OilX’s new data‑as‑a‑service platform that aims to democratize access to granular physical‑commodity information, positioning it as a catalyst for the emerging “quantamental” trading paradigm. By stripping away legacy costs and offering standardized, real‑time datasets, OilX lowers entry barriers...
The video showcases five hands‑on n8n projects designed to elevate low‑code AI automation skills, ranging from conversational agents to business‑focused bots. Each example leverages n8n’s visual workflow engine combined with large language models, APIs, and third‑party tools to deliver real‑world...
Google unveiled two new open‑source AI models aimed at accelerating medical imaging analysis and clinical documentation, expanding its MedGemma family with version 1.5 and launching MedASR for speech‑to‑text conversion. MedGemma 1.5 is a 4‑billion‑parameter multimodal model trained on the MedMA dataset....
The Yale School of Management’s Quantitative Investing course introduces students to systematic, data‑driven portfolio construction. It defines quantitative or systematic investing as the process of converting financial characteristics—such as earnings‑to‑price ratios, momentum quintiles, or other accounting metrics—into repeatable trading rules,...
Google announced the open‑source Universal Commerce Protocol (UCP), a standardized framework that lets artificial‑intelligence agents complete online purchases end‑to‑end. Until now, AI could only recommend products; actual checkout required bespoke integrations for each retailer. UCP provides a shared language for...
Alibaba unveiled Qwen3VL, a multimodal AI model that combines text and image embeddings into a unified semantic space, alongside a dedicated re‑ranking engine. The new embedding layer lets the model treat a picture, its caption, and a related paragraph as interchangeable...
