Know What's Happening in Big Data
Know What's Happening in Big Data
Big Data Pulse
EMAIL DIGESTS
Daily
Every morning
Weekly
Tuesday recap
EMAIL DIGESTS
Daily
Every morning
Weekly
Tuesday recap
Minor Hotels builds global AI and data platform to personalize guest experiences
The hotel chain is creating a new AI‑driven data platform that links guest information across its 640‑plus properties and 12 brands. Powered by Google Cloud, Salesforce and OneTrust, the stack bypasses legacy systems to deliver real‑time, context‑aware personalization.
Also developing:
By the numbers: Dynatrace acquires Bindplane
Enterprise data warehouses are increasingly seen as costly, inflexible assets, prompting a shift toward open‑source alternatives. EDB Postgres AI introduces WarehousePG, a PostgreSQL‑based, petabyte‑scale MPP warehouse that promises up to 58% lower total cost of ownership while delivering predictable performance. The platform supports hybrid storage via PXF, real‑time ingestion with FlowServer, and in‑database AI through MADlib and pgvector. Migration paths from legacy systems are designed to be low‑risk, preserving existing SQL workloads.
The IRS is testing Palantir's AI-powered analytics platform to identify "highest-value" audit and investigation targets, documents obtained by Wired reveal. The pilot program aims to cut through decades of fragmented legacy systems to surface taxpayers most likely to be committing...
Profisee has launched the general‑availability of its 2026 R1 release, positioning the cloud‑native MDM platform as an AI leader. The update introduces a Model Context Protocol (MCP) Server that creates an open standard for linking master data to AI tools such...
SAP announced acquisition of Reltio, integrating its master data management platform into SAP Business Data Cloud. The move gives SAP control over the enterprise master data layer, especially for customers with mixed SAP and non‑SAP environments. By embedding Reltio, SAP...
CIBO Technologies has entered a three‑year strategic partnership with Ingredion to expand regenerative agriculture across its supply chain. The collaboration will use CIBO’s data and analytics platform, including AI and computer‑vision tools, to enroll and support farmers in Iowa and...
Palantir Technologies announced a five‑year renewal and expansion of its partnership with Stellantis, adding the Palantir Artificial Intelligence Platform to the automaker’s existing Foundry deployment. The deal deepens Palantir’s foothold in automotive SaaS and comes as the company’s stock slipped...
SQL tip You're running three separate queries to get this. SELECT SUM(amount) FROM orders WHERE user_type = 'premium'; SELECT COUNT(*) FROM orders WHERE is_first_order = TRUE; SELECT SUM(amount) FROM orders; You can get all three in one. This pattern works across Oracle, SQL Server, PostgreSQL, BigQuery...
Great detailed write-up by Mariia explaining how we built topic modelling that turns surprisingly messy support chats into structured & applicable actionable insights A fun reminder that "traditional" ML (e.g. >4 years old) is still very useful https://t.co/vo9KfPIg6q https://t.co/KFMGcHYHxN
Commvault announced an expansion of its data security posture management (DSPM) to include structured data and AI‑driven vector databases, leveraging its recent acquisition of Satori. The new real‑time data access governance lets security teams monitor and control structured data usage,...
The article lists seven common data‑preparation challenges—poor profiling, missing or invalid values, name/address inconsistencies, cross‑system data mismatches, enrichment hurdles, and scaling issues—and offers practical ways to address each. It highlights that data preparation typically consumes the majority of effort in...
PostgreSQL relies on periodic vacuuming to reclaim space from dead tuples created by its MVCC architecture and to prevent transaction ID wraparound. The built‑in autovacuum daemon, enabled by default, triggers when dead rows exceed a threshold of 50 rows plus...
CorridorIQ and Bonaventure announced a strategic partnership that will embed AI-driven migration intelligence across Bonaventure's $2.8 billion multifamily asset base. Co‑founders Zave Greene and Luke Anderson will serve as AI Entrepreneurs in Residence, with the firms expecting tens of millions of...
Data stewards don't need to be engineers. They need to be domain experts who can speak to data quality. #DataGovernance #DataSteward https://t.co/aQ7n0Kcc79
Palantir’s UK executive warned ministers against yielding to “ideologically motivated” campaigners as they consider invoking a break clause in the NHS’s £330 million (≈ $413 million) Federated Data Platform contract. The AI‑enabled platform is projected to generate £150 million (≈ $188 million) in benefits by 2030,...
Microsoft unveiled Database Hub and Fabric IQ at FabCon and SQLCon 2026, extending its Fabric SaaS analytics platform to unify roughly 20 data services under a single management plane. The new Database Hub adds AI‑driven, natural‑language exploration across Azure SQL, Cosmos DB, PostgreSQL and...
The Open Data Institute’s four‑month NDL‑Lite prototype scanned more than 100,000 public datasets from six UK sources, exposing pervasive labeling gaps, outdated records, and accessibility hurdles. Notably, a major Home Office crime dataset has not been refreshed since 2018, while...
Google Research released TimesFM 2.5, a decoder‑only time‑series foundation model with 200 million parameters, down from 500 million in version 2.0. The new model supports a 16 k context window, far exceeding the prior 2 048 limit, and adds an optional 30 million‑parameter quantile head for continuous...
Dodge Industrial’s reliance on a 20‑year‑old SAP BW system forced business users to build a shadow data warehouse in Power BI, which ultimately crashed the company’s entire tenant. The outage prompted Data & Analytics Manager Daniel Garrett to partner with Protiviti...
Within3 unveiled Dataverse, a unified real‑world data ecosystem that merges electronic health records, claims, and specialty analytics to sharpen pharmaceutical launch decisions. Avalere Health released a global framework to broaden genomic profiling in cancer care, while Emota’s report highlighted rising...
HYBE America announced Blake Foster as its new Head of Business Intelligence, a role designed to centralize data strategy across U.S. operations. The former Warner Music Group senior vice president will build the company’s analytics infrastructure and turn artist‑generated data...
China’s Ministry of Agriculture and Rural Affairs has accelerated the rollout of AI‑enabled smart farming on more than 3,800 mu of fields in Jiangsu, using drones, IoT sensors and data‑analytics platforms. The initiative has lifted tea leaf quality by nearly 50%...
Hammerspace unveiled a Unified Global Namespace that abstracts storage across on‑prem, AWS, Azure and OCI, letting data appear locally wherever compute runs. Its policy‑driven Objective‑Based Data Orchestration moves only the required blocks, eliminating heavyweight migrations for AI and GPU‑intensive workloads....
Apache Kafka’s pull‑based model excels for event‑driven microservices, but scaling consumer groups creates operational overhead, head‑of‑line blocking, and complex error handling. Large enterprises such as Wix and Uber have addressed these limits by deploying a centralized push‑based consumer proxy, achieving...
Lumen Technologies, a $12.4 billion telecom operator with a 500,000‑mile fiber network, faced fragmented inventory from decades of acquisitions, operating over 17 legacy systems and nearly 500 data sources. It built a unified data layer and AI‑driven digital twin, launching the...
Fastest way to build a business dashboard with AI in 2026: ↓ 1// Take any spreadsheet you already use to track business data. Revenue, leads, whatever you've been tracking manually. 2// Open Claude Code and tell it you want a live dashboard...
Stefaan Verhulst’s paper surveys the surge of data‑governance models—data trusts, commons, cooperatives, intermediaries, unions, sandboxes and data spaces—and argues they are not competing solutions but purpose‑driven responses to distinct coordination challenges. He proposes a typology of seven governance archetypes, each...
Embedding analytics directly into applications is rapidly becoming a strategic priority for software vendors, as 78 % of tech leaders plan to boost BI investments. Developers must decide between building custom visualizations or buying a third‑party platform such as Tableau, Power BI,...
The Mark Anthony Group (MAG) has moved from a traditional data warehouse to Snowflake Intelligence, turning its data platform into a generative business intelligence engine. By mandating Snowflake Secure Data Sharing in vendor RFPs, MAG streamlined real‑time data integration and...
@JeffDean says it best, the problem in this new agentic era is "tools designed for human speed interaction". That's why we think agents love 𝗟𝗮𝗸𝗲𝗯𝗮𝘀𝗲 𝗣𝗼𝘀𝘁𝗴𝗿𝗲𝘀, it can branch, snapshot, scale up and down in a second, orders of magnitude...
dbt Labs unveiled a suite of eight AI agent skills that automate complex dbt tasks, including a migration from dbt Core 1.10 to Fusion that completed without human intervention. These skills distill hundreds of hours of community expertise into concise...
Palantir Technologies posted a surprise earnings beat and announced three marquee contracts—a Department of Defense program‑of‑record designation for its Maven system, a UK regulator pilot, and a software role in the $185 bn Golden Dome missile‑defense initiative—signaling accelerating AI‑driven revenue growth...
Alpha School, a private network with campuses in Austin, Miami, San Francisco and New York, has launched a data‑centric curriculum where students spend two hours a day with AI tutors for $65,000 a year. The company says the model accelerates...
Toyota Motor Europe’s head of enterprise data and analytics, Thierry Martin, detailed how the company built a continent‑wide data mesh on Snowflake, launching over 100 data products in its internal marketplace. He described the broader tech stack—including Calibra, Dataiku, Qlik,...
In this episode, ThoughtSpot CEO Ketan Karkhanis discusses how AI agents are reshaping data analytics, turning self‑service BI from a long‑standing promise into a reality. He showcases ThoughtSpot’s agents—Spotter, Spotter Model, and SpotterWiz—that can answer business questions, automate data engineering...
@FINRA 's MMAT recent BK response/filling (March 27th) states an estimated 2.5 terabyte of trading data for #MMAT / #MMTLP. They called this BURDENSOME. At first glance perhaps this may look like a big, scary dataset... But lets take a closer...
You have any giant, convoluted code or SQL logic to handle data values that might be similar? @JeffONelson did. But he shows off a new stateless semantic search in @googlecloud BigQuery that might be a lifesaver for small datasets. https://t.co/RU5q8SoJb4
The Forrester Wave™: Data Quality Solutions, Q1 2026 reveals a decisive shift toward AI‑driven automation, real‑time observability, and multimodal data handling. Vendors now embed generative and agentic AI to profile, classify, validate, and remediate data at scale, moving beyond traditional rule‑based...
Beijing LLVision Technology and Ping An Insurance are turning sophisticated data pipelines into profit engines, launching AI‑powered translation glasses and early‑disease screening tools that together underpin a $174 billion AI market in China. Their niche‑focused models illustrate how Chinese firms are...
China's Ministry of Agriculture announced a country‑wide rollout of sensor‑rich, cloud‑based farming platforms for the spring season, though financial details were not disclosed. At the same time, Herbalife's $55 million acquisition of Bioniq and a $33 billion US‑Indonesia trade pact underscore how...
RIP BI Dashboards. Tools like Tableau and PowerBI are about to become extinct. This is what's coming (and how to prepare):
Over 97% of companies worldwide have invested in big data, and analytics now yields an average return of $13 for every $1 spent, according to a Nucleus Research survey. The article argues that businesses that appear to win online without...
OSINT Jobs released a tutorial showing how to access GDELT’s comprehensive news archive through Google BigQuery at no cost. The guide walks users through setting up the BigQuery environment, exploring the two core GDELT tables, and running a SQL query...
Spirit Crossing developers published a blog post detailing past monetization tactics and future strategies, highlighting a pivot toward programmatic in‑game advertising and AI‑powered pricing. The shift reflects broader industry moves to blend ad‑tech with traditional purchases to boost revenue and...
Python tip You've been creating extra columns just to group by month. pd.Grouper does it in one step, inside the groupby. Same result. No extra column. It works for any time frequency -- weekly, quarterly, custom intervals -- without touching your data.
Trust In The #Digital Classroom: Why #Data Governance Must Guide #AI In Education by @geoffreyalef1 @Forbes Learn more: https://t.co/BKbfmT1JPq #EduTech #ArtificialIntelligence #DigitalTransformation https://t.co/gLBIx5UmYg
PostgreSQL’s upcoming 19 release introduces a native JSON output option for the COPY TO command, allowing users to stream query results as line‑delimited JSON objects (NDJSON). The feature supports the syntax COPY TO … WITH (FORMAT json) and includes a force_array...
Herbalife Ltd. announced a $55 million acquisition of assets from UK‑based Bioniq, adding a biomarker‑powered supplement engine to its portfolio. The deal, slated to close in Q2 2026, aims to scale personalized nutrition through the company’s global distributor network.
Microsoft’s Africa government affairs director Akua Gyekye says the continent’s AI future hinges on effective data governance rather than just technology adoption. While 76 % of African nations now have data‑protection laws, fragmented policies and restrictive localisation impede cross‑border data flows....
Exponential Interactive’s VDX.tv is gathering extensive personal and behavioural data through cookies that last up to 90 days, including IP addresses, device identifiers and browsing histories. The practice has ignited privacy‑governance concerns among regulators and consumer‑rights groups, highlighting the tension...
Chinese AI companies XtalPi and Blacklake have moved from loss‑making research to sustainable profitability by targeting specialized data‑driven markets. XtalPi reported a 134.6 million‑yuan ($19.5 million) profit in 2025, while Blacklake achieved its first profit in late 2024, underscoring a shift in...
