Know What's Happening in Big Data
Know What's Happening in Big Data
Big Data Pulse
EMAIL DIGESTS
Daily
Every morning
Weekly
Tuesday recap
EMAIL DIGESTS
Daily
Every morning
Weekly
Tuesday recap
Minor Hotels builds global AI and data platform to personalize guest experiences
The hotel chain is creating a new AI‑driven data platform that links guest information across its 640‑plus properties and 12 brands. Powered by Google Cloud, Salesforce and OneTrust, the stack bypasses legacy systems to deliver real‑time, context‑aware personalization.
Also developing:
By the numbers: Dynatrace acquires Bindplane
SVT Robotics unveiled Softbot Intelligence, a platform that captures and contextualizes real‑time execution data from robotics, software, and enterprise systems. By correlating events with millisecond precision, the solution creates a high‑fidelity data backbone that AI can consume for accurate predictions and continuous optimization. The company highlighted the technology’s ability to reveal cross‑system dependencies and performance constraints, positioning it as a foundation for scalable AI in logistics and other industrial settings. SVT will demonstrate the offering at MODEX 2026 in Atlanta.
Python tip You've been filtering DataFrames like this. df[(df['region'] == 'UAE') & (df['revenue'] > 10000)] There's a cleaner way. df.query("region == 'UAE' and revenue > 10000") Same result. No brackets. No repeated df. Reads like a sentence. Where it really pays off is inside a chain. Use...
90% of the world's data was generated in just the past two years. Discoverability is critical. A data catalog is Google Search for your internal metadata. https://www.ssp.sh/brain/data-catalog
A lone data engineer at a mid‑size manufacturing firm built a data catalogue from scratch, turning ad‑hoc notes into a structured metadata repository. The organization lacked documentation, ownership, and a data strategy, causing slow, risky deliveries and hidden changes. By...
Fivetran’s 2026 Enterprise Data Infrastructure Benchmark, based on a survey of 500 senior data leaders at firms with over 5,000 employees, reveals that fragile data pipelines are costing large enterprises an average of $3 million each month. While organizations spend roughly...
Infometry has released a native macOS version of its INFOFISCUS Conversa platform, letting executives ask plain‑English questions and receive AI‑generated insights without writing SQL or consulting dashboards. The app translates natural language into optimized queries for cloud warehouses such as...
Dune Analytics unveiled a fully integrated dbt connector that streams transformed blockchain data directly into Snowflake or BigQuery, eliminating the need for separate ETL pipelines. The platform now covers more than 130 blockchains through its Datashare library, offering ready‑made tables...
Enterprises are moving beyond static dashboards to Agentic Analytics, an AI‑driven approach that monitors, interprets, and acts on real‑time data without human prompts. By embedding autonomous agents into finance, supply‑chain, and sales workflows, companies can flag risks, predict outcomes, and...
NHS employees have raised concerns after at least six Palantir engineers were granted NHS.net email accounts, giving them access to a directory of up to 1.5 million staff. The issue spotlights data‑security, privacy and ethical questions surrounding the £330 million Federated Data...
Minor Hotels announced a new global data and AI platform built with Google Cloud, Salesforce, OneTrust and Deloitte. The platform will unify guest data across its 63‑country footprint, enabling real‑time personalization and AI‑driven service. Designed from scratch, it leverages generative...
New Jersey’s Integrated Population Health Data (iPHD) project, created by statute in 2016, now links more than 90 million person‑level health and administrative records. The initiative, funded by the state Department of Health, breaks down data silos across agencies to support...
Minor Hotels is constructing a brand‑new global AI and data platform to connect guest information across its portfolio of more than 640 hotels and 12 brands. By building the stack from the ground up, the company sidesteps the legacy‑system bottlenecks...
Cloudera unveiled a suite of enhancements to its hybrid data and AI platform, extending support through 2032 and promising a unified experience across cloud and on‑premises environments. The upgrades focus on operational stability, simultaneous updates for hybrid estates, and new...
Enterprises are hitting a wall on AI not because models are flawed but because their data infrastructure remains fragmented and reconciled after the fact. Syncari argues that a continuously mastered, real‑time control plane—what it calls Agentic MDM—provides the trusted data...
SAS has partnered with North Carolina State University and East Carolina University to launch a pilot IoT sensor network in Hyde County, delivering real‑time flood, soil‑moisture and salinity data to farmers. The project leverages SAS® Analytics for IoT and the...
Meta eliminated the employee‑created "Claudeonomics" leaderboard that tracked AI token usage across its 85,000‑strong workforce. The tool had recorded more than 60 trillion tokens in a 30‑day span, prompting concerns over data privacy, cost control and internal governance.
China's smart breeding sector is accelerating with AI‑powered big‑data platforms that cut the traditional 8‑10‑year breeding cycle to 3‑4 years. New tools from the Nanfan platform, a Huawei‑backed intelligence hub, and the GEAIR robot promise faster, cheaper hybrid development for...
UNION VS UNION ALL in SQL UNION deduplicates every row after combining the results. That means sorting, comparing, discarding. On large tables that's a real performance cost -- and most of the time, you don't even need it. UNION ALL stacks the...
A new AvePoint‑Omdia survey of 333 MSP executives finds data governance and compliance are the biggest obstacles to AI adoption, with 51% naming it the top barrier. The AI services market is projected to reach $276 billion by 2030, creating a...
In this episode Marco introduces PgLake, an extension that lets PostgreSQL query and manage data lakes stored as Iceberg tables in object storage. By delegating analytical queries to DuckDB’s vectorized engine, PgLake can achieve up to 100× faster performance than...
Data leaders across industries are turning to generative AI and automation to tame complex data‑integration projects. Thomson Reuters is piloting an internal AI tool for M&A due diligence, while Create Music Group runs more than 600 pipelines with Astronomer’s Astro...
Liberty IT’s principal software engineer Sarah Whelan leads data pipeline enablement and experimentation, delivering reliable datasets for product and analytics teams. Her day blends technical design—creating reusable patterns, observability tools, and testing frameworks—with cross‑functional collaboration and mentorship. Whelan also co‑chairs...
A new Thales report, based on a survey of 210 IT and security leaders, finds that more than half of enterprises lack full visibility into their unstructured data estates, and 68% say most of that data remains unprotected. Only 9%...
Researchers using daily satellite imagery report a 16% net increase in global nighttime illumination between 2014 and 2022, driven by rapid urbanization in Africa and Asia. The study also uncovers sharp regional dimming linked to conflict, power outages and deliberate...
Honeywell announced a partnership with Dangote Petroleum Refinery to install its Performance+ Services, digital twins and operator‑training simulators across core units. The deal targets a capacity jump from 650,000 to 1.4 million barrels per day by 2029, while upskilling more than...
A new analysis by UC Berkeley’s Deportation Data Project shows ICE arrests of immigrants lacking criminal convictions surged 770% in the first year of President Donald Trump’s second term. The study, based on FOIA‑obtained ICE records, also documents a five‑fold...
A single database eventually hits CPU, memory, and I/O limits, causing latency and availability risks. Replication creates multiple copies of the same dataset, improving read scalability and fault tolerance through synchronous or asynchronous modes. Sharding splits data across nodes, allowing...
Enterprises are rapidly moving from experimenting with AI agents to scaling agentic AI, with 23% already deploying agents in at least one function. However, many organizations still rely on legacy, fragmented data stacks that cannot meet the low‑latency, high‑throughput demands...
Accenture has bought Spanish cloud‑native AI and data company Keepler Data Tech, bringing more than 240 Keepler professionals into its health‑data analytics practice. The terms were not disclosed, and Accenture’s stock fell 0.83% to $197.30 after the announcement. The deal...
ColorCloud 2026, the Microsoft Business Applications conference, takes place in Hamburg from April 15‑17. The event features a session titled “Power BI Everywhere: Embedding Apps and Automations,” co‑presented by Capgemini’s Power Platform architect Keith Atherton and Sarah Guest. Atherton will also...
Nasuni, a long‑time leader in cloud‑native global file systems, announced two AI‑focused offerings—AI Activate and Active Everywhere—aimed at giving enterprise AI applications secure, permission‑aware access to unstructured data. CEO Sam King framed the move as a natural evolution from the...
Natalie Ryan, vice president of data strategy, insights and analytics at Emerson Group, highlighted the critical role of timely, actionable information for retailers and their CPG partners. She examined current shopper trends, noting how AI is reshaping demand forecasting and...
The ACM announced Matei Zahara as the 2026 recipient of the ACM Prize in Computing, recognizing his pioneering work on distributed data systems that power large‑scale machine learning and AI. The $250,000 award, funded by Infosys, highlights his creation of...
StreamNative, the company behind Apache Pulsar, announced Lakestream, a new architecture that fuses streaming with lakehouse storage, and launched Ursa For Kafka (UFK) in limited public preview. Lakestream collapses the traditional divide by storing Kafka topics as Iceberg or Delta Lake tables,...
There is a gap between knowing SQL and knowing enough SQL to answer the questions a business actually asks. "Show me each customer's rank within their segment." "Give me a running total of revenue by month." "Flag anyone earning above their...
Indianapolis City‑County Councilor Ron Gibson survived 13 shots fired into his front door and a handwritten “No Data Centers” note after he voted to rezone a half‑billion‑dollar Metrobloks data‑center project. The incident has amplified fears that opposition to AI‑driven data‑center...
Probabilistic data structures like Bloom filters and HyperLogLog let engineers handle massive datasets with minimal memory by accepting a controlled error margin. Bloom filters provide fast, space‑efficient membership tests, while HyperLogLog offers near‑accurate distinct‑count estimates. Both replace costly exact structures...
On World Health Day 2026, the Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) launched a new AI platform that fuses brain imaging, genomic and clinical data to predict Alzheimer’s up to 20 years early. The system, part of a...
On April 3 2026 China’s National Data Administration released draft guidelines for data property registration, inviting public comment until April 19. The proposal creates a unified national system where data ownership certificates can be recorded as intangible assets on corporate balance sheets or...
The U.S. Army launched the Army Data Operations Center (ADOC) on April 3 to act as a rapid‑response help desk for battlefield data challenges. A small team of civilian and soldier engineers has already fielded seven deconfliction requests from training units...
Amazon announced S3 Files, a service that mounts any S3 bucket directly into an agent’s local environment using Elastic File System technology. The solution provides true file‑system semantics while keeping S3 as the system of record, eliminating the need for...
Lisente Agricultural Technology Co. is exporting data‑rich greenhouse systems to Uzbekistan, Guinea and Romania, marking the latest push in China's 15th Five‑Year Plan to globalise precision‑farming. The company has completed more than 270 projects across 40 countries, delivering IoT‑enabled, AI‑monitored...
The study examines how metadata design on open‑government data portals influences user behavior across 15 U.S. cities, analyzing 5,863 datasets. Using affordance theory, researchers measured metadata quality and linked it to two usage metrics: dataset views and downloads. Results show...
Enterprises operating in hybrid environments face data silos, inconsistent formats, security gaps and costly manual transfers. The article proposes a hybrid data layer powered by automated ETL pipelines as the strategic bridge between on‑premise legacy systems and cloud applications. By...
Many midsize firms rely on static spreadsheets as data integrity frameworks, but these documents quickly become outdated, leading to poor data quality. A Gartner 2023 survey estimates the average cost of bad data at $12.9 million per year. The article contrasts...
UI‑driven data pipeline tools let early‑stage teams launch pipelines quickly, but the convenience hides configuration state across multiple dashboards and vendor accounts. As organizations scale, hidden operational debt accumulates, leading to schema drift, silent failures, and an inability to diff...
UBS analyst Karl Keirstead said Palantir’s ontology layer, paired with Foundry’s metadata mapping, turns raw enterprise data into actionable insights and creates a hard‑to‑replicate AI moat. He listed Palantir among the eight best U.S. stocks for the next five years....
Enterprise hits and misses - time for an enterprise data health gut check. Plus: are context graphs a trillion dollar enterprise play? https://t.co/cH2SNwF5A2 by @jonerp. #EnSw
Zeta Global, led by CEO David A. Steinberg, has positioned its AI‑first data platform as a core infrastructure for marketers, now serving 51% of the Fortune 100. The company launched Athena, a voice‑enabled AI copilot built with OpenAI, after proving that...
Bigeye announced its membership in Snowflake‑led Open Semantic Interchange (OSI), an open‑source effort to create a vendor‑neutral specification for semantic metadata. OSI seeks to unify fragmented data definitions so metrics stay consistent across dashboards, notebooks, and machine‑learning models. By joining,...
