Know What's Happening in Big Data
Know What's Happening in Big Data
Big Data Pulse
EMAIL DIGESTS
Daily
Every morning
Weekly
Tuesday recap
EMAIL DIGESTS
Daily
Every morning
Weekly
Tuesday recap
Minor Hotels builds global AI and data platform to personalize guest experiences
The hotel chain is creating a new AI‑driven data platform that links guest information across its 640‑plus properties and 12 brands. Powered by Google Cloud, Salesforce and OneTrust, the stack bypasses legacy systems to deliver real‑time, context‑aware personalization.
Also developing:
By the numbers: Dynatrace acquires Bindplane
AI‑native product engineering firm Wishtree Technologies announced it is now an official partner of Databricks, the leading data and AI platform. The collaboration enables Wishtree to deliver unified data pipelines, industry‑specific Unity Catalog models, and production‑grade AI solutions built on Databricks’ Data Intelligence Platform, Delta Lake, and Mosaic AI. By providing engineering, governance, and real‑time ingestion expertise, Wishtree aims to help enterprises in fintech, healthtech, adtech, supply‑chain and HVACR move AI projects from pilot to production. The partnership strengthens Wishtree’s service portfolio and expands Databricks’ ecosystem for complex, regulated workloads.
Rick Koleta’s GTM Vault episode shows how Skyp’s enrichment pipeline combines Claude Code’s plan mode with the Apollo API to deliver high‑quality leads at roughly fifty cents each. The build demonstrates that while MCP connectors (Gmail, Stripe, Grain, Slack) provide...
The Open Group OSDU Forum is set to launch OSDU Data Platform Standard Version 1.0, a stable subset of the platform’s capabilities that defines consistent API behavior. The standard provides detailed guidelines for services such as secure access, search, and file...
I’ve never worked with a clean dataset. Every real project = messy data. And it always comes down to 4 things: • Missing values • Duplicates • Data types & formatting • Outliers Cleaning isn’t a “prep step”. It is the analysis.
The essay argues that data governance is the foundation of AI governance, as AI systems depend on high‑quality input data. It outlines ten transformative shifts, including redefined data definitions, expanded ownership, real‑time pipelines, and new ethical risk assessments. These changes...
Decades of investment in statistical systems have yielded abundant official data, yet users still struggle to discover, interpret, and apply it. The IMF’s new StatGPT report argues that the core issue is not data availability but (re)usability, highlighting fragmented portals,...
Boomi warns that fragmented, poorly‑labelled data is the biggest obstacle to enterprise AI in 2026. The company tracks 75,000 AI agents in production across more than 30,000 customers, including over a quarter of the Fortune 500. Its March 9 platform update...
Companies often build data silos that block AI collaboration, forcing teams to work in isolation. Insight Enterprises helped a large multinational set up an AI Center of Excellence, unlocking shared data assets and enabling data scientists to solve previously intractable...
Researchers at UCSF used large language models to generate code that predicted gestational age and preterm‑birth risk from massive biomedical datasets, matching or surpassing expert‑written analyses. The finding highlights how AI can democratize big‑data analytics in health research.
Full open-source stack for running at low cost for mid-scale companies. Such as Dagster + DuckDB + dbt + Airbyte. https://www.ssp.sh/brain/open-data-stack
The Smart Water Networks Forum, in partnership with the Water Research Foundation, has released a Smart Metering Playbook that consolidates insights from over 50 utilities across 22 countries. The guide maps the maturity curve from pilot projects to full‑scale Advanced...
V2 AI has achieved Databricks Silver partner status, confirming its baseline performance, revenue generation, and certified expertise in the data‑and‑AI space. CEO Craig Howe said the designation validates the firm’s work building scalable, high‑performance data platforms that turn data into...
Google’s Indian arm, Raiden Infotech India Ltd., began construction on a $15 billion, 1‑gigawatt data‑center complex near Visakhapatnam on April 28. The three‑site hub, built with Adani Infra, is the biggest single foreign direct investment in India and will expand Google’s global...
SAP Business Data Cloud (BDC) is a fully managed SaaS that unifies data management, governance, and analytics across SAP and non‑SAP systems, tackling the fragmentation that still plagues most ERP environments. A recent SAPinsider benchmark shows only 3% of organizations...
SAP and the Open Data Institute (ODI) have launched a global program to create AI‑ready data foundations for enterprises. The initiative underpins IDEA (Interchange for Data and Enterprise AI), a neutral framework that defines governance, semantics, and lineage across heterogeneous...
AI coding agents now generate SQL that looks correct but often ignores execution plans, locking behavior, and data distribution, leading to costly production incidents. Radim Marek argues that the missing piece is real‑time awareness of the production schema, including table...
Researchers at Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) launched MAGNET-AD, an AI platform that predicts Alzheimer’s disease up to two decades before clinical onset. The system leverages massive multimodal health datasets and a spatiotemporal graph neural network, delivering...
Scientists from St. Jude Children’s Research Hospital, the American Society for Hematology and the Munich Leukemia Laboratory launched the ASH HematOmics (ASHOP) platform, uniting genomics, transcriptomics and clinical data from 5,960 blood‑cancer patients. The open resource combines whole‑genome and whole‑transcriptome...
Dremio announced full native support for Apache Iceberg V3 in Dremio Cloud, adding capabilities such as the VARIANT data type, deletion vectors, and advanced schema‑evolution controls. The company also highlighted JB Onofre’s election to the Apache Software Foundation board and...
CRN’s 2026 AI 100 spotlights 15 data‑management firms powering the surge of AI agents and generative models. Databricks announced a $1.4 billion annual revenue run rate for its AI suite, while Alteryx, ThoughtSpot, and others unveiled new agentic platforms that embed industry‑specific...
SageX AI has launched an unstructured data platform tailored for hedge funds and asset managers, promising to turn the 90% of unstructured data into AI‑ready, structured intelligence. The no‑code solution claims to cut data processing costs by up to 90%...
Lisente Agricultural Technology shipped steel frames for data‑enabled greenhouses to Uzbekistan, marking its 270th project across more than 40 nations. The push leverages AI‑driven irrigation, temperature control and real‑time monitoring, signaling a new wave of Chinese big‑data agriculture abroad.
Meta built a pre‑compute engine of 50+ specialized AI agents that scanned its 4,100‑plus file, three‑repo data pipeline and produced 59 concise context files capturing tribal knowledge. This "compass" layer lifted AI coverage from roughly 5% to 100% of the...
Denodo, a leading data‑management vendor, has joined the Open Semantic Interchange (OSI), an open‑source effort spearheaded by Snowflake to create a vendor‑neutral semantic metadata specification. OSI aims to standardize fragmented data definitions across industries, enabling seamless exchange of business metrics....
Fragmented datasets still slow many decisions inside organizations. Knowledge graphs connect entities across systems and expose hidden relationships, so leaders can interpret signals with greater clarity and translate data structure into operational choices. Microblog @antgrasso https://t.co/O2qh7Pgcu8
The post outlines a production‑grade anomaly detection system for streaming log data, combining Z‑score and IQR statistical filters, time‑series baseline analysis, multi‑dimensional clustering, and adaptive thresholds. It emphasizes sub‑second latency and horizontal scalability, referencing Netflix’s 800‑service monitoring, Uber’s 100,000‑event‑per‑second fraud...
The Department of Health and Human Services has undone a 2024 restructuring, moving the Chief Technology Officer, Chief Artificial Intelligence Officer and Chief Data Officer back under the Office of the Chief Information Officer. The change centralizes cybersecurity, data and...
Meta has indefinitely paused its partnership with Mercur, the $10 billion AI‑training startup, after a supply‑chain attack leaked parts of its model‑pipeline data. The breach, linked to the open‑source LiteLLM library, forces the tech giant to reassess AI data‑supply‑chain security.
In this episode, CTO Jamie Hutton of Quantexa explains how decision intelligence extends beyond traditional business intelligence by using graph‑based context and entity resolution to create a single, trustworthy view of people, companies, and relationships. He details how Quantexa’s platform...
Analysts need timely production data, but traditional approaches—direct primary queries, streaming replicas, or nightly ETL snapshots—introduce performance risk, replication lag, or stale information. The article proposes using PostgreSQL’s write‑ahead log (WAL) shipping as a data distribution layer, decoupling log transport...
IBM has implemented an AI‑ready data lakehouse built on its watsonx platform for Tata Play Fiber, India’s leading fiber broadband provider. The solution merges 25 separate data sources into a unified, scalable environment, enabling real‑time analytics and advanced AI workloads. By consolidating...
Walmart Data Ventures has introduced the Scintilla Digital Landscapes solution in Canada, expanding its Scintilla platform beyond Channel Performance and Shopper Behaviour modules. Powered by first‑party data from Walmart.ca and its mobile app, the new tool maps shoppers’ online paths...
Jacob Siegel’s new excerpt from *The Information State* details how U.S. disinformation legislation birthed an inter‑agency information‑war apparatus that now mirrors corporate surveillance tools. The analysis warns CIOs that the same infrastructure can be repurposed for enterprise data control, forcing...
LatentView Analytics announced it has earned Gold Partner status in the Databricks Partner Program, underscoring its ability to deliver large‑scale AI and data pipelines. The milestone comes with more than 400 Databricks‑certified staff and new industry‑specific accelerators, positioning the firm...
Collibra unveiled its Spring ’26 release, introducing automation‑centric data‑governance features, a semantic‑modeling agent and a revamped interface for high‑volume use cases. The upgrade aims to reduce manual effort and accelerate AI model oversight for enterprise customers.
Databricks announced it will acquire Tecton, a leading real‑time enterprise feature‑store provider, to enhance its data‑engine platform for AI‑driven applications. The deal, disclosed on Aug. 27, 2025, targets faster, personalized AI agents in use cases such as fraud detection, risk scoring...
NetApp introduced AI Data Engine (AIDE), an AI‑optimized data platform built on NVIDIA technology. The system automates metadata catalog creation, enriches content semantically, and will roll out to a limited customer group this month, with broader availability slated for summer.
The article argues that analytics engineering must “move up the stack” again, this time leveraging AI agents to automate routine data work. It highlights dbt’s meteoric growth—over three million daily downloads and a billion total downloads—showing how the tool already reshaped...
Hybrid working has become the default model for UK financial services, but it is fragmenting data governance and exposing firms to hidden compliance risks. The spread of personal devices, unsecured networks, and shadow‑IT tools makes it difficult to maintain audit...
Microsoft said it will spend $10 billion to construct AI‑optimized data centre facilities in Japan, a move aimed at boosting the country’s cloud and big‑data capabilities for enterprise AI workloads.
Kilian Kagle, the Justice Department’s chief FOIA and privacy officer, resigned days after the agency disclosed a plan to transfer sensitive state voter‑registration data to the Department of Homeland Security. The move, part of a broader push for a national...
Apple’s Watch platform is being hailed as a new standard for consumer‑grade big‑data analytics, leveraging FDA‑cleared atrial‑fibrillation detection and a growing suite of health metrics. Senior director Deidre Caldbeck says the goal is inclusive, actionable data for every iPhone user,...
Artemis 2 isn't just about space exploration; it's a critical lesson in the #ExecutiveCostOfBadData. Just like astronauts need a shared language for lunar data, enterprises need high-fidelity data & unified taxonomies to avoid #AIHallucinations. Crucial insights for leaders deploying AI!...
Cybersecurity firm Check Point discovered a DNS‑tunneling vulnerability in OpenAI's ChatGPT that can exfiltrate user data without alerts. The flaw, found in the model’s runtime environment, comes as OpenAI serves over 800 million weekly users and handles 18 billion messages, underscoring the...
30 years later, Kimball's facts and dimensions and conformed dimensions transcend tooling. Dimensional modeling emphasizes identifying key business processes first, then progressively adding more. https://www.ssp.sh/brain/dimensional-modeling
Why Enterprise #Data Strategies Must Balance #Analytics And Reporting by Govinda Rao Banothu @Forbes Learn more: https://t.co/hUJAggO72h #DataScience #BigData https://t.co/P8RUw08Wr8
Engine and Nuqleous announced a merger that consolidates their retail analytics capabilities under the Engine brand. Private‑equity firm Rubicon Technology Partners stays on as the majority investor, positioning the new entity to scale faster in the CPG data market.
Elon Musk told a crowd in March that SpaceX, now merged with xAI, will deploy data centers in Earth orbit to run AI workloads, saying space‑based power could soon be cheaper than terrestrial solutions. The proposal has drawn both enthusiasm...
China's DeepSeek announced its V4 model will run on Huawei's latest chips, prompting Alibaba, ByteDance and Tencent to place bulk orders for hundreds of thousands of units. At the same time, OpenAI reassigned COO Brad Lightcap to head special projects...
Data mesh or mesh of humans? Done well, data mesh IS a network of humans. #DataMesh #DataGovernance https://t.co/18gW4z1eAd
