Know What's Happening in Big Data
Know What's Happening in Big Data
Immuta launches Agentic Data Access module for AI agents
Immuta unveiled an Agentic Data Access module that lets autonomous AI agents retrieve enterprise data in real time while enforcing governance policies. The module treats agents as first‑class data users, applying least‑access and zero standing privileges and providing audit trails, all built on Immuta’s policy engine.
Smart TVs can monitor content played on HDMI‑connected devices using two methods: HDMI‑CEC metadata and Automatic Content Recognition (ACR). ACR takes pixel‑level snapshots to fingerprint shows, movies, or games, while CEC logs device IDs and usage duration. The article outlines how these mechanisms feed data back to manufacturers for personalized ads and recommendations. It also provides step‑by‑step instructions for disabling ACR, turning off CEC, and employing hardware blockers or VPNs to safeguard privacy.
Spark is evolving from low‑level RDD and notebook‑driven workflows to declarative pipelines, branded as Lakeflow on Databricks. The new framework lets engineers define flows, datasets, and pipelines in a configuration‑first manner, while Spark handles execution for both batch and streaming....
Robin Moffatt discusses how data engineering has shifted from traditional batch processing to real‑time streaming in a recent podcast interview. He outlines the technical drivers—cloud scalability, event‑driven architectures, and low‑latency analytics—that enable continuous data pipelines. Moffatt also highlights emerging tools...
Mayo Clinic Platform’s Orchestrate tool has added new capabilities that deliver standardized, research‑ready cancer data. The upgrade leverages the OMOP Oncology common data model to transform unstructured inputs such as pathology reports and imaging into consistent tumor characteristics, biomarkers, and...
The 2026 Data Pipeline Design Playbook positions pipeline architecture as the decisive factor separating data‑driven firms from laggards. It outlines seven modern frameworks—including the kappa shift, ELT over ETL, medallion data lakes, microservice pipelines, and lambda balancing—to achieve real‑time consistency,...
In this episode, Rohan Bhasin of Fortellix and Dan Gural of Voxel51 discuss how autonomous‑vehicle (AV) teams can transform massive drive‑log datasets into high‑fidelity simulations using neural reconstruction, scenario‑driven data curation, and NVIDIA‑accelerated pipelines. They explain how these tools enable...
Data engineering in 2026 is shifting from batch warehouses to real‑time, cloud‑native ecosystems that feed AI and generative models. Leaders like Informatica, lakeFS and Aerospike stress that active data, automated governance, and AI‑driven predictive scaling are essential to avoid bottlenecks....
The article walks through solving a Tesla interview question in Python, calculating each car maker’s net product launch change between 2019 and 2020 using pandas. It then refactors the script into a reusable function and adds a unit‑test suite to...
XGBoost Tips from 5x Kaggle Grandmaster Chris Deotte Top 5 ways to improve your ML models:
In this re‑aired episode, John interviews Ben Rogojan, owner of Seattle Data Guy, about how data teams can demonstrate value amid tighter budgets and rapid AI advances. They discuss shifting from output‑focused metrics like dashboards to outcome‑driven results, the importance...
The data‑center sector is racing to deliver gigawatt‑scale campuses amid soaring AI demand, tight labor markets, and long equipment lead times. Traditional on‑site construction cannot keep pace, prompting a shift toward factory‑first modular building. By standardizing designs and producing electrical,...
When thinking through the future of software, it’s helpful to think through what will we produce more of vs. less of in the future due to agents. And what systems are tied to that production or consumption. Whether it’s a new...
China’s leading semiconductor manufacturer SMIC warned that a rush to purchase AI chips is prompting companies to build a decade’s worth of data‑center capacity in just one or two years. CEO Zhao Haijun said the rapid build‑out is outpacing clear...
The fact that iceberg has introduced a scan planning api is a tacit admission that ducklake is right and the metadata should just live in the catalog. https://t.co/PgsOWxx1v0
The European Securities and Markets Authority (ESMA) has launched a new Digital Strategy for 2026‑2028 and refreshed its Data Strategy covering 2023‑2028. Both roadmaps aim to accelerate digital transformation, simplify supervisory reporting and harness data‑driven insights across the European System...
Teradata reported fourth‑quarter earnings of $0.74 per share, well above the $0.54 consensus, and revenue of $421 million, a 3% year‑over‑year increase. Recurring revenue now represents 87% of total sales, while public‑cloud annual recurring revenue jumped 15% to $701 million. The company...
Ant Group, the Jack Ma‑backed fintech giant, is shifting its growth engine from digital payments to artificial‑intelligence‑powered health care. After a stalled IPO five years ago, the company has become one of China’s largest investors in medical AI, funding platforms...
The MarkTechPost tutorial showcases how Einops can express complex tensor transformations for deep‑learning pipelines with concise, readable syntax. It walks through real‑world patterns such as vision patchification, multi‑head attention, and multimodal token packing, demonstrating each operation using rearrange, reduce, repeat,...
Researchers applied an AI model to LinkedIn photos of over 96,000 MBA graduates, extracting Big Five personality traits and showing they predict program rank, initial compensation, salary trajectory, and job transitions. The algorithm builds on a 2020 study that has...
Test Data Management (TDM) tools are becoming essential for QA and DevOps teams as CI/CD pipelines demand rapid, compliant data provisioning. In 2026, vendors such as K2view, Delphix, Datprof, IBM Optim, Informatica, and Broadcom lead the market, each emphasizing self‑service,...
Wesco International closed 2025 with record $23.5 billion in sales, an 8% increase year‑over‑year, and a 10% jump in Q4 revenue. The distributor invested more than $35 million in a unified data lake and AI‑driven tools to replace legacy systems across its...
Palantir CEO Alex Karp released a nearly hour‑long prerecorded video to address employee concerns about the company's work with Immigration and Customs Enforcement (ICE). The discussion avoided detailed product disclosures, instead offering staff the option to sign nondisclosure agreements for...
The National Institute of Standards and Technology (NIST) has awarded $3.19 million in Phase II SBIR grants to eight small businesses across seven states. The funding supports research in artificial intelligence, biotechnology, semiconductor, quantum and other advanced technologies, with each award ranging...
European cloud provider OVHcloud unveiled its Bare Metal 2026 generation of dedicated servers, featuring AMD Ryzen and EPYC Zen 5 processors across four product lines. The Scale 2026 model scales to 384 cores, 3 TB DDR5 memory and up to 98 TB NVMe storage, while...
Servpac, a Hawaii‑based cloud and colocation provider, broke ground on a $13 million expansion at Mililani Technology Park that will double the IT capacity of its MTP Data Center. The project adds a 5‑acre, 150,000 sq ft site and aims to increase cabinet...
Precisely introduced StreetPro Discover, a dataset that converts complex street attributes into human‑readable text for large language models. The offering replaces cryptic codes with clear, searchable descriptions, enabling plain‑language queries across delivery, risk, and urban‑planning use cases. By delivering "Agentic‑Ready"...
The article presents an architecture that replaces manual ticket dispatch with a machine‑learning core and a real‑time workload scheduler. Historical ticket data is vectorized with TF‑IDF and classified via Logistic Regression to predict the best resolver. Availability is verified through...
Datadog has launched a generally‑available Feature Flags service that tightly couples feature management with its observability platform. The new product links each flag to real‑time APM and RUM telemetry, enabling instant visibility into performance and reliability impacts. Automated canary rollouts,...
BNP Paribas’s US credit strategist Meghan Robson projects hyperscalers will issue roughly $250 billion of debt in 2026, driven by a 16% jump in AI‑related capex and a shift toward more asset‑heavy business models. She warns that continued issuance will likely widen...
Researchers have created an octopus‑inspired hydrogel that acts as a programmable canvas, embedding data directly into its polymer structure during 3‑D printing. When the gel is heated or exposed to a solvent with a different polarity, it swells and alters...
Robo.ai Inc. and DaBoss.AI Inc. have signed a definitive joint‑venture agreement to create a distributed embodied‑intelligence data platform headquartered in the UAE. The venture will tackle data scale, acquisition cost and compliance challenges by deploying a dual‑engine methodology that blends...
Alibaba Tongyi Lab unveiled Zvec, an open‑source, in‑process vector database designed for edge and on‑device retrieval‑augmented generation (RAG) workloads. Marketed as the “SQLite of vector databases,” it runs as a library inside the host application, eliminating the need for external...
Arbol and Pollen Systems, backed by Esri and Omniris, have launched a parametric insurance product that fuses AI‑driven risk models with real‑time satellite, drone and field data. The solution leverages Esri’s GIS platform to deliver location‑aware insights throughout the policy...
Mariia Miakisheva highlights that multi‑rail payment data is rarely comparable out‑of‑the‑box, creating a major obstacle for real‑time liquidity visibility. She advocates building a standardized, governance‑first finance data layer that captures, maps, and reconciles every cash movement to the management P&L....
Starcloud announced it will be the first to launch Amazon Web Services Outposts hardware on a satellite scheduled for October 2026. The company also filed an FCC proposal for an ambitious 88,000‑satellite constellation designed to train and run AI models...
Spanish AI software firm Multiverse Computing is negotiating a €500 million financing round. The capital raise would lift its post‑money valuation above €1.5 billion. Sources said the round is slated to close in the first half of 2026 and will introduce new...
Nebius, a Nasdaq‑listed cloud provider spun out of Yandex, filed for an 80‑acre data‑center project called BHM01 in Birmingham, Alabama, targeting 300 MW of capacity. The development will replace the former Regions Lakeshore Operations Center after the company acquired three Oxmoor...
Similarweb introduced AI Studio, an AI‑powered enterprise intelligence platform built on its massive digital data repository. The solution offers conversational chat, automated deep‑research reports, and AI‑generated dashboards, allowing any employee to retrieve market insights instantly without specialized training. Beta testing...
Researchers from Singapore, France, and the United States unveiled a compact terahertz antenna that leverages topological photonics. The silicon‑based chip, patterned with two sizes of triangular holes, creates a conical beam and achieves roughly 75 % spatial coverage—about 30 times better...
Matia announced a $21 million Series A round, led by Red Dot Capital, bringing its total funding above $31 million. The startup offers a unified DataOps platform on AWS that merges ETL, reverse‑ETL, observability and catalog functions into a single interface. It can...
Nebius Group NV, the cloud‑computing spin‑off from Yandex, announced a $275 million acquisition of Tavily, a specialist in AI‑agent search technology. Tavily’s software equips autonomous agents with real‑time data retrieval for tasks such as software development and financial trading. The deal...
Most digital engagement metrics are being polluted by bots, synthetic traffic, and identity spoofing, turning them from reliable signals into attack surfaces. Datavault AI is addressing this by building a verification‑first platform that authenticates human actions at the point of...
AI DATA CENTER STACK — this is a systems build, not a chip cycle 👇 COMPUTE & SERVERS: $NVDA Owns accelerated compute end to end. CUDA locks software, NVLink locks topology. Sells architectures, not chips. Switching costs scale with clusters. $AMD Pressure valve...
Simplyblock has launched Vela, a self‑hostable platform that provides instant, Git‑style branching for PostgreSQL databases without copying data. The solution leverages copy‑on‑write on local NVMe storage and deep Kubernetes integration to deliver high‑performance, low‑latency environments. Vela targets AI workloads that...
Simplyblock unveiled Vela, a platform that delivers instant PostgreSQL branches using copy‑on‑write technology on its high‑performance block storage. The solution eliminates traditional snapshot‑restore cycles, offering developers rapid, cost‑effective cloning without data duplication. Vela is cloud‑agnostic, Kubernetes‑native, and supports NVMe/TCP and...
A former 33‑hectare sugar refinery near Caen is slated for acquisition by Brown Fields, which plans to transform the derelict site into an AI data center. The project, estimated at €15‑€20 million, benefits from an existing 220 kV power line and a...
Your manager asks: "Sales jumped in December — is that a real growth or seasonality?" You pull up a line chart. Sure, it shows the spike. But it doesn't tell you why. And that's what they actually want to know. This is where time...
Data governance is critical but tough. Without executive support, clear roles, and resources, committees stay reactive. Done right, it drives strategic decisions and strengthens both insights and cyber resilience. https://t.co/brZ80xsiyu
Ark Data Centres received conditional approval to build an 18‑meter‑tall, 27,350 sqm data centre on Westwell Roads in Corsham, Wiltshire, after an 18‑month planning saga. The new facility will be the seventh Ark campus at the Spring Park site, joining five existing...
Energy Vault has entered a strategic partnership with Peak Energy to create a dedicated energy‑storage architecture for AI‑focused data centers. The solution merges Peak’s sodium‑ion battery technology with Energy Vault’s Vault OS software and system design. A supply agreement secures 1.5 GWh...
