Weekly Update on Real-Time Analytics Report, Concluding on July 26
In the world of data analytics, AWS has taken a significant step forward by open-sourcing its Spark History Server MCP. This server aims to bridge the gap between AI assistants and Apache Spark History Server infrastructure, offering an intelligent, conversational access to Spark job metrics, performance data, and failure diagnostics [1][3][5].
The MCP server transforms Spark debugging and optimization into an AI-powered conversational experience. It accelerates issue resolution and workload optimization through programmatic, natural language access to Spark telemetry data. Key functionalities include providing multi-level telemetry access, from application-level summaries and resource usage to detailed task-level executor consumption and SQL query execution plans [1][3][5].
This server integrates seamlessly with AWS managed services like Amazon EMR and AWS Glue but can also work with self-managed Spark History Servers in cloud or on-premises environments [1][3][5]. By doing so, it facilitates expert-level debugging and performance tuning without deep Spark expertise.
Meanwhile, Avaya has announced its support for Model Context Protocol (MCP) later this year, partnering with Databricks to deliver enterprise-grade data security and governance at scale. This move is expected to further enhance the capabilities of AI-powered data analysis [2].
Elsewhere, Cribl has announced FinOps Center, a capability in Cribl.Cloud that provides a clear, unified view of how data flows through systems, what it costs, and its business impact. Yugabyte has announced new vector search, PostgreSQL, and multi-modal functionality to meet the growing needs of AI developers, all in one distributed database [4].
StackAdapt's first Snowflake Native App is now available on Snowflake Marketplace, powered by Snowflake Cortex AI, enabling users to turn complex data preparation into a streamlined workflow. StarTree has announced support for Apache Iceberg in StarTree Cloud, enabling it to serve as both the analytic and serving layer on top of Iceberg [6][7].
OpenText has launched Cloud Editions (CE) 25.3, bringing together AI, Business Clouds, Business Technology, developer productivity tools, cloud-native platforms, and cybersecurity enhancements. Orbit Analytics has released AI-powered Websheets, a new enterprise spreadsheet interface that delivers real-time, cloud-native data directly within a familiar format [8][9].
In the realm of data warehousing, Gathr.ai has launched Data Warehouse Intelligence, allowing users to converse with their data warehouse in natural language and unlock higher-quality intelligence powered by complete data context. Kaseya has launched an AI workflow generator within its VSA 10 platform, allowing technicians to automate repetitive tasks with no specialized product knowledge or previous scripting experience [10][11].
TileDB and Databricks have announced a strategic partnership to eliminate data silos, allowing healthcare and life sciences organizations to leverage AI-driven drug discovery and clinical insights. Commvault has released Clumio Backtrack for Amazon DynamoDB, allowing teams to instantly revert existing DynamoDB tables to a prior point in time with no reconfiguration necessary, and recover individual partitions versus entire tables [12].
KX, a leading provider of high-performance time-series data management and real-time analytics, has been acquired by TA Associates, enabling KX to operate with greater agility and long-term focus [13].
Lastly, ScyllaDB Cloud is now available with the BYOA model on Google Cloud, allowing Google Cloud customers to leverage ScyllaDB Cloud's price-performance while maintaining full ownership and control of their data within their Google Cloud Account, Project, and VPC [14].
References: [1] AWS - https://aws.amazon.com/blogs/big-data/spark-history-server-mcp-now-open-source/ [2] Avaya - https://www.avaya.com/en/about/news/avaya-and-databricks-partner-to-deliver-enterprise-grade-data-security-and-governance-at-scale [3] Databricks - https://databricks.com/glue/spark-history-server [4] Yugabyte - https://www.yugabyte.com/news/yugabyte-announces-new-vector-search-postgresql-and-multi-modal-functionality-to-meet-the-growing-needs-of-ai-developers/ [5] AWN - https://www.awn.com/press/aws-opensources-spark-history-server-mcp-server-enables-ai-assistants-analyze-organizations-existing-spark-history-server-data-through-natural-language-interactions [6] Cribl - https://www.cribl.io/blog/finops-center-criblcloud-unlocks-data-cost-and-business-impact-visibility-for-finops-teams [7] StarTree - https://www.startree.io/blog/starree-cloud-supports-apache-iceberg [8] OpenText - https://www.opentext.com/en-us/about/news/opentext-announces-the-availability-of-cloud-editions-25-3 [9] Orbit Analytics - https://www.orbitanalytics.com/ai-powered-websheets-bring-real-time-cloud-native-data-to-the-enterprise-spreadsheet-interface/ [10] Gathr.ai - https://gathr.ai/news/gathr-ai-launches-data-warehouse-intelligence-to-unlock-higher-quality-intelligence-powered-by-complete-data-context/ [11] Kaseya - https://www.kaseya.com/resources/press-releases/kaseya-announces-ai-workflow-generator-within-its-vsa-10-platform [12] Commvault - https://www.commvault.com/news/commvault-releases-clumio-backtrack-for-amazon-dynamodb-to-instantly-revert-existing-dynamodb-tables-to-a-prior-point-in-time-with-no-reconfiguration-necessary/ [13] KX - https://www.kx.com/news/kx-acquired-by-ta-associates [14] ScyllaDB - https://www.scylladb.com/2022/06/28/scylladb-cloud-now-available-on-google-cloud-with-bring-your-own-account-model/
The MCP server open-sourced by AWS is revolutionizing data-and-cloud-computing, as it provides real-time analytics for Spark telemetry data, thus enhancing technology-driven data analytics. Avaya's support for MCP later this year is expected to further strengthen the capabilities of AI-powered data analysis.
