<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
     xmlns:content="http://purl.org/rss/1.0/modules/content/"
     xmlns:dc="http://purl.org/dc/elements/1.1/"
     xmlns:dcterms="http://purl.org/dc/terms/"
     xmlns:media="http://search.yahoo.com/mrss/"
     xmlns:atom="http://www.w3.org/2005/Atom"
     xmlns:cf="https://www.futureplc.com/rss/content-flags"
>
    <channel>
                    <atom:link rel="alternate" hreflang="en-GB"
                       href="https://www.itpro.com/uk/feeds/tag/data-analytics"
                       type="application/rss+xml"/>
                            <title><![CDATA[ Latest from ITPro UK in Data-analytics ]]></title>
                <link>https://www.itpro.com/uk/data-analytics</link>
        <description><![CDATA[ All the latest data-analytics content from the ITPro  UK team ]]></description>
                                    <lastBuildDate>Thu, 15 Oct 2026 08:00:00 +0000</lastBuildDate>
                            <language>en</language>
                                <item>
                                                            <title><![CDATA[ Qlik achieves AWS Data Competency for relational database expertise ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Data integration and analytics specialist Qlik has achieved the AWS Data Competency in the cloud giant’s relational database category.</p><p>The AWS Competency program aims to help customers identify and grow their business with AWS partners that can offer deep industry experience and expertise across industries, use cases, and workloads.</p><p>The relational database credential now recognizes Qlik’s ability to deliver unified data architectures on the AWS platform and help organizations integrate, govern and activate data across complex environments.</p><p>The vendor said the designation differentiates it as a member of the AWS Partner Network that is capable of providing deep technical proficiency and customer success delivering data solutions on the cloud platform.</p><h2 id="relational-database-expertise">Relational database expertise</h2><p>Qlik’s open, platform-agnostic model is designed to help organizations work flexibly with data, cloud platforms, and technologies without being restricted to a single technology stack. The firm’s wider capabilities include integration, transformation, governance, analytics, and AI.</p><p>Within the relational database category, Qlik provides relational database engines, migration and performance tools, as well as business applications built on Amazon Relational Database Service (RDS) and AWS Aurora.</p><p>Support for AWS-hosted databases spans Oracle, SQL Server, MySQL, PostgreSQL, and MariaDB, alongside SAP HANA, Sysbase ASE, and IBM Db2.</p><h2 id="benefits-for-qlik-customers">Benefits for Qlik customers</h2><p>Qlik said its AWS recognition means customers can connect and work with data across a diverse range of enterprise environments – such as AWS, cloud platforms, on-premises systems, and SaaS applications.</p><p>They can also build on their existing environments while being able to adopt new architectures and technologies, as well as create a stronger foundation for analytics and AI. </p><p>Matt Hayes, general manager of Qlik’s data business unit, said data strategies now require greater flexibility and cannot be built around a single platform or a single destination.</p><p>“Our customers need the freedom to work across the technologies they already depend on while modernizing their data foundations for analytics and AI,” he explained. “Achieving the AWS Data Competency reflects the depth of our data capabilities and our commitment to giving organizations a more open, flexible path from complex data environments to trusted business outcomes.”</p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/technology/big-data/qlik-achieves-aws-data-competency-for-relational-database-expertise</link>
                                                                            <description>
                            <![CDATA[ The recognition highlights the company’s cross-environment data integration, governance, and preparation capabilities on AWS ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">y9StMGMuzoNmhwSYvmbfH5</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/vmyejvj5k5vckYQsyWRomK-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Thu, 15 Oct 2026 08:00:00 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 14:44:08 +0000</updated>
                                                                                                                                            <category><![CDATA[Big Data]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                                                                <author><![CDATA[ itpro@futurenet.com (Daniel Todd) ]]></author>                    <dc:creator><![CDATA[ Daniel Todd ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/SRyC34qeLpNDj3dJtsVDhT-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ null ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/vmyejvj5k5vckYQsyWRomK-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Transparent panels displaying programming code create a visually engaging representation of data flow and digital transformation, symbolizing the power of machine learning and AI]]></media:description>                                                            <media:text><![CDATA[Transparent panels displaying programming code create a visually engaging representation of data flow and digital transformation, symbolizing the power of machine learning and AI]]></media:text>
                                <media:title type="plain"><![CDATA[Transparent panels displaying programming code create a visually engaging representation of data flow and digital transformation, symbolizing the power of machine learning and AI]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/vmyejvj5k5vckYQsyWRomK-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Data integration and analytics specialist Qlik has achieved the AWS Data Competency in the cloud giant’s relational database category.</p><p>The AWS Competency program aims to help customers identify and grow their business with AWS partners that can offer deep industry experience and expertise across industries, use cases, and workloads.</p><p>The relational database credential now recognizes Qlik’s ability to deliver unified data architectures on the AWS platform and help organizations integrate, govern and activate data across complex environments.</p><p>The vendor said the designation differentiates it as a member of the AWS Partner Network that is capable of providing deep technical proficiency and customer success delivering data solutions on the cloud platform.</p><h2 id="relational-database-expertise">Relational database expertise</h2><p>Qlik’s open, platform-agnostic model is designed to help organizations work flexibly with data, cloud platforms, and technologies without being restricted to a single technology stack. The firm’s wider capabilities include integration, transformation, governance, analytics, and AI.</p><p>Within the relational database category, Qlik provides relational database engines, migration and performance tools, as well as business applications built on Amazon Relational Database Service (RDS) and AWS Aurora.</p><p>Support for AWS-hosted databases spans Oracle, SQL Server, MySQL, PostgreSQL, and MariaDB, alongside SAP HANA, Sysbase ASE, and IBM Db2.</p><h2 id="benefits-for-qlik-customers">Benefits for Qlik customers</h2><p>Qlik said its AWS recognition means customers can connect and work with data across a diverse range of enterprise environments – such as AWS, cloud platforms, on-premises systems, and SaaS applications.</p><p>They can also build on their existing environments while being able to adopt new architectures and technologies, as well as create a stronger foundation for analytics and AI. </p><p>Matt Hayes, general manager of Qlik’s data business unit, said data strategies now require greater flexibility and cannot be built around a single platform or a single destination.</p><p>“Our customers need the freedom to work across the technologies they already depend on while modernizing their data foundations for analytics and AI,” he explained. “Achieving the AWS Data Competency reflects the depth of our data capabilities and our commitment to giving organizations a more open, flexible path from complex data environments to trusted business outcomes.”</p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ Google's Spirit Airlines auction & TrendAI insider threat report ]]></title>
                                                                                                <dc:content><![CDATA[ <iframe allow="clipboard-write" height="200px" width="100%" id="" style="width: 100%; height: 200px;" class="position-center" data-lazy-priority="high" data-lazy-src="https://player.captivate.fm/episode/5acca2d1-04a0-490b-b1d3-3a09c19bd511" src="https://player.captivate.fm/episode/5acca2d1-04a0-490b-b1d3-3a09c19bd511"></iframe><p>This week, Bobby Hellard and Scott Bekker talk with ITPro's news &amp; analysis editor, Ross Kelly, to discuss some of the top stories from August. </p><p>That includes Google acquiring a treasure trove of data from a defunct airline in a bid to bolster AI products. The auction to acquire data from Spirit Airlines hit headlines this month as Google outbid another industry player looking to capitalize on a trove of information. </p><p>We also discuss TrendAI's insider threat report, which looked at how cyber criminals are building increasingly sophisticated insider threat networks. </p><h2 id="highlights">Highlights</h2><p>"As a a failed Spirit Airlines customer, I once had a feudal trip where I was trying to get to a Microsoft conference, and I was in line, and they're like, "Yeah, your flight's canceled. We can get you there in four days. I was like, "Yeah, I'm never doing Spirit again. But was there any customer data other than the customer chats in this volume of data?"</p><p>"A big part of the issue here is how do you tackle insider threats? Because it's quite a broad category here in terms of what we're talking about. Insider threats can be just people not doing their job correctly, not following best practices. We've covered stories on that before. Another big thing is that people who are doing this deliberately, research from CFAS last year found that one in eight UK employees have actually sold company logins, or they know someone who has. So, you know that one in eight doesn't sound huge, but I think that's really concerning there."</p><h2 id="links">Links</h2><ul><li><a href="https://www.itpro.com/technology/artificial-intelligence/google-just-spent-usd10-million-in-an-auction-for-spirit-airlines-data-100-million-emails-500-million-microsoft-teams-chats-and-30-million-lines-of-code-will-be-used-to-improve-ai-models-and-products"><u>Google just spent $10 million in an auction for Spirit Airlines data</u></a></li><li><a href="https://www.itpro.com/security/the-easiest-way-into-a-company-isnt-always-through-a-vulnerability-anymore-hackers-are-building-a-global-insider-threat-recruitment-network-and-theyre-even-offering-referral-bonuses"><u>Hackers are building a global insider threat recruitment network</u></a></li></ul> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/technology/big-data/googles-spirit-airlines-auction-and-trendai-insider-threat-report</link>
                                                                            <description>
                            <![CDATA[ Google's Spirit Airlines auction & TrendAI insider threat report ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">Bibw7JrvG3Y8j3s6m8pXhk</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/ufsxEZB9QTYhpL23S2VQYa-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Fri, 28 Aug 2026 15:34:13 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:50:00 +0000</updated>
                                                                                                                                            <category><![CDATA[Google]]></category>
                                                    <category><![CDATA[Big Data]]></category>
                                                    <category><![CDATA[Workplace Technology]]></category>
                                                    <category><![CDATA[Software]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                                                                <author><![CDATA[ itpro@futurenet.com (Bobby Hellard) ]]></author>                    <dc:creator><![CDATA[ Bobby Hellard ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/bsR2tHSyVKUoyXZF5pNsDA-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Bobby Hellard&amp;nbsp;is&amp;nbsp;ITPro&#039;s Reviews Editor and has worked on&amp;nbsp;CloudPro and ChannelPro since 2018. In his time at ITPro, Bobby has covered stories for all the major technology companies, such as Apple, Microsoft, Amazon and Facebook, and regularly attends industry-leading events such as AWS Re:Invent and Google Cloud Next.&lt;/p&gt;
&lt;p&gt;Bobby mainly covers hardware reviews, but you will also recognize him as the face of many of our video reviews of laptops and smartphones.&lt;/p&gt;
&lt;p&gt;He has been a journalist for ten years, originally covering sports, before moving into business technology with ITPro. He has bylines in The Independent, Vice and The Business Briefing. Contact him at &lt;a href=&quot;mailto:bobby.hellard@futurenet.com&quot;&gt;bobby.hellard@futurenet.com&lt;/a&gt; or find him on Twitter: &lt;a href=&quot;https://twitter.com/bobbyhellard&quot;&gt;@bobbyhellard&lt;/a&gt;&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/ufsxEZB9QTYhpL23S2VQYa-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[The latest episode title over a plane window]]></media:description>                                                            <media:text><![CDATA[The latest episode title over a plane window]]></media:text>
                                <media:title type="plain"><![CDATA[The latest episode title over a plane window]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/ufsxEZB9QTYhpL23S2VQYa-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <iframe allow="clipboard-write" height="200px" width="100%" id="" style="width: 100%; height: 200px;" class="position-center" data-lazy-priority="high" data-lazy-src="https://player.captivate.fm/episode/5acca2d1-04a0-490b-b1d3-3a09c19bd511" src="https://player.captivate.fm/episode/5acca2d1-04a0-490b-b1d3-3a09c19bd511"></iframe><p>This week, Bobby Hellard and Scott Bekker talk with ITPro's news &amp; analysis editor, Ross Kelly, to discuss some of the top stories from August. </p><p>That includes Google acquiring a treasure trove of data from a defunct airline in a bid to bolster AI products. The auction to acquire data from Spirit Airlines hit headlines this month as Google outbid another industry player looking to capitalize on a trove of information. </p><p>We also discuss TrendAI's insider threat report, which looked at how cyber criminals are building increasingly sophisticated insider threat networks. </p><h2 id="highlights">Highlights</h2><p>"As a a failed Spirit Airlines customer, I once had a feudal trip where I was trying to get to a Microsoft conference, and I was in line, and they're like, "Yeah, your flight's canceled. We can get you there in four days. I was like, "Yeah, I'm never doing Spirit again. But was there any customer data other than the customer chats in this volume of data?"</p><p>"A big part of the issue here is how do you tackle insider threats? Because it's quite a broad category here in terms of what we're talking about. Insider threats can be just people not doing their job correctly, not following best practices. We've covered stories on that before. Another big thing is that people who are doing this deliberately, research from CFAS last year found that one in eight UK employees have actually sold company logins, or they know someone who has. So, you know that one in eight doesn't sound huge, but I think that's really concerning there."</p><h2 id="links">Links</h2><ul><li><a href="https://www.itpro.com/technology/artificial-intelligence/google-just-spent-usd10-million-in-an-auction-for-spirit-airlines-data-100-million-emails-500-million-microsoft-teams-chats-and-30-million-lines-of-code-will-be-used-to-improve-ai-models-and-products"><u>Google just spent $10 million in an auction for Spirit Airlines data</u></a></li><li><a href="https://www.itpro.com/security/the-easiest-way-into-a-company-isnt-always-through-a-vulnerability-anymore-hackers-are-building-a-global-insider-threat-recruitment-network-and-theyre-even-offering-referral-bonuses"><u>Hackers are building a global insider threat recruitment network</u></a></li></ul>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ How OneLondon is putting data to good use to aid patient services ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Healthcare organizations collect huge amounts of data that can be used to improve operational processes and save patient lives. </p><p>However, exploiting this data is easier said than done. Healthcare professionals face multiple challenges, from stove-piped data to governance hurdles, as they look to turn information into insight.</p><p>It’s in this challenging environment that Dr Joe Zhang, CTO at OneLondon, is aiming to create a new era of interoperability. OneLondon is a specialist healthcare partnership that connects health and care information across the capital to improve patient treatments and plan future medical services – and at the heart of this approach sits the <a href="https://www.itpro.com/technology/artificial-intelligence/snowflake-ceo-many-vendors-sell-you-parts-of-a-car-and-tell-you-to-build-it-yourself-at-snowflake-we-have-a-different-philosophy-we-want-to-give-you-the-car">Snowflake data platform</a>. </p><p>“The data is a lot more complicated in healthcare than [in] other settings; it's highly dimensional, it's multimodal, meaning that you have structured data, free text, but also imaging data, and genomics data,” says Zhang. </p><p>“The value of the data for improving care is enormous, but what you're dealing with on the ground is just a constellation of many siloed systems locked away and managed by different teams.”</p><h2 id="disparate-data">Disparate data </h2><p>Patient data in London is spread across GPs, hospitals, mental health providers, community services, and social care organizations. This data has traditionally been fragmented across disparate systems, making it difficult to create a joined-up view of patient health to predict demand or conduct population health research.</p><p>After an open procurement process that considered other data platforms, OneLondon selected <a href="https://www.itpro.com/technology/artificial-intelligence/enterprises-are-becoming-much-more-rigorous-about-the-economics-of-ai-snowflake-wants-to-help-you-cut-ai-costs-by-choosing-the-right-model-for-the-right-task">Snowflake</a>, with Zhang suggesting the provider’s capabilities meant its technology ticked more boxes than its rivals. Today, Snowflake is helping the organization solve its data interoperability challenges.</p><p>“At a local level, the platform is the layer where we can ingest data that's compliant, secure, and that we can trust,” he says. “It’s also operationally open, which means we can use our own tooling, which is standard things like <a href="https://www.itpro.com/sql/30242/what-is-sql">SQL</a> and <a href="https://www.itpro.com/business-strategy/careers-training/356640/how-to-become-a-python-software-developer">Python</a>, to transform data, ingest it, observe it, standardize it, and turn it into a usable asset for clinicians and analysts on the ground.”</p><p>Zhang, who spoke with <em>ITPro</em> at the recent Snowflake Summit 2026 in San Francisco, says the platform provides a data mesh-like approach, where professionals can share insights securely with others. As a doctor who used to work in the Intensive Care Unit (ICU), Zhang has first-hand experience of the life-changing impact of timely insights. Now, he’s helping professionals in other healthcare organizations to exploit their data.</p><p>“My background is as a doctor, but I've got a technical background in data engineering and data science. I left medicine after COVID. I worked in industry for a while doing biomarker development in real-world data, then came back to London to lead part of the program across London, and then stepped into the <a href="https://www.itpro.com/strategy/28237/cto-job-description-what-does-a-cto-do">CTO </a>role,” he says.</p><p>“This job gives me the best of both worlds. We can make a bigger impact with data, data products, and applications built on data, but it can take a bit longer to see the impact. When I worked in [the] ICU, you’d see the results within 10 minutes or so. This work involves a wider scope and longer timelines, but a potentially bigger impact.”</p><h2 id="a-data-journey-heading-towards-value-recognition">A data journey heading towards value recognition</h2><p>OneLondon’s activity covers about 30 hospitals and more than 1,400 GP practices. Some healthcare organizations are more mature in their data journey than others. While the Snowflake platform provides a core layer for joined-up analytics efforts, the key to long-term success is ensuring that professionals recognize its value.</p><p>“It’s more of an incentivized play rather than saying, ‘This is the pattern we're going for,’” says Zhang. “The organizations that have come on to Snowflake have done so because they think the technology helps with interoperability. A lot of the work has been about unifying opinions across all the organizations in London to make this approach work.”</p><p>The key benefit for professionals is a single patient record. Whether someone spends time in GP services, local hospitals or specialist healthcare centers, Zhang says their pathway is tracked: “If you're a clinician at a point of care, you can start to build applications that say, ‘This patient, based on everything that has happened, is at more risk of renal dysfunction, so we should do something about it.’” </p><p>Work on the platform continues. The major migration process finished in April, with primary care data feeds currently coming online. At least a dozen use cases are in development. While these pioneering projects will produce benefits, Zhang says it’s important to recognize that the core focus so far has been perfecting the underlying technology layer.</p><p>“There are all sorts of infrastructure and networking challenges you must overcome before you think about integration,” he says.</p><p>“But because Snowflake offers an application layer where you can provision resources and scale compute to applications that are deployed, it becomes a highly secure solution for us to deploy all sorts of services.”</p><p>That effort is crucial, as Zhang says ambitious projects in population health or life sciences research won’t be scalable if the right data isn’t available. The long-term aim of this initiative is to create proactive care applications for clinical pathways: “The approach we choose may not work at first, but you iterate, and create a cycle where you constantly learn and improve.”</p><h2 id="future-innovation">Future innovation</h2><p>Another long-term objective, says Zhang, is to use the joined-up view on data to help support the development of new drugs for disease treatments. He says a key reason the UK isn't doing as well as it could in terms of developing new therapies for patients is a lack of data. The Snowflake platform could play a crucial role in supporting progress.</p><p>“We don't know what diseases are there, who is suffering from what disease, and what the trajectories are,” he says. </p><p>“So being able to map that process out, being able to run more clinical trials in this country, and getting new drugs to patients faster, would be a big outcome for me if we can help do that.”</p><p>Reflecting on progress made so far, Zhang says clear long-term objectives and a trusted technology partner are critical to success. As someone well-versed in life-changing decisions in high-pressure environments, he recognizes that digital leaders looking to push data-enabled change must walk before they can run. </p><p>“Often it's not sophisticated things like AI and agents; it's just having the right data in the right place at the right time,” he says. </p><p>“We need to be able to measure outcomes and see what's happening to our patients. Those things sound simple, but they've never really been possible before. So, in that instance, this project is all about trying to prevent preventable things.”</p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/data-and-insights/how-onelondon-is-putting-data-to-good-use-to-aid-patient-services</link>
                                                                            <description>
                            <![CDATA[ The healthcare partnership is working with Snowflake to turn data into intelligence and actionable insights ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">sNon4d4BPqEWBvuFF2jPQ4</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/NbjkLyDmULJ5cfMZFyQPa3-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Wed, 26 Aug 2026 07:00:00 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:17:16 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Platforms]]></category>
                                                    <category><![CDATA[Data and Insights]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Business]]></category>
                                                                                                                    <dc:creator><![CDATA[ Mark Samuels ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/rfAoiWsTvmT4koiuWLLZBi-320-70.jpeg ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Mark Samuels is a freelance writer specializing in business and technology. For the past two decades, he has produced extensive work on subjects such as the adoption of technology by C-suite executives.&lt;/p&gt;&lt;p&gt;At ITPro, Mark has provided long-form content on C-suite strategy, particularly relating to chief information officers (CIOs), as well as digital transformation case studies, and explainers on cloud computing architecture.&lt;/p&gt;&lt;p&gt;Mark has written for publications including The Guardian, ZDNet, TechRepublic, Times Higher Education, and CIONET. He started working as a staff writer at Computing in 2000, where he later became the publication’s features editor. In 2008, he took charge of the brand’s monthly supplement Computing Business alongside his features responsibilities.&lt;/p&gt;&lt;p&gt;From 2008 to 2014, Mark was also editor of the membership magazine for IT leadership forum CIO Connect. As part of the role, Mark oversaw the editorial content for CIO Connect, edited research reports, and maintained an extensive network of industry experts.&lt;/p&gt;&lt;p&gt;Before his career in journalism, Mark achieved a BA in geography and MSc in World Space Economy at the University of Birmingham, as well as a PhD in economic geography at the University of Sheffield.&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/NbjkLyDmULJ5cfMZFyQPa3-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[A medical professional in a white coat holding a blue clipboard while healthcare-related images, including a full torso skeleton and an icon of some lungs, spring from an open laptop.]]></media:description>                                                            <media:text><![CDATA[A medical professional in a white coat holding a blue clipboard while healthcare-related images, including a full torso skeleton and an icon of some lungs, spring from an open laptop.]]></media:text>
                                <media:title type="plain"><![CDATA[A medical professional in a white coat holding a blue clipboard while healthcare-related images, including a full torso skeleton and an icon of some lungs, spring from an open laptop.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/NbjkLyDmULJ5cfMZFyQPa3-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Healthcare organizations collect huge amounts of data that can be used to improve operational processes and save patient lives. </p><p>However, exploiting this data is easier said than done. Healthcare professionals face multiple challenges, from stove-piped data to governance hurdles, as they look to turn information into insight.</p><p>It’s in this challenging environment that Dr Joe Zhang, CTO at OneLondon, is aiming to create a new era of interoperability. OneLondon is a specialist healthcare partnership that connects health and care information across the capital to improve patient treatments and plan future medical services – and at the heart of this approach sits the <a href="https://www.itpro.com/technology/artificial-intelligence/snowflake-ceo-many-vendors-sell-you-parts-of-a-car-and-tell-you-to-build-it-yourself-at-snowflake-we-have-a-different-philosophy-we-want-to-give-you-the-car">Snowflake data platform</a>. </p><p>“The data is a lot more complicated in healthcare than [in] other settings; it's highly dimensional, it's multimodal, meaning that you have structured data, free text, but also imaging data, and genomics data,” says Zhang. </p><p>“The value of the data for improving care is enormous, but what you're dealing with on the ground is just a constellation of many siloed systems locked away and managed by different teams.”</p><h2 id="disparate-data">Disparate data </h2><p>Patient data in London is spread across GPs, hospitals, mental health providers, community services, and social care organizations. This data has traditionally been fragmented across disparate systems, making it difficult to create a joined-up view of patient health to predict demand or conduct population health research.</p><p>After an open procurement process that considered other data platforms, OneLondon selected <a href="https://www.itpro.com/technology/artificial-intelligence/enterprises-are-becoming-much-more-rigorous-about-the-economics-of-ai-snowflake-wants-to-help-you-cut-ai-costs-by-choosing-the-right-model-for-the-right-task">Snowflake</a>, with Zhang suggesting the provider’s capabilities meant its technology ticked more boxes than its rivals. Today, Snowflake is helping the organization solve its data interoperability challenges.</p><p>“At a local level, the platform is the layer where we can ingest data that's compliant, secure, and that we can trust,” he says. “It’s also operationally open, which means we can use our own tooling, which is standard things like <a href="https://www.itpro.com/sql/30242/what-is-sql">SQL</a> and <a href="https://www.itpro.com/business-strategy/careers-training/356640/how-to-become-a-python-software-developer">Python</a>, to transform data, ingest it, observe it, standardize it, and turn it into a usable asset for clinicians and analysts on the ground.”</p><p>Zhang, who spoke with <em>ITPro</em> at the recent Snowflake Summit 2026 in San Francisco, says the platform provides a data mesh-like approach, where professionals can share insights securely with others. As a doctor who used to work in the Intensive Care Unit (ICU), Zhang has first-hand experience of the life-changing impact of timely insights. Now, he’s helping professionals in other healthcare organizations to exploit their data.</p><p>“My background is as a doctor, but I've got a technical background in data engineering and data science. I left medicine after COVID. I worked in industry for a while doing biomarker development in real-world data, then came back to London to lead part of the program across London, and then stepped into the <a href="https://www.itpro.com/strategy/28237/cto-job-description-what-does-a-cto-do">CTO </a>role,” he says.</p><p>“This job gives me the best of both worlds. We can make a bigger impact with data, data products, and applications built on data, but it can take a bit longer to see the impact. When I worked in [the] ICU, you’d see the results within 10 minutes or so. This work involves a wider scope and longer timelines, but a potentially bigger impact.”</p><h2 id="a-data-journey-heading-towards-value-recognition">A data journey heading towards value recognition</h2><p>OneLondon’s activity covers about 30 hospitals and more than 1,400 GP practices. Some healthcare organizations are more mature in their data journey than others. While the Snowflake platform provides a core layer for joined-up analytics efforts, the key to long-term success is ensuring that professionals recognize its value.</p><p>“It’s more of an incentivized play rather than saying, ‘This is the pattern we're going for,’” says Zhang. “The organizations that have come on to Snowflake have done so because they think the technology helps with interoperability. A lot of the work has been about unifying opinions across all the organizations in London to make this approach work.”</p><p>The key benefit for professionals is a single patient record. Whether someone spends time in GP services, local hospitals or specialist healthcare centers, Zhang says their pathway is tracked: “If you're a clinician at a point of care, you can start to build applications that say, ‘This patient, based on everything that has happened, is at more risk of renal dysfunction, so we should do something about it.’” </p><p>Work on the platform continues. The major migration process finished in April, with primary care data feeds currently coming online. At least a dozen use cases are in development. While these pioneering projects will produce benefits, Zhang says it’s important to recognize that the core focus so far has been perfecting the underlying technology layer.</p><p>“There are all sorts of infrastructure and networking challenges you must overcome before you think about integration,” he says.</p><p>“But because Snowflake offers an application layer where you can provision resources and scale compute to applications that are deployed, it becomes a highly secure solution for us to deploy all sorts of services.”</p><p>That effort is crucial, as Zhang says ambitious projects in population health or life sciences research won’t be scalable if the right data isn’t available. The long-term aim of this initiative is to create proactive care applications for clinical pathways: “The approach we choose may not work at first, but you iterate, and create a cycle where you constantly learn and improve.”</p><h2 id="future-innovation">Future innovation</h2><p>Another long-term objective, says Zhang, is to use the joined-up view on data to help support the development of new drugs for disease treatments. He says a key reason the UK isn't doing as well as it could in terms of developing new therapies for patients is a lack of data. The Snowflake platform could play a crucial role in supporting progress.</p><p>“We don't know what diseases are there, who is suffering from what disease, and what the trajectories are,” he says. </p><p>“So being able to map that process out, being able to run more clinical trials in this country, and getting new drugs to patients faster, would be a big outcome for me if we can help do that.”</p><p>Reflecting on progress made so far, Zhang says clear long-term objectives and a trusted technology partner are critical to success. As someone well-versed in life-changing decisions in high-pressure environments, he recognizes that digital leaders looking to push data-enabled change must walk before they can run. </p><p>“Often it's not sophisticated things like AI and agents; it's just having the right data in the right place at the right time,” he says. </p><p>“We need to be able to measure outcomes and see what's happening to our patients. Those things sound simple, but they've never really been possible before. So, in that instance, this project is all about trying to prevent preventable things.”</p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ This one engineering role could be the key to building a truly data-driven enterprise ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Data streaming engineers are in hot demand, according to new research, with 85% of organizations planning to expand data streaming engineering teams in the year ahead. </p><p>A <a href="https://zwly9k6z.r.us-east-1.awstrack.me/L0/https:%2F%2Fwww.confluent.io%2Fresources%2Freport%2Fquick-thinking-2026%2F/1/0100019fa7c35d1b-d1050738-8244-4d97-be5a-22293a5980cd-000000/a1AX2AEs5Q8PsCHq0avXcBhcFsg=473" target="_blank"><u>survey</u></a> of 200 UK CEOs, MDs, and C-level executives by Confluent found that data streaming engineers are now key to turning raw information into tangible insights that power AI. </p><p>Data streaming engineers play a vital role in managing the continuous movement and processing of data, the study noted, and are increasingly helping shape AI strategies. </p><p>“While traditional data engineers focus on storing, cleaning and preparing historical data, data streaming engineers operate in the present tense, ensuring data is continuously available, trusted and actionable the moment it’s created,” said Richard Jones, VP Northern Europe at <a href="https://www.itpro.com/business/acquisition/ibms-confluent-acquisition-will-give-it-a-competitive-edge-and-supercharge-its-ai-credentials">Confluent</a>.</p><p>More than half (56%) the firms strongly agreed that all data-driven organizations should have at least one data streaming engineer. </p><p>Meanwhile, 83% said they could make more informed decisions faster with dedicated data engineers.</p><p>Elsewhere, 88% believe that organizations that hire them will be better placed to adopt, use, and manage AI moving forward. </p><h2 id="demand-grows-for-data-streaming-engineers">Demand grows for data streaming engineers</h2><p>Confluent’s study found that demand for data streaming engineers is expected to grow in the coming years, with 94% of business leaders agreeing that every data-driven organization should employ them.</p><p>85% of respondents said they plan to accelerate hiring on this front moving forward. </p><p>“<a href="https://www.itpro.com/business/data-and-insights/this-new-technique-could-improve-ai-output-accuracy-by-80-percent-and-tackle-hallucinations-once-and-for-all">AI can only work with the data it’s given</a>, and when that data is incomplete or out of date, the consequences can be serious," said Jones. </p><p>"That’s why it’s so encouraging to see businesses investing heavily in data. If leaders want AI to make informed decisions, it needs an accurate, real-time view of what’s really happening across the business. Without that, AI can sound knowledgeable, but it won’t be truly intelligent.”</p><h2 id="data-driven-decision-making">Data-driven decision making</h2><p>Demand on this front comes amidst heightened <a href="https://www.itpro.com/technology/artificial-intelligence/is-enterprise-agentic-ai-adoption-matching-the-hype">enterprise AI adoption</a>, according to Confluent. Yet many organizations still face issues with real-time decision making when using the technology. </p><p>Most leaders (59%) believe that their colleagues’ use of AI has increased the expectation for fast or even instant decisions. Nearly two-thirds (61%) admitted they struggle to capitalize on fast-moving insights or trends, for example. </p><p>More than eight-in-ten often have to choose between making a quick decision and an informed one, and 59% of leaders frequently rely on gut feelings. </p><p>Meanwhile, six-in-ten leaders admit that data is too difficult to access at their level, with 71% revealing that it’s already out of date by the time it reaches them. </p><p>The result here is that enterprise IT leaders are making poorly informed decisions, which has a negative impact on overall productivity and profitability. </p><p>Three-quarters admit they have regretted decisions made too quickly, while 71% regret waiting too long and missing out on opportunities. </p><p>Notably, nine-in-ten respondents said they want to make more data-driven decisions at work, and the same number said they’d feel more confident if they had access to <a href="https://www.itpro.com/business-intelligence/28220/what-is-data-analytics">real-time data insights</a>. </p><p>"The real foundation of confident decision-making isn’t instinct or AI alone, it’s real-time data. Accurate, trustworthy, context-rich insights that can flow across an organization in the moment leaders need them most," said Jones. </p><p>"Real-time data remains the voice that every leader must hear."</p><h3 class="article-body__section" id="section-follow-us-on-social-media"><span>FOLLOW US ON SOCIAL MEDIA</span></h3> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/data-and-insights/real-time-data-remains-the-voice-that-every-leader-must-hear-this-one-engineering-role-could-be-the-key-to-building-a-truly-data-driven-enterprise</link>
                                                                            <description>
                            <![CDATA[ AI has increased the expectation for fast, or even instant, decisions. Data streaming engineers could help leaders keep pace ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">ebgWYhy7uKMbEmHXaGWuqF</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/j86vr7Ts6okTvrLSRdkm5S-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Wed, 05 Aug 2026 09:47:37 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:16:28 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Engineering]]></category>
                                                    <category><![CDATA[Data and Insights]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Business]]></category>
                                                                                                                    <dc:creator><![CDATA[ Emma Woollacott ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/aWfskavxoVSMDy6cDWtYmJ-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ null ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/j86vr7Ts6okTvrLSRdkm5S-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Male and female data streaming engineers pictured in an open plan office space discussing strategy with software applications open on computer screens in background.]]></media:description>                                                            <media:text><![CDATA[Male and female data streaming engineers pictured in an open plan office space discussing strategy with software applications open on computer screens in background.]]></media:text>
                                <media:title type="plain"><![CDATA[Male and female data streaming engineers pictured in an open plan office space discussing strategy with software applications open on computer screens in background.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/j86vr7Ts6okTvrLSRdkm5S-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Data streaming engineers are in hot demand, according to new research, with 85% of organizations planning to expand data streaming engineering teams in the year ahead. </p><p>A <a href="https://zwly9k6z.r.us-east-1.awstrack.me/L0/https:%2F%2Fwww.confluent.io%2Fresources%2Freport%2Fquick-thinking-2026%2F/1/0100019fa7c35d1b-d1050738-8244-4d97-be5a-22293a5980cd-000000/a1AX2AEs5Q8PsCHq0avXcBhcFsg=473" target="_blank"><u>survey</u></a> of 200 UK CEOs, MDs, and C-level executives by Confluent found that data streaming engineers are now key to turning raw information into tangible insights that power AI. </p><p>Data streaming engineers play a vital role in managing the continuous movement and processing of data, the study noted, and are increasingly helping shape AI strategies. </p><p>“While traditional data engineers focus on storing, cleaning and preparing historical data, data streaming engineers operate in the present tense, ensuring data is continuously available, trusted and actionable the moment it’s created,” said Richard Jones, VP Northern Europe at <a href="https://www.itpro.com/business/acquisition/ibms-confluent-acquisition-will-give-it-a-competitive-edge-and-supercharge-its-ai-credentials">Confluent</a>.</p><p>More than half (56%) the firms strongly agreed that all data-driven organizations should have at least one data streaming engineer. </p><p>Meanwhile, 83% said they could make more informed decisions faster with dedicated data engineers.</p><p>Elsewhere, 88% believe that organizations that hire them will be better placed to adopt, use, and manage AI moving forward. </p><h2 id="demand-grows-for-data-streaming-engineers">Demand grows for data streaming engineers</h2><p>Confluent’s study found that demand for data streaming engineers is expected to grow in the coming years, with 94% of business leaders agreeing that every data-driven organization should employ them.</p><p>85% of respondents said they plan to accelerate hiring on this front moving forward. </p><p>“<a href="https://www.itpro.com/business/data-and-insights/this-new-technique-could-improve-ai-output-accuracy-by-80-percent-and-tackle-hallucinations-once-and-for-all">AI can only work with the data it’s given</a>, and when that data is incomplete or out of date, the consequences can be serious," said Jones. </p><p>"That’s why it’s so encouraging to see businesses investing heavily in data. If leaders want AI to make informed decisions, it needs an accurate, real-time view of what’s really happening across the business. Without that, AI can sound knowledgeable, but it won’t be truly intelligent.”</p><h2 id="data-driven-decision-making">Data-driven decision making</h2><p>Demand on this front comes amidst heightened <a href="https://www.itpro.com/technology/artificial-intelligence/is-enterprise-agentic-ai-adoption-matching-the-hype">enterprise AI adoption</a>, according to Confluent. Yet many organizations still face issues with real-time decision making when using the technology. </p><p>Most leaders (59%) believe that their colleagues’ use of AI has increased the expectation for fast or even instant decisions. Nearly two-thirds (61%) admitted they struggle to capitalize on fast-moving insights or trends, for example. </p><p>More than eight-in-ten often have to choose between making a quick decision and an informed one, and 59% of leaders frequently rely on gut feelings. </p><p>Meanwhile, six-in-ten leaders admit that data is too difficult to access at their level, with 71% revealing that it’s already out of date by the time it reaches them. </p><p>The result here is that enterprise IT leaders are making poorly informed decisions, which has a negative impact on overall productivity and profitability. </p><p>Three-quarters admit they have regretted decisions made too quickly, while 71% regret waiting too long and missing out on opportunities. </p><p>Notably, nine-in-ten respondents said they want to make more data-driven decisions at work, and the same number said they’d feel more confident if they had access to <a href="https://www.itpro.com/business-intelligence/28220/what-is-data-analytics">real-time data insights</a>. </p><p>"The real foundation of confident decision-making isn’t instinct or AI alone, it’s real-time data. Accurate, trustworthy, context-rich insights that can flow across an organization in the moment leaders need them most," said Jones. </p><p>"Real-time data remains the voice that every leader must hear."</p><h3 class="article-body__section" id="section-follow-us-on-social-media"><span>FOLLOW US ON SOCIAL MEDIA</span></h3>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ How to transform data chaos into real AI outcomes ]]></title>
                                                                                                <dc:content><![CDATA[ <h2 id="tl-dr">TL;DR</h2><ul><li>Data quality has a direct impact on the success of AI deployments</li><li>Intuitive data management and automation capabilities help bridge gaps, clean up data, and deliver tangible results</li><li>High-performance infrastructure underpins any successful AI project</li></ul><p>AI is by no means a plug-and-play solution and requires significant investment and expertise across a range of areas. </p><p>From networking and storage infrastructure to data management and analytics capabilities, AI projects can be daunting for enterprises – and many are encountering acute challenges in moving from pilot to production. </p><p>MIT’s <a href="https://mlq.ai/media/quarterly_decks/v0.1_State_of_AI_in_Business_2025_Report.pdf" target="_blank"><u>2025 report</u></a> found that 95% of AI pilot projects fail, while separate McKinsey <a href="https://www.mckinsey.com/capabilities/mckinsey-technology/our-insights/ai-data-readiness-the-key-to-scaling-impact#/" target="_blank"><u>research </u></a>shows that just 7% of companies have successfully scaled AI across their organization. </p><figure class="van-image-figure  inline-layout" data-bordeaux-image-check="" ><div class='image-full-width-wrapper'><div class='image-widthsetter' style="max-width:1920px;"><p class="vanilla-image-block" style="padding-top:56.25%;"><img id="GQRD77FPVk8ptAEF77KmqT" name="ITPro-AIDataPlatform-A36-Image2" alt="A women looking at data" src="https://cdn.mos.cms.futurecdn.net/GQRD77FPVk8ptAEF77KmqT-1920-80.jpg" mos="" align="middle" fullscreen="" width="1920" height="1080" attribution="" endorsement="" class="inline" /></p></div></div><figcaption itemprop="caption description" class=" inline-layout"><span class="credit" itemprop="copyrightHolder">(Image credit: Dell Technologies)</span></figcaption></figure><p>A key factor lies in "AI readiness", according to McKinsey. Put simply, many organizations have not done the necessary groundwork to ensure that their data is cleaned up and prepared for AI use. </p><p>Other considerations, such as security and governance, are also often overlooked during the early stages of AI adoption. This creates a confluence of issues that impedes progress and, in many cases, ultimately results in failure. </p><p>Given that AI systems rely heavily on unstructured data, which <a href="https://www.forrester.com/blogs/unstructured-data-your-rocket-fuel-for-genai/" target="_blank"><u>Forrester describes</u></a> as the “messy stuff”  including video, text, images, and even behavioral signals, it’s no surprise that IT leaders encounter challenges when embarking on AI adoption projects. </p><p>This is where solutions such as the Dell AI Data Platform can help enterprises make sense of their data estate in preparation for AI adoption. </p><p>The Dell AI Data Platform allows IT leaders to consolidate their IT environments within a unified platform,  with tools  designed to prepare, manage, secure, and maximize the value of their data</p><h2 id="how-do-i-clean-up-my-data">How do I clean up my data?</h2><figure class="van-image-figure  inline-layout" data-bordeaux-image-check="" ><div class='image-full-width-wrapper'><div class='image-widthsetter' style="max-width:1920px;"><p class="vanilla-image-block" style="padding-top:56.25%;"><img id="rD58mX5CPtSs8j9iWAw7tZ" name="ITPro-AIDataPlatform-A36-Image3-Getty" alt="A depiction of data" src="https://cdn.mos.cms.futurecdn.net/rD58mX5CPtSs8j9iWAw7tZ-1920-80.jpg" mos="" align="middle" fullscreen="" width="1920" height="1080" attribution="" endorsement="" class="inline" /></p></div></div><figcaption itemprop="caption description" class=" inline-layout"><span class="credit" itemprop="copyrightHolder">(Image credit: Getty Images)</span></figcaption></figure><p>When embarking on an AI adoption project, one of the first questions many IT leaders ask is how to clean up data in preparation for its use. </p><p>Data quality is paramount in this process: if you put garbage in, you will get garbage out. Nearly two-thirds of CEOs cite low-quality or disconnected data caused by siloed infrastructures and fragmented technology stacks as a major barrier to scaling AI, according to Dell’s summary of  <a href="https://www.kearney.com/about/kearney-in-the-media/press/ceos-face-personal-inflection-point-affecting-decision-making" target="_blank"><u>Futurum Group and Kearney research.</u></a></p><p>“High-quality data determines how well an AI model can perceive, predict, and act—all critical performance criteria,” <a href="https://www.dell.com/en-uk/blog/the-it-leader-s-guide-to-feeding-ai-high-quality-data/" target="_blank"><u>Dell notes</u></a>. “Without sound data, your AI foundation will collapse.”</p><p>According to a recent <a href="https://www.delltechnologies.com/asset/en-gb/solutions/business-solutions/briefs-summaries/dell-and-nvidia-data-is-the-dna-of-ai-ebook.pdf" target="_blank"><u>eBook published by Dell and Nvidia</u></a><u>,</u> there are several steps IT leaders can take to begin cleaning their data, including identifying recurring issues. </p><p>"Accelerating AI outcomes starts with clean, well-labeled, and accessible data," the eBook states. Put simply, IT leaders should assess and audit the quality of their data from the outset.</p><p>Common problems with data quality include: </p><ul><li>Duplicate datasets</li><li>Missing values</li><li>Syntax errors</li><li>Irrelevant data</li><li>Inconsistencies</li></ul><p>These are all questions IT leaders must consider when auditing their data, but assessing data management capabilities is equally important. This allows enterprises to establish a clear baseline in terms of their expertise and readiness.</p><p>To underscore the point, Dell’s own guide to AI and data, ‘<a href="https://www.dell.com/en-us/blog/the-it-leader-s-guide-to-feeding-ai-high-quality-data/#:~:text=Establishing%20organizational%20standards%20for%20data,security%20and%20resilience%20are%20paramount." target="_blank"><u>The IT Leader’s Guide to Feeding AI High-Quality Data</u></a>’, says: “Establishing organizational standards for data structure, consistency, and completeness helps ensure the models your business relies on are learning from the right signals.” </p><h2 id="how-can-the-dell-ai-data-platform-help">How can the Dell AI Data Platform help?</h2><figure class="van-image-figure  inline-layout" data-bordeaux-image-check="" ><div class='image-full-width-wrapper'><div class='image-widthsetter' style="max-width:1920px;"><p class="vanilla-image-block" style="padding-top:56.25%;"><img id="gy3TWziuqyiborZeTziq8i" name="ITPro-AIDataPlatform-A36-Image4-Getty" alt="A server room" src="https://cdn.mos.cms.futurecdn.net/gy3TWziuqyiborZeTziq8i-1920-80.jpg" mos="" align="middle" fullscreen="" width="1920" height="1080" attribution="" endorsement="" class="inline" /></p></div></div><figcaption itemprop="caption description" class=" inline-layout"><span class="credit" itemprop="copyrightHolder">(Image credit: Getty Images)</span></figcaption></figure><p>The Dell AI Data Platform includes tools designed specifically for this process, such as the Dell Data Processing Engine. Powered by Apache Spark, this engine helps enrich and transform new data sources. </p><p><a href="https://www.delltechnologies.com/asset/en-us/products/storage/briefs-summaries/dell-data-processing-engine.pdf" target="_blank"><u>According to Dell</u></a>: “Data is efficiently organized into Parquet columnar format, optimizing storage and query performance. </p><p>"This engine supports a wide range of use cases, including ETL, advanced analytics, and machine learning, enabling teams to derive insights and build models faster."</p><p>The Dell Data Search Engine also plays a key role in discovery, retrieval, and making unstructured data usable. This solution allows users to parse and index unstructured data, making it more easily searchable by adding metadata tags. </p><h2 id="what-does-clean-and-structured-data-look-like">What does clean and structured data look like?</h2><p>In this context, clean data is accurate, consistent, free from errors and duplication, and ready to be used in AI systems. </p><p>A fundamental distinction is that clean, structured data is easier to identify and retrieve because it is organized using labels, definitions, and consistent structures.</p><h2 id="what-kind-of-infrastructure-and-tools-do-i-need-to-prepare-my-data">What kind of infrastructure and tools do I need to prepare my data?</h2><p>The data pipelines that feed generative and agentic AI applications are a key component in the success of any adoption project, however. Clean, usable data will have little impact if an organization is still contending with fragmented, disparate siloes across its IT architecture. </p><p>That is where the Dell AI Data Platform is a key differentiator for enterprises. As a unified platform, the solution allows organizations to consolidate data sources and create a more comprehensive view of their greatest asset in the age of AI. </p><p>The Dell Data Orchestration Engine is a critical tool in this regard. This platform helps consolidate data ingestion, preparation, retrieval, and inference within a single end-to-end pipeline. </p><p>This not only has a direct impact on data flows and broader AI innovation, but also delivers benefits in governance and security. Visibility is crucial to ensure that mission-critical data remains safe and secure. </p><p>“Simplifying how data moves, how it’s processed, and how it’s governed ensures systems can scale without adding complexity,” <a href="https://www.delltechnologies.com/asset/en-gb/solutions/business-solutions/briefs-summaries/dell-and-nvidia-data-is-the-dna-of-ai-ebook.pdf" target="_blank"><u>Dell notes</u></a>.  “A unified, flexible approach enables faster experimentation, better performance, and long-term adaptability.”</p><p>From a broader infrastructure perspective, best-in-class AI storage solutions are also a vital component of AI innovation. Dell PowerScale, the core storage foundation of the Dell AI Data Platform, is designed specifically to support enterprises throughout their adoption journey. </p><p>The storage platform offers the flexibility and scalability required to meet evolving needs as AI projects mature and expand in scope. PowerScale is intricately woven within the Dell AI Data Platform, once again providing users with a unified ecosystem designed for end-to-end project delivery. </p><p>If you think the Dell AI Data Platform is the right solution for your business, find out more on the <a href="https://ad.doubleclick.net/ddm/trackclk/N1153793.3561925FUTUREPLC/B36306769.453067481;dc_trk_aid=646941596;dc_trk_cid=260851445;dc_lat=;dc_rdid=;tag_for_child_directed_treatment=;tfua=;gdpr=${GDPR};gdpr_consent=${GDPR_CONSENT_755};ltd=;dc_tdv=1" target="_blank" rel="nofollow sponsored">Dell website.</a></p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/technology/artificial-intelligence/how-to-transform-data-chaos-into-real-ai-outcomes-the-missing-link-in-enterprise-ai</link>
                                                                            <description>
                            <![CDATA[ Enterprises face acute data quality challenges. Here's how the Dell AI Data Platform can help ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">5QNPw4UDZyWwpUhUPfLaHY</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/rBkApywUwppE6nfN9kUT2m-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Mon, 03 Aug 2026 13:00:00 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:17:05 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Platforms]]></category>
                                                    <category><![CDATA[Artificial Intelligence]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                                                                <author><![CDATA[ dale.walker@futurenet.com (ITPro) ]]></author>                    <dc:creator><![CDATA[ ITPro ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/JpDGYSnD7yNNModq5jFThm-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ null ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/rBkApywUwppE6nfN9kUT2m-1920-80.jpg">
                                                            <media:credit><![CDATA[Dell Technologies]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[A technician in a server room]]></media:description>                                                            <media:text><![CDATA[A technician in a server room]]></media:text>
                                <media:title type="plain"><![CDATA[A technician in a server room]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/rBkApywUwppE6nfN9kUT2m-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <h2 id="tl-dr">TL;DR</h2><ul><li>Data quality has a direct impact on the success of AI deployments</li><li>Intuitive data management and automation capabilities help bridge gaps, clean up data, and deliver tangible results</li><li>High-performance infrastructure underpins any successful AI project</li></ul><p>AI is by no means a plug-and-play solution and requires significant investment and expertise across a range of areas. </p><p>From networking and storage infrastructure to data management and analytics capabilities, AI projects can be daunting for enterprises – and many are encountering acute challenges in moving from pilot to production. </p><p>MIT’s <a href="https://mlq.ai/media/quarterly_decks/v0.1_State_of_AI_in_Business_2025_Report.pdf" target="_blank"><u>2025 report</u></a> found that 95% of AI pilot projects fail, while separate McKinsey <a href="https://www.mckinsey.com/capabilities/mckinsey-technology/our-insights/ai-data-readiness-the-key-to-scaling-impact#/" target="_blank"><u>research </u></a>shows that just 7% of companies have successfully scaled AI across their organization. </p><figure class="van-image-figure  inline-layout" data-bordeaux-image-check="" ><div class='image-full-width-wrapper'><div class='image-widthsetter' style="max-width:1920px;"><p class="vanilla-image-block" style="padding-top:56.25%;"><img id="GQRD77FPVk8ptAEF77KmqT" name="ITPro-AIDataPlatform-A36-Image2" alt="A women looking at data" src="https://cdn.mos.cms.futurecdn.net/GQRD77FPVk8ptAEF77KmqT-1920-80.jpg" mos="" align="middle" fullscreen="" width="1920" height="1080" attribution="" endorsement="" class="inline" /></p></div></div><figcaption itemprop="caption description" class=" inline-layout"><span class="credit" itemprop="copyrightHolder">(Image credit: Dell Technologies)</span></figcaption></figure><p>A key factor lies in "AI readiness", according to McKinsey. Put simply, many organizations have not done the necessary groundwork to ensure that their data is cleaned up and prepared for AI use. </p><p>Other considerations, such as security and governance, are also often overlooked during the early stages of AI adoption. This creates a confluence of issues that impedes progress and, in many cases, ultimately results in failure. </p><p>Given that AI systems rely heavily on unstructured data, which <a href="https://www.forrester.com/blogs/unstructured-data-your-rocket-fuel-for-genai/" target="_blank"><u>Forrester describes</u></a> as the “messy stuff”  including video, text, images, and even behavioral signals, it’s no surprise that IT leaders encounter challenges when embarking on AI adoption projects. </p><p>This is where solutions such as the Dell AI Data Platform can help enterprises make sense of their data estate in preparation for AI adoption. </p><p>The Dell AI Data Platform allows IT leaders to consolidate their IT environments within a unified platform,  with tools  designed to prepare, manage, secure, and maximize the value of their data</p><h2 id="how-do-i-clean-up-my-data">How do I clean up my data?</h2><figure class="van-image-figure  inline-layout" data-bordeaux-image-check="" ><div class='image-full-width-wrapper'><div class='image-widthsetter' style="max-width:1920px;"><p class="vanilla-image-block" style="padding-top:56.25%;"><img id="rD58mX5CPtSs8j9iWAw7tZ" name="ITPro-AIDataPlatform-A36-Image3-Getty" alt="A depiction of data" src="https://cdn.mos.cms.futurecdn.net/rD58mX5CPtSs8j9iWAw7tZ-1920-80.jpg" mos="" align="middle" fullscreen="" width="1920" height="1080" attribution="" endorsement="" class="inline" /></p></div></div><figcaption itemprop="caption description" class=" inline-layout"><span class="credit" itemprop="copyrightHolder">(Image credit: Getty Images)</span></figcaption></figure><p>When embarking on an AI adoption project, one of the first questions many IT leaders ask is how to clean up data in preparation for its use. </p><p>Data quality is paramount in this process: if you put garbage in, you will get garbage out. Nearly two-thirds of CEOs cite low-quality or disconnected data caused by siloed infrastructures and fragmented technology stacks as a major barrier to scaling AI, according to Dell’s summary of  <a href="https://www.kearney.com/about/kearney-in-the-media/press/ceos-face-personal-inflection-point-affecting-decision-making" target="_blank"><u>Futurum Group and Kearney research.</u></a></p><p>“High-quality data determines how well an AI model can perceive, predict, and act—all critical performance criteria,” <a href="https://www.dell.com/en-uk/blog/the-it-leader-s-guide-to-feeding-ai-high-quality-data/" target="_blank"><u>Dell notes</u></a>. “Without sound data, your AI foundation will collapse.”</p><p>According to a recent <a href="https://www.delltechnologies.com/asset/en-gb/solutions/business-solutions/briefs-summaries/dell-and-nvidia-data-is-the-dna-of-ai-ebook.pdf" target="_blank"><u>eBook published by Dell and Nvidia</u></a><u>,</u> there are several steps IT leaders can take to begin cleaning their data, including identifying recurring issues. </p><p>"Accelerating AI outcomes starts with clean, well-labeled, and accessible data," the eBook states. Put simply, IT leaders should assess and audit the quality of their data from the outset.</p><p>Common problems with data quality include: </p><ul><li>Duplicate datasets</li><li>Missing values</li><li>Syntax errors</li><li>Irrelevant data</li><li>Inconsistencies</li></ul><p>These are all questions IT leaders must consider when auditing their data, but assessing data management capabilities is equally important. This allows enterprises to establish a clear baseline in terms of their expertise and readiness.</p><p>To underscore the point, Dell’s own guide to AI and data, ‘<a href="https://www.dell.com/en-us/blog/the-it-leader-s-guide-to-feeding-ai-high-quality-data/#:~:text=Establishing%20organizational%20standards%20for%20data,security%20and%20resilience%20are%20paramount." target="_blank"><u>The IT Leader’s Guide to Feeding AI High-Quality Data</u></a>’, says: “Establishing organizational standards for data structure, consistency, and completeness helps ensure the models your business relies on are learning from the right signals.” </p><h2 id="how-can-the-dell-ai-data-platform-help">How can the Dell AI Data Platform help?</h2><figure class="van-image-figure  inline-layout" data-bordeaux-image-check="" ><div class='image-full-width-wrapper'><div class='image-widthsetter' style="max-width:1920px;"><p class="vanilla-image-block" style="padding-top:56.25%;"><img id="gy3TWziuqyiborZeTziq8i" name="ITPro-AIDataPlatform-A36-Image4-Getty" alt="A server room" src="https://cdn.mos.cms.futurecdn.net/gy3TWziuqyiborZeTziq8i-1920-80.jpg" mos="" align="middle" fullscreen="" width="1920" height="1080" attribution="" endorsement="" class="inline" /></p></div></div><figcaption itemprop="caption description" class=" inline-layout"><span class="credit" itemprop="copyrightHolder">(Image credit: Getty Images)</span></figcaption></figure><p>The Dell AI Data Platform includes tools designed specifically for this process, such as the Dell Data Processing Engine. Powered by Apache Spark, this engine helps enrich and transform new data sources. </p><p><a href="https://www.delltechnologies.com/asset/en-us/products/storage/briefs-summaries/dell-data-processing-engine.pdf" target="_blank"><u>According to Dell</u></a>: “Data is efficiently organized into Parquet columnar format, optimizing storage and query performance. </p><p>"This engine supports a wide range of use cases, including ETL, advanced analytics, and machine learning, enabling teams to derive insights and build models faster."</p><p>The Dell Data Search Engine also plays a key role in discovery, retrieval, and making unstructured data usable. This solution allows users to parse and index unstructured data, making it more easily searchable by adding metadata tags. </p><h2 id="what-does-clean-and-structured-data-look-like">What does clean and structured data look like?</h2><p>In this context, clean data is accurate, consistent, free from errors and duplication, and ready to be used in AI systems. </p><p>A fundamental distinction is that clean, structured data is easier to identify and retrieve because it is organized using labels, definitions, and consistent structures.</p><h2 id="what-kind-of-infrastructure-and-tools-do-i-need-to-prepare-my-data">What kind of infrastructure and tools do I need to prepare my data?</h2><p>The data pipelines that feed generative and agentic AI applications are a key component in the success of any adoption project, however. Clean, usable data will have little impact if an organization is still contending with fragmented, disparate siloes across its IT architecture. </p><p>That is where the Dell AI Data Platform is a key differentiator for enterprises. As a unified platform, the solution allows organizations to consolidate data sources and create a more comprehensive view of their greatest asset in the age of AI. </p><p>The Dell Data Orchestration Engine is a critical tool in this regard. This platform helps consolidate data ingestion, preparation, retrieval, and inference within a single end-to-end pipeline. </p><p>This not only has a direct impact on data flows and broader AI innovation, but also delivers benefits in governance and security. Visibility is crucial to ensure that mission-critical data remains safe and secure. </p><p>“Simplifying how data moves, how it’s processed, and how it’s governed ensures systems can scale without adding complexity,” <a href="https://www.delltechnologies.com/asset/en-gb/solutions/business-solutions/briefs-summaries/dell-and-nvidia-data-is-the-dna-of-ai-ebook.pdf" target="_blank"><u>Dell notes</u></a>.  “A unified, flexible approach enables faster experimentation, better performance, and long-term adaptability.”</p><p>From a broader infrastructure perspective, best-in-class AI storage solutions are also a vital component of AI innovation. Dell PowerScale, the core storage foundation of the Dell AI Data Platform, is designed specifically to support enterprises throughout their adoption journey. </p><p>The storage platform offers the flexibility and scalability required to meet evolving needs as AI projects mature and expand in scope. PowerScale is intricately woven within the Dell AI Data Platform, once again providing users with a unified ecosystem designed for end-to-end project delivery. </p><p>If you think the Dell AI Data Platform is the right solution for your business, find out more on the <a href="https://ad.doubleclick.net/ddm/trackclk/N1153793.3561925FUTUREPLC/B36306769.453067481;dc_trk_aid=646941596;dc_trk_cid=260851445;dc_lat=;dc_rdid=;tag_for_child_directed_treatment=;tfua=;gdpr=${GDPR};gdpr_consent=${GDPR_CONSENT_755};ltd=;dc_tdv=1" target="_blank" rel="nofollow sponsored">Dell website.</a></p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ Microsoft and Databricks target AI business context gains in partnership expansion ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Databricks and Microsoft are forging deeper ties with an expansion to the duo’s decade-long partnership, with a fresh focus placed on data management. </p><p>As part of the move, Databricks said it plans to expand use of Azure Databricks in core business operations and build a new, unified data lakehouse. </p><p>The move will also see the firm adopt Microsoft’s Arm-based VM infrastructure, Azure Cobalt, to “improve performance and efficiency”. </p><p>Microsoft, meanwhile, plans deeper integration of Databricks’ Data and AI platform across core product lines in a bid to provide customers with new tools such as Genie, the company’s flagship AI chatbot. </p><p><a href="https://www.itpro.com/business/acquisition/databricks-ceo-rebuffs-claims-of-generative-ai-bubble-following-dollar13bn-mosaicml-acquisition">Databricks CEO and co-founder Ali Ghodsi</a> said the expansion builds on long-standing ties and aims to accelerate customer data transformation efforts. </p><p>“For nearly a decade, Databricks and Microsoft have helped enterprises innovate with data and AI,” he said. </p><p>“Today, our partnership is stronger than ever. With Databricks Genie and Unity AI Gateway deeply integrated across Microsoft’s products, we’re helping enterprises unify their data and ground AI in business knowledge.”</p><h2 id="delivering-business-context">Delivering business context</h2><p>The partnership expansion aims to address key recurring hurdles for enterprises dabbling in AI innovation: data preparation and management. </p><p>AI systems, particularly agents, require fine-tuned data grounded in domain-specific context, according to the duo. Simply put, this means AI systems need to understand enterprise products, customers, operations, and general business processes to run efficiently.  </p><p>A significant portion of enterprises are still struggling to bridge these gaps, however, and it risks derailing adoption processes, according to Judson Althoff, CEO of Microsoft’s commercial business. </p><p>“The next generation of AI will be defined by how effectively organizations turn their unique knowledge into intelligence,” Althoff said. </p><p>“Microsoft and Databricks are helping customers connect data, AI, and business context to accelerate decision-making and drive measurable impact.”</p><h2 id="databricks-targets-performance-gains">Databricks targets performance gains</h2><p>A key focus of the partnership rests on expansion of Azure Cobalt for Databricks. The company said this will help improve performance and efficiency for agentic AI and ‘data-intensive’ workloads for customers. </p><p>The <a href="https://www.itpro.com/business-intelligence/28220/what-is-data-analytics">data analytics</a> firm currently uses Cobalt 100. Looking ahead, the company plans to adopt Cobalt 200, which Microsoft noted offers up to 50% better performance and includes memory encryption by default. </p><p>Expansion of core business operations through Azure Databricks will also deliver performance improvements, the duo noted, enabling the firm to scale up capabilities for customers. </p><h2 id="genie-integration">Genie integration</h2><p>Deeper integration of <a href="https://www.itpro.com/technology/artificial-intelligence/databricks-launches-ai-co-worker-genie-one"><u>Databricks’ Genie AI service</u></a> within Azure also aims to simplify data management capabilities for customers, according to the firm. </p><p>Running the AI system directly within Microsoft environments will enable customers to ground and operate agents on data hosted within the cloud service. This means the AI tool will be “deeply integrated” with key Microsoft products, including: </p><ul><li>Azure Data Lake Storage</li><li>Power BI</li><li>Microsoft Foundry</li><li>Microsoft 365, Teams, and Copilot</li></ul><p>“These capabilities bring governed, real-time data and AI into business workflows, giving organisations the context, control, choice, and cost efficiency needed to drive impact,” the company said in a blog post. </p><h3 class="article-body__section" id="section-follow-us-on-social-media"><span>FOLLOW US ON SOCIAL MEDIA</span></h3> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/data-and-insights/microsoft-and-databricks-target-ai-business-context-gains-in-partnership-expansion</link>
                                                                            <description>
                            <![CDATA[ Deeper integration of Databricks Genie within Azure aims to build more context-aware AI ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">npaVnF3XcUpBjWP3j8Ne5K</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/RqEHy9wywe2xQk4d6SKqVo-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Fri, 24 Jul 2026 09:31:18 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:17:06 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Platforms]]></category>
                                                    <category><![CDATA[Data and Insights]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Business]]></category>
                                                                                                <author><![CDATA[ ross.kelly@futurenet.com (Ross Kelly) ]]></author>                    <dc:creator><![CDATA[ Ross Kelly ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/Y5vrV2V98Np6jHAGmAtCd3-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Ross Kelly is ITPro&#039;s News &amp;amp; Analysis Editor, with a keen interest in cyber security, business leadership and emerging technologies.&lt;/p&gt;
&lt;p&gt;He graduated from Edinburgh Napier University in 2016 with a BA (Hons) in Journalism, and joined ITPro in 2022 after four years working in technology conference research.&amp;nbsp;&lt;/p&gt;
&lt;p&gt;In his spare time, Ross enjoys cycling, walking and is an avid reader of history and non-fiction.&lt;/p&gt;
&lt;p&gt;You can contact Ross at ross.kelly@futurenet.com or on &lt;a href=&quot;https://twitter.com/rosswritesetc&quot;&gt;Twitter&lt;/a&gt; and &lt;a href=&quot;https://www.linkedin.com/in/ross-kelly-18a54411a/&quot;&gt;LinkedIn&lt;/a&gt;.&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/RqEHy9wywe2xQk4d6SKqVo-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Databricks logo and branding on a smartphone screen, with company branding also pictured in background.]]></media:description>                                                            <media:text><![CDATA[Databricks logo and branding on a smartphone screen, with company branding also pictured in background.]]></media:text>
                                <media:title type="plain"><![CDATA[Databricks logo and branding on a smartphone screen, with company branding also pictured in background.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/RqEHy9wywe2xQk4d6SKqVo-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Databricks and Microsoft are forging deeper ties with an expansion to the duo’s decade-long partnership, with a fresh focus placed on data management. </p><p>As part of the move, Databricks said it plans to expand use of Azure Databricks in core business operations and build a new, unified data lakehouse. </p><p>The move will also see the firm adopt Microsoft’s Arm-based VM infrastructure, Azure Cobalt, to “improve performance and efficiency”. </p><p>Microsoft, meanwhile, plans deeper integration of Databricks’ Data and AI platform across core product lines in a bid to provide customers with new tools such as Genie, the company’s flagship AI chatbot. </p><p><a href="https://www.itpro.com/business/acquisition/databricks-ceo-rebuffs-claims-of-generative-ai-bubble-following-dollar13bn-mosaicml-acquisition">Databricks CEO and co-founder Ali Ghodsi</a> said the expansion builds on long-standing ties and aims to accelerate customer data transformation efforts. </p><p>“For nearly a decade, Databricks and Microsoft have helped enterprises innovate with data and AI,” he said. </p><p>“Today, our partnership is stronger than ever. With Databricks Genie and Unity AI Gateway deeply integrated across Microsoft’s products, we’re helping enterprises unify their data and ground AI in business knowledge.”</p><h2 id="delivering-business-context">Delivering business context</h2><p>The partnership expansion aims to address key recurring hurdles for enterprises dabbling in AI innovation: data preparation and management. </p><p>AI systems, particularly agents, require fine-tuned data grounded in domain-specific context, according to the duo. Simply put, this means AI systems need to understand enterprise products, customers, operations, and general business processes to run efficiently.  </p><p>A significant portion of enterprises are still struggling to bridge these gaps, however, and it risks derailing adoption processes, according to Judson Althoff, CEO of Microsoft’s commercial business. </p><p>“The next generation of AI will be defined by how effectively organizations turn their unique knowledge into intelligence,” Althoff said. </p><p>“Microsoft and Databricks are helping customers connect data, AI, and business context to accelerate decision-making and drive measurable impact.”</p><h2 id="databricks-targets-performance-gains">Databricks targets performance gains</h2><p>A key focus of the partnership rests on expansion of Azure Cobalt for Databricks. The company said this will help improve performance and efficiency for agentic AI and ‘data-intensive’ workloads for customers. </p><p>The <a href="https://www.itpro.com/business-intelligence/28220/what-is-data-analytics">data analytics</a> firm currently uses Cobalt 100. Looking ahead, the company plans to adopt Cobalt 200, which Microsoft noted offers up to 50% better performance and includes memory encryption by default. </p><p>Expansion of core business operations through Azure Databricks will also deliver performance improvements, the duo noted, enabling the firm to scale up capabilities for customers. </p><h2 id="genie-integration">Genie integration</h2><p>Deeper integration of <a href="https://www.itpro.com/technology/artificial-intelligence/databricks-launches-ai-co-worker-genie-one"><u>Databricks’ Genie AI service</u></a> within Azure also aims to simplify data management capabilities for customers, according to the firm. </p><p>Running the AI system directly within Microsoft environments will enable customers to ground and operate agents on data hosted within the cloud service. This means the AI tool will be “deeply integrated” with key Microsoft products, including: </p><ul><li>Azure Data Lake Storage</li><li>Power BI</li><li>Microsoft Foundry</li><li>Microsoft 365, Teams, and Copilot</li></ul><p>“These capabilities bring governed, real-time data and AI into business workflows, giving organisations the context, control, choice, and cost efficiency needed to drive impact,” the company said in a blog post. </p><h3 class="article-body__section" id="section-follow-us-on-social-media"><span>FOLLOW US ON SOCIAL MEDIA</span></h3>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ Why doesn't more data produce better results? ]]></title>
                                                                                                <dc:content><![CDATA[ <iframe allow="clipboard-write" height="200px" width="100%" id="" style="width: 100%; height: 200px;" class="position-center" data-lazy-priority="low" data-lazy-src="https://player.captivate.fm/episode/e904be37-373f-47e8-87a7-da2870b89379/" src="https://player.captivate.fm/episode/e904be37-373f-47e8-87a7-da2870b89379/"></iframe><p>Data is treated as a source of untapped riches for businesses, promising a world of better insight and easier management. What's less discussed is how it's possible to drown in this ocean of information – more data sometimes just means more noise, and this is as true in IT as in any other profession. </p><p>Why doesn't more data produce better results? Is there a better way forward? And what does this mean for the end users?  On this episode of the ITPro Podcast, Bobby Hellard and Ross Kelly talk to Fernando Castanheira, the CIO of Riverbed. </p><p>Castanheira's career has struck a balance between tech and finance, and how data is used to power businesses. He talks us through the mismatch between the amount of data available and how it's being used. </p><h2 id="highlights-2">Highlights</h2><p>"If I'm a service desk person, my job is to kind of make sure that everyone's able to do their jobs. There's no interruption, etc. I can come in and say, we have just introduced our third iteration of AI. We call it a Q. Q is basically you're going away from dashboards, which everybody's got to go look at dashboards, to come across as more conversational. I can come in and say, "Hey, I'm the desk guy. What are the three or four items that I should focus on today so that I can improve my you know my my environment? And then based on the data that we've collected over the last 24 hours, a week, whatever it is, we come back with some suggestions." </p><p>"These dashboards all look green, right? All look green on the outside, but you open things up on the inside, a lot of red. Because a lot of things are not working, even though the dashboards are looking green. So I think our approach is to make sure we kind of solve that by having very specific data, very specific recommendations, or very specific automation."</p><p>"The key thing is to have that foundation in place, and then we can act and enable things as you go forward, but it's a journey. You don't like go from zero to 100 overnight. You start with the easier stuff and then continue on that journey." </p><h2 id="links-2">Links</h2><ul><li><a href="https://www.itpro.com/technology/artificial-intelligence/data-quality-worries-holding-back-manufacturer-ai">Data quality worries are holding back AI adoption among manufacturers, despite optimism over its growth potential</a></li><li><a href="https://www.itpro.com/business/data-and-insights/ai-projects-are-faltering-as-cdos-grapple-with-poor-data-quality">AI projects are faltering as CDOs grapple with poor data quality</a></li><li><a href="https://www.itpro.com/business/data-and-insights/everpure-wants-you-to-get-your-data-ai-ready">Everpure wants you to get your data AI-ready</a></li></ul> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/data-and-insights/why-doesnt-more-data-produce-better-results</link>
                                                                            <description>
                            <![CDATA[ Riverbed CIO Fernando Castanheira talks about data and how businesses can use it better ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">XQAB2wAysQLJ8H5W5Ba2PU</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/R43kaqDv6RV5tjZed8Uxhf-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Fri, 17 Jul 2026 13:12:10 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:15:48 +0000</updated>
                                                                                                                                            <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Data and Insights]]></category>
                                                    <category><![CDATA[Business]]></category>
                                                                                                <author><![CDATA[ itpro@futurenet.com (Bobby Hellard) ]]></author>                    <dc:creator><![CDATA[ Bobby Hellard ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/bsR2tHSyVKUoyXZF5pNsDA-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Bobby Hellard&amp;nbsp;is&amp;nbsp;ITPro&#039;s Reviews Editor and has worked on&amp;nbsp;CloudPro and ChannelPro since 2018. In his time at ITPro, Bobby has covered stories for all the major technology companies, such as Apple, Microsoft, Amazon and Facebook, and regularly attends industry-leading events such as AWS Re:Invent and Google Cloud Next.&lt;/p&gt;
&lt;p&gt;Bobby mainly covers hardware reviews, but you will also recognize him as the face of many of our video reviews of laptops and smartphones.&lt;/p&gt;
&lt;p&gt;He has been a journalist for ten years, originally covering sports, before moving into business technology with ITPro. He has bylines in The Independent, Vice and The Business Briefing. Contact him at &lt;a href=&quot;mailto:bobby.hellard@futurenet.com&quot;&gt;bobby.hellard@futurenet.com&lt;/a&gt; or find him on Twitter: &lt;a href=&quot;https://twitter.com/bobbyhellard&quot;&gt;@bobbyhellard&lt;/a&gt;&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/R43kaqDv6RV5tjZed8Uxhf-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[The episode title ]]></media:description>                                                            <media:text><![CDATA[The episode title ]]></media:text>
                                <media:title type="plain"><![CDATA[The episode title ]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/R43kaqDv6RV5tjZed8Uxhf-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <iframe allow="clipboard-write" height="200px" width="100%" id="" style="width: 100%; height: 200px;" class="position-center" data-lazy-priority="low" data-lazy-src="https://player.captivate.fm/episode/e904be37-373f-47e8-87a7-da2870b89379/" src="https://player.captivate.fm/episode/e904be37-373f-47e8-87a7-da2870b89379/"></iframe><p>Data is treated as a source of untapped riches for businesses, promising a world of better insight and easier management. What's less discussed is how it's possible to drown in this ocean of information – more data sometimes just means more noise, and this is as true in IT as in any other profession. </p><p>Why doesn't more data produce better results? Is there a better way forward? And what does this mean for the end users?  On this episode of the ITPro Podcast, Bobby Hellard and Ross Kelly talk to Fernando Castanheira, the CIO of Riverbed. </p><p>Castanheira's career has struck a balance between tech and finance, and how data is used to power businesses. He talks us through the mismatch between the amount of data available and how it's being used. </p><h2 id="highlights-2">Highlights</h2><p>"If I'm a service desk person, my job is to kind of make sure that everyone's able to do their jobs. There's no interruption, etc. I can come in and say, we have just introduced our third iteration of AI. We call it a Q. Q is basically you're going away from dashboards, which everybody's got to go look at dashboards, to come across as more conversational. I can come in and say, "Hey, I'm the desk guy. What are the three or four items that I should focus on today so that I can improve my you know my my environment? And then based on the data that we've collected over the last 24 hours, a week, whatever it is, we come back with some suggestions." </p><p>"These dashboards all look green, right? All look green on the outside, but you open things up on the inside, a lot of red. Because a lot of things are not working, even though the dashboards are looking green. So I think our approach is to make sure we kind of solve that by having very specific data, very specific recommendations, or very specific automation."</p><p>"The key thing is to have that foundation in place, and then we can act and enable things as you go forward, but it's a journey. You don't like go from zero to 100 overnight. You start with the easier stuff and then continue on that journey." </p><h2 id="links-2">Links</h2><ul><li><a href="https://www.itpro.com/technology/artificial-intelligence/data-quality-worries-holding-back-manufacturer-ai">Data quality worries are holding back AI adoption among manufacturers, despite optimism over its growth potential</a></li><li><a href="https://www.itpro.com/business/data-and-insights/ai-projects-are-faltering-as-cdos-grapple-with-poor-data-quality">AI projects are faltering as CDOs grapple with poor data quality</a></li><li><a href="https://www.itpro.com/business/data-and-insights/everpure-wants-you-to-get-your-data-ai-ready">Everpure wants you to get your data AI-ready</a></li></ul>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ How Rathbones Asset Management built strong data foundations ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Stephen Wood, chief operating officer at Rathbones Asset Management (RAM), faced a challenge. His organization wanted to build strong data foundations to help deliver fresh insight to its professionals and embrace emerging technologies, such as agentic AI. </p><p>The solution to this challenge came via technology specialist Snowflake’s data platform. </p><p>“We wanted to create a golden source of data for each of our foundational domains,” he says. </p><p>“We wanted to overlay the data quality checks, the business rules, all those good things, and then everything would be built off that data lake. That's where we found ourselves working with Snowflake’s AI Data Cloud.”</p><h2 id="taking-a-long-term-view">Taking a long-term view</h2><p>Wood, who spoke with<em> ITPro</em> at the recent Snowflake Summit 2026 conference in San Francisco, says this process began two years ago, when RAM, which is part of the Rathbones investment group, was looking for a way to manage its information assets more effectively.</p><p>The shift to Snowflake is part of a broader digital transformation to support business growth. The organization’s assets under management grew quickly before the move to Snowflake. However, RAM was still using a portfolio management system that was customized for the wealth management element of the wider Rathbones group.</p><p>Fortuitously, a solution came from within the broader Rathbones group. The firm was in the first phase of its Snowflake deployment, and Wood suggested to senior executives that the technology could help his organization manage its data headache: </p><p>“We said, ‘Look, we can take advantage of this technology,” he adds. “We want to lead the way in terms of building out our core foundational data domains in a Snowflake environment.’”</p><h2 id="transformational-stages">Transformational stages</h2><p>Stage one of the transformation project involved a point-to-point data share between the existing Charles River investment management solution and the Snowflake platform. Wood says this data-sharing process covered a trading view of the organization’s funds, such as securities bought and sold. </p><p>Stage two, meanwhile, involved building out RAM’s data store and the static reference information for its funds. Wood says this process allowed his team to build the Open Funds template, which external vendors use as a standard for consuming the organization’s data. </p><p>The success of this initial work meant senior executives could see further opportunities, with Wood adding: “Then we started to get into conversations where we were saying, ‘Okay, now we need historical fund performance, our quant risk calculations, what we call subscriptions and redemptions, and the cash flow in and out of our funds from clients.’” </p><p>Today, RAM has nine domain-related data sets established in its Snowflake data platform. These data sets cover a range of areas, including performance, risk, sustainability, and unstructured information, such as the decisions behind the firm’s investment activities. </p><h2 id="foundation-for-future-success">Foundation for future success</h2><p>Wood says the integrated data sources provide a foundation for change, including potentially embracing emerging technology. Work undertaken so far means his team can start exploring AI, including Snowflake’s agentic services. At the San Francisco event, Snowflake announced new features for CoWork, its personal agent for knowledge workers, and CoCo, its coding agent for developers and data engineers. Wood can see the agentic technology’s potential.</p><p>“When you combine all the information, you can start to do some powerful things,” he says. </p><p>“We're now in a scenario where we can say, ‘Looking over all this data, we can start to analyze the performance of our investment decisions and give product specialists new insights.’” </p><p>RAM’s agentic explorations are already underway. The organization has a test environment for CoCo and CoWork that’s running with millions of rows of data. “At this stage, the outputs look very decent, so it's a near-production environment,” Wood says of the explorations, before outlining other potential applications. </p><p>He adds: “The future direction is that you start to get into sales and distribution. The most valuable data in our CRM system today is the call notes written up after every meeting that say clients are interested in some funds and pulling away from others. No one could analyze that data until now, because, after you've had two or three calls with the client, the information disappears down the chain in Salesforce.</p><p>“Now we're looking at the idea of using agentic technologies to consider the long-term buying trends of clients. The salespeople know their clients, and they know what they're buying. But if we see the general trends, then that insight can go into a product cycle that makes us think, ‘Do we need to be looking at new funds, do we need to broaden our horizon? Are we at risk in certain areas?’” </p><h2 id="fuelling-innovation">Fuelling innovation</h2><p>The work Wood’s team has undertaken means they can investigate native applications and emerging technologies with confidence, rather than focusing on point-to-point data shares with Snowflake. That investigatory work is crucial because, as a smaller business, RAM will never have a team of engineers to build out a big AI platform. </p><p>“That approach doesn't make any sense,” he says. “What does make sense is that we've got Snowflake technology that is central to our data strategy. Now, our work is about how we can find the tools that interplay with the platform, so we reduce the Frankenstein's monster of connectivity and integrations that can slow projects down.”</p><p>Wood reflects on the digital transformation program he’s overseen and says that, as with any financial services firm, the key challenge is ensuring exploratory projects are prioritized in an industry that often contends with a regulatory burden and technical debt. Sometimes, due to these intractable challenges, innovation gets stifled because of people and budget constraints. Wood says his organization has circumvented these issues.</p><p>“I think Snowflake, and how Rathbones operates, has allowed us to take control of our environment,” he says, referring to the split between the group implementation of the platform and his organization’s deployment. “There's a broad Snowflake environment, and then we've got a ring-fenced environment, with all our data sets, which means the implementation has been built in a way that allows more self-service capability.” </p><p>Wood suggests the key to long-term success will be staying on top of Snowflake’s product advances. For example, his team received buy-in for its CoWork and CoCo explorations by explaining how a trial of the agentic technologies could benefit the group.</p><p>“There are good ways to try and ensure that you get that prioritization if you need to,” he says. </p><p>“When you've got a real-world business case and value proposition that is going to materially benefit the business, versus just being a nice technology idea, the investment ultimately comes through.”</p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/data-and-insights/how-rathbones-asset-management-built-strong-data-foundations</link>
                                                                            <description>
                            <![CDATA[ The firm worked with cloud-native data and AI firm, Snowflake, to turn data into insight that can drive smart decisions ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">5rqejNEMe2Lt5oLnXvDZhB</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/p6SHUCH4Cp9Ao9UbtkVNMK-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Thu, 16 Jul 2026 07:00:00 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:17:16 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Platforms]]></category>
                                                    <category><![CDATA[Data and Insights]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Business]]></category>
                                                                                                                    <dc:creator><![CDATA[ Mark Samuels ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/rfAoiWsTvmT4koiuWLLZBi-320-70.jpeg ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Mark Samuels is a freelance writer specializing in business and technology. For the past two decades, he has produced extensive work on subjects such as the adoption of technology by C-suite executives.&lt;/p&gt;&lt;p&gt;At ITPro, Mark has provided long-form content on C-suite strategy, particularly relating to chief information officers (CIOs), as well as digital transformation case studies, and explainers on cloud computing architecture.&lt;/p&gt;&lt;p&gt;Mark has written for publications including The Guardian, ZDNet, TechRepublic, Times Higher Education, and CIONET. He started working as a staff writer at Computing in 2000, where he later became the publication’s features editor. In 2008, he took charge of the brand’s monthly supplement Computing Business alongside his features responsibilities.&lt;/p&gt;&lt;p&gt;From 2008 to 2014, Mark was also editor of the membership magazine for IT leadership forum CIO Connect. As part of the role, Mark oversaw the editorial content for CIO Connect, edited research reports, and maintained an extensive network of industry experts.&lt;/p&gt;&lt;p&gt;Before his career in journalism, Mark achieved a BA in geography and MSc in World Space Economy at the University of Birmingham, as well as a PhD in economic geography at the University of Sheffield.&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/p6SHUCH4Cp9Ao9UbtkVNMK-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Digital transformation concept image showing human hand touching digital interface with glowing data points.]]></media:description>                                                            <media:text><![CDATA[Digital transformation concept image showing human hand touching digital interface with glowing data points.]]></media:text>
                                <media:title type="plain"><![CDATA[Digital transformation concept image showing human hand touching digital interface with glowing data points.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/p6SHUCH4Cp9Ao9UbtkVNMK-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Stephen Wood, chief operating officer at Rathbones Asset Management (RAM), faced a challenge. His organization wanted to build strong data foundations to help deliver fresh insight to its professionals and embrace emerging technologies, such as agentic AI. </p><p>The solution to this challenge came via technology specialist Snowflake’s data platform. </p><p>“We wanted to create a golden source of data for each of our foundational domains,” he says. </p><p>“We wanted to overlay the data quality checks, the business rules, all those good things, and then everything would be built off that data lake. That's where we found ourselves working with Snowflake’s AI Data Cloud.”</p><h2 id="taking-a-long-term-view">Taking a long-term view</h2><p>Wood, who spoke with<em> ITPro</em> at the recent Snowflake Summit 2026 conference in San Francisco, says this process began two years ago, when RAM, which is part of the Rathbones investment group, was looking for a way to manage its information assets more effectively.</p><p>The shift to Snowflake is part of a broader digital transformation to support business growth. The organization’s assets under management grew quickly before the move to Snowflake. However, RAM was still using a portfolio management system that was customized for the wealth management element of the wider Rathbones group.</p><p>Fortuitously, a solution came from within the broader Rathbones group. The firm was in the first phase of its Snowflake deployment, and Wood suggested to senior executives that the technology could help his organization manage its data headache: </p><p>“We said, ‘Look, we can take advantage of this technology,” he adds. “We want to lead the way in terms of building out our core foundational data domains in a Snowflake environment.’”</p><h2 id="transformational-stages">Transformational stages</h2><p>Stage one of the transformation project involved a point-to-point data share between the existing Charles River investment management solution and the Snowflake platform. Wood says this data-sharing process covered a trading view of the organization’s funds, such as securities bought and sold. </p><p>Stage two, meanwhile, involved building out RAM’s data store and the static reference information for its funds. Wood says this process allowed his team to build the Open Funds template, which external vendors use as a standard for consuming the organization’s data. </p><p>The success of this initial work meant senior executives could see further opportunities, with Wood adding: “Then we started to get into conversations where we were saying, ‘Okay, now we need historical fund performance, our quant risk calculations, what we call subscriptions and redemptions, and the cash flow in and out of our funds from clients.’” </p><p>Today, RAM has nine domain-related data sets established in its Snowflake data platform. These data sets cover a range of areas, including performance, risk, sustainability, and unstructured information, such as the decisions behind the firm’s investment activities. </p><h2 id="foundation-for-future-success">Foundation for future success</h2><p>Wood says the integrated data sources provide a foundation for change, including potentially embracing emerging technology. Work undertaken so far means his team can start exploring AI, including Snowflake’s agentic services. At the San Francisco event, Snowflake announced new features for CoWork, its personal agent for knowledge workers, and CoCo, its coding agent for developers and data engineers. Wood can see the agentic technology’s potential.</p><p>“When you combine all the information, you can start to do some powerful things,” he says. </p><p>“We're now in a scenario where we can say, ‘Looking over all this data, we can start to analyze the performance of our investment decisions and give product specialists new insights.’” </p><p>RAM’s agentic explorations are already underway. The organization has a test environment for CoCo and CoWork that’s running with millions of rows of data. “At this stage, the outputs look very decent, so it's a near-production environment,” Wood says of the explorations, before outlining other potential applications. </p><p>He adds: “The future direction is that you start to get into sales and distribution. The most valuable data in our CRM system today is the call notes written up after every meeting that say clients are interested in some funds and pulling away from others. No one could analyze that data until now, because, after you've had two or three calls with the client, the information disappears down the chain in Salesforce.</p><p>“Now we're looking at the idea of using agentic technologies to consider the long-term buying trends of clients. The salespeople know their clients, and they know what they're buying. But if we see the general trends, then that insight can go into a product cycle that makes us think, ‘Do we need to be looking at new funds, do we need to broaden our horizon? Are we at risk in certain areas?’” </p><h2 id="fuelling-innovation">Fuelling innovation</h2><p>The work Wood’s team has undertaken means they can investigate native applications and emerging technologies with confidence, rather than focusing on point-to-point data shares with Snowflake. That investigatory work is crucial because, as a smaller business, RAM will never have a team of engineers to build out a big AI platform. </p><p>“That approach doesn't make any sense,” he says. “What does make sense is that we've got Snowflake technology that is central to our data strategy. Now, our work is about how we can find the tools that interplay with the platform, so we reduce the Frankenstein's monster of connectivity and integrations that can slow projects down.”</p><p>Wood reflects on the digital transformation program he’s overseen and says that, as with any financial services firm, the key challenge is ensuring exploratory projects are prioritized in an industry that often contends with a regulatory burden and technical debt. Sometimes, due to these intractable challenges, innovation gets stifled because of people and budget constraints. Wood says his organization has circumvented these issues.</p><p>“I think Snowflake, and how Rathbones operates, has allowed us to take control of our environment,” he says, referring to the split between the group implementation of the platform and his organization’s deployment. “There's a broad Snowflake environment, and then we've got a ring-fenced environment, with all our data sets, which means the implementation has been built in a way that allows more self-service capability.” </p><p>Wood suggests the key to long-term success will be staying on top of Snowflake’s product advances. For example, his team received buy-in for its CoWork and CoCo explorations by explaining how a trial of the agentic technologies could benefit the group.</p><p>“There are good ways to try and ensure that you get that prioritization if you need to,” he says. </p><p>“When you've got a real-world business case and value proposition that is going to materially benefit the business, versus just being a nice technology idea, the investment ultimately comes through.”</p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ Amazon OpenSearch update targets performance boosts and lower costs ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Amazon Web Services (AWS) has announced a series of changes to Amazon OpenSearch aimed at streamlining data log analysis. </p><p>A new purpose-built log analytics engine for the service will provide users with marked performance gains and up to 70% lower storage costs, according to the firm. </p><p>OpenSearch allows users to search, analyze, and visualize data in real-time, and is typically used for application monitoring, observability, and AI/ML search applications. </p><p>The hyperscaler said the update comes in direct response to surging volumes of log data handled by enterprises in 2026, largely due to AI. </p><p>Research from AWS shows that log volumes have grown between 30-40% year over year, which is stretching budgets and creating bottlenecks. </p><h2 id="amazon-opensearch-overhaul">Amazon OpenSearch overhaul</h2><p>As part of the update, Amazon revealed OpenSearch will now store data in the Apache Parquet format. This is a column-oriented data file format designed specifically for more efficient data storage and retrieval purposes. </p><p>The service previously relied on inverted indexing. Amazon noted the shift will deliver significant efficiency gains and faster search and retrieval capabilities. </p><p>“Apache Calcite parses and optimizes each query, then routes operations to the engine best suited to execute them: Apache DataFusion for analytical operations on columnar data, or Lucene for search predicates,” the company explained in a blog post. </p><p>“The two hand off mid-query, so a single query can search log content and aggregate the results without additional roundtrips.”</p><p>Amazon noted that OpenSearch now also supports the Piped Processing Language (PPL) and SQL query languages, both of which “execute natively” through the platform.</p><h2 id="amazon-eyes-optimized-log-analytics">Amazon eyes optimized log analytics</h2><p>From a performance perspective, Amazon noted users can expect significant improvements alongside lower costs.</p><p>OpenSearch now boasts up to four-times price improvements compared to the existing engine, based on internal benchmarks. </p><p>Users can also capitalize on two-times faster analytics queries due to the fact the engine processes data in columnar batches, even across larger data sets. A two-fold improvement on ingestion rates also aims to reduce bottlenecks.</p><p>“The optimized engine sustained 1.78 million documents per second at matched concurrency, approximately 2x the throughput of the Lucene baseline, while consuming less <a href="https://www.itpro.com/infrastructure/the-role-of-the-cpu-in-the-ai-era">CPU</a>,” the hyperscaler explained.</p><p>“Both domains ran with zero write rejections. For teams ingesting terabytes per day, the throughput advantage translates to fewer nodes for the same volume, or longer retention on the same infrastructure.”</p><h2 id="how-to-access-amazon-opensearch">How to access Amazon OpenSearch</h2><p>The new log analytics engine is available now for enterprises in AWS regions where OpenSearch Optimized instances are supported, the company noted. Similarly, there will be no additional premium for the optimized engine. </p><p>It’s worth noting that the new engine is a setting selected at creation time, meaning users can’t add this to an existing domain or enable it within individual indices or fields within a general-purpose domain. </p><p>“To adopt the optimized engine, create a new domain and migrate your ingestion pipelines into it,” the company explained. </p><p>“Create a new domain in the Amazon OpenSearch Service console and select Observability as your use case. The optimized engine is enabled by default.”</p><p>The in-built console will provide users with a side-by-side comparison of capabilities based on individual needs.</p><p>“After your domain is ready, ingest JSON documents through the same Bulk API and client libraries you use today. No changes to your ingestion pipelines or application code are required.”</p><h3 class="article-body__section" id="section-follow-us-on-social-media"><span>FOLLOW US ON SOCIAL MEDIA</span></h3> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/data-and-insights/amazon-opensearch-update-targets-performance-boosts-and-lower-costs-and-at-no-extra-charge-for-users</link>
                                                                            <description>
                            <![CDATA[ Surging data volumes have prompted an overhaul of Amazon’s OpenSearch service ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">e9YcTaNfUPWDU5Wo9yyiye</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/i2VUb2oLPjFFkMn6CA4Huj-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Tue, 07 Jul 2026 15:30:57 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:17:16 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Platforms]]></category>
                                                    <category><![CDATA[Data and Insights]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Business]]></category>
                                                                                                <author><![CDATA[ ross.kelly@futurenet.com (Ross Kelly) ]]></author>                    <dc:creator><![CDATA[ Ross Kelly ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/Y5vrV2V98Np6jHAGmAtCd3-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Ross Kelly is ITPro&#039;s News &amp;amp; Analysis Editor, with a keen interest in cyber security, business leadership and emerging technologies.&lt;/p&gt;
&lt;p&gt;He graduated from Edinburgh Napier University in 2016 with a BA (Hons) in Journalism, and joined ITPro in 2022 after four years working in technology conference research.&amp;nbsp;&lt;/p&gt;
&lt;p&gt;In his spare time, Ross enjoys cycling, walking and is an avid reader of history and non-fiction.&lt;/p&gt;
&lt;p&gt;You can contact Ross at ross.kelly@futurenet.com or on &lt;a href=&quot;https://twitter.com/rosswritesetc&quot;&gt;Twitter&lt;/a&gt; and &lt;a href=&quot;https://www.linkedin.com/in/ross-kelly-18a54411a/&quot;&gt;LinkedIn&lt;/a&gt;.&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/i2VUb2oLPjFFkMn6CA4Huj-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Amazon Web Services (AWS) logo and branding pictured at the Hannover Messe industrial trade fair for mechanical and electrical engineering and digital industries.]]></media:description>                                                            <media:text><![CDATA[Amazon Web Services (AWS) logo and branding pictured at the Hannover Messe industrial trade fair for mechanical and electrical engineering and digital industries.]]></media:text>
                                <media:title type="plain"><![CDATA[Amazon Web Services (AWS) logo and branding pictured at the Hannover Messe industrial trade fair for mechanical and electrical engineering and digital industries.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/i2VUb2oLPjFFkMn6CA4Huj-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Amazon Web Services (AWS) has announced a series of changes to Amazon OpenSearch aimed at streamlining data log analysis. </p><p>A new purpose-built log analytics engine for the service will provide users with marked performance gains and up to 70% lower storage costs, according to the firm. </p><p>OpenSearch allows users to search, analyze, and visualize data in real-time, and is typically used for application monitoring, observability, and AI/ML search applications. </p><p>The hyperscaler said the update comes in direct response to surging volumes of log data handled by enterprises in 2026, largely due to AI. </p><p>Research from AWS shows that log volumes have grown between 30-40% year over year, which is stretching budgets and creating bottlenecks. </p><h2 id="amazon-opensearch-overhaul">Amazon OpenSearch overhaul</h2><p>As part of the update, Amazon revealed OpenSearch will now store data in the Apache Parquet format. This is a column-oriented data file format designed specifically for more efficient data storage and retrieval purposes. </p><p>The service previously relied on inverted indexing. Amazon noted the shift will deliver significant efficiency gains and faster search and retrieval capabilities. </p><p>“Apache Calcite parses and optimizes each query, then routes operations to the engine best suited to execute them: Apache DataFusion for analytical operations on columnar data, or Lucene for search predicates,” the company explained in a blog post. </p><p>“The two hand off mid-query, so a single query can search log content and aggregate the results without additional roundtrips.”</p><p>Amazon noted that OpenSearch now also supports the Piped Processing Language (PPL) and SQL query languages, both of which “execute natively” through the platform.</p><h2 id="amazon-eyes-optimized-log-analytics">Amazon eyes optimized log analytics</h2><p>From a performance perspective, Amazon noted users can expect significant improvements alongside lower costs.</p><p>OpenSearch now boasts up to four-times price improvements compared to the existing engine, based on internal benchmarks. </p><p>Users can also capitalize on two-times faster analytics queries due to the fact the engine processes data in columnar batches, even across larger data sets. A two-fold improvement on ingestion rates also aims to reduce bottlenecks.</p><p>“The optimized engine sustained 1.78 million documents per second at matched concurrency, approximately 2x the throughput of the Lucene baseline, while consuming less <a href="https://www.itpro.com/infrastructure/the-role-of-the-cpu-in-the-ai-era">CPU</a>,” the hyperscaler explained.</p><p>“Both domains ran with zero write rejections. For teams ingesting terabytes per day, the throughput advantage translates to fewer nodes for the same volume, or longer retention on the same infrastructure.”</p><h2 id="how-to-access-amazon-opensearch">How to access Amazon OpenSearch</h2><p>The new log analytics engine is available now for enterprises in AWS regions where OpenSearch Optimized instances are supported, the company noted. Similarly, there will be no additional premium for the optimized engine. </p><p>It’s worth noting that the new engine is a setting selected at creation time, meaning users can’t add this to an existing domain or enable it within individual indices or fields within a general-purpose domain. </p><p>“To adopt the optimized engine, create a new domain and migrate your ingestion pipelines into it,” the company explained. </p><p>“Create a new domain in the Amazon OpenSearch Service console and select Observability as your use case. The optimized engine is enabled by default.”</p><p>The in-built console will provide users with a side-by-side comparison of capabilities based on individual needs.</p><p>“After your domain is ready, ingest JSON documents through the same Bulk API and client libraries you use today. No changes to your ingestion pipelines or application code are required.”</p><h3 class="article-body__section" id="section-follow-us-on-social-media"><span>FOLLOW US ON SOCIAL MEDIA</span></h3>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ Using data to help deal with ever-changing and unpredictable weather conditions ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Britain might be in the middle of a heatwave, but cast your mind back a few weeks, and you’ll remember the rain.</p><p>In fact, Met Office estimates suggest 2026 has seen well-above-average rainfall, with some areas recording their wettest conditions in over 100 years during January and February, followed by a notably unsettled and wet spell across May and early June.</p><p>Such are the fluctuations in weather conditions that sudden rainfall can result in flooding, creating huge challenges for residents and public sector organizations. It’s into this fast-changing environment that an innovative project between Ordnance Survey (OS), Britain’s national mapping service, and technology specialist Snowflake aims to bring data-led clarity.</p><p>The two businesses have worked together to create an Intelligent Flood Readiness Model (IFRM), which has identified 1.2 million undefended buildings at risk of flooding in England, many in the most deprived parts of the country. </p><h2 id="harnessing-the-power-of-data-led-insight">Harnessing the power of data-led insight</h2><p>The initiative is opening eyes to data-powered opportunities, according to Tim Chilton, managing geospatial consultant at OS. </p><p>“We’re trying to create a broader conversation around the types of things technology can do across government,” he says. </p><p>“Several parties have come to us and said, ‘This is interesting, can we talk?’ What I'm trying to do on behalf of OS is to create those conversations and ask, ‘What could you achieve with our data and this kind of technology?’”</p><p>Chilton helps OS explore new commercial opportunities from its treasure troves of data. The organization started working with Snowflake in 2024. The organization uses the Snowflake Marketplace to share open data with public-sector organizations and explore commercial avenues. The priority now is ensuring OS embraces other data-led advances. </p><p>“We have a platform strategy, which is about putting our data where the customer works,” he says. </p><p>“The person who uses our data might work in geospatial, they might be a data scientist, and increasingly, as you'll find with the IFRM, they could be a businessperson who wants to ask a natural language query and be confident the results are correct.”</p><p>That approach resonates with Snowflake’s longer-term business strategy. At its recent Summit 2026 event in San Francisco, senior executives outlined the company’s plans to use agentic AI to open data access to IT and non-IT professionals. Chilton says the IFRM is an exemplar of the joined-up initiatives that will help organizations make the most of data in the age of AI.</p><p>“The model is about Snowflake and us talking about how AI can supercharge the timelines around having a problem and trying to solve it. Geospatial data really brings that data-led journey to life. A lot of government strategies are based around multi-year plans, but the climate is changing more frequently and regularly in more extreme ways than before,” he says. </p><p>“The question we asked was, ‘How could we use technology and bring in the latest data to check that those plans are still right for specific areas and even individual buildings?’ We hoped the model could help us keep on top of the issues and monitor and measure the impact of that plan on the ground.”</p><h2 id="finding-the-path-forward">Finding the path forward</h2><p>OS and Snowflake started the initiative in early 2026. After spending a couple of months working on the model, including ensuring the right data sets were being tapped, the organizations recognized that other sources could provide further depth, particularly the National Geographic Database. Chilton says the model will continue to be honed iteratively.</p><p>“If someone says, ‘Ah, but you didn't include this data that we've just released,’ we can say, ‘Good point, give us a week, and we'll give you some early results with your data included,’” he says. </p><p>“So, the model is a collaborative way of working, where we’re reacting to those changes in the model and the data that it uses.”</p><p>The model combines six data streams into a single layer. This layer produces key insights. For example, cross-referencing OS building datasets with the Indices of Deprivation in England identifies where physical vulnerability intersects with social risk. This insight is then layered against other information, such as Environment Agency flood and risk data. </p><p>Chilton says three key steps were crucial in the development of the model. First, project staff used the Snowflake CoCo agent to turn text-heavy documents, such as Flood Risk Management Plans, into data that the model could read in natural language.</p><p>Second, Snowflake’s semantic layer technology helped the model to understand, with guidance from OS experts, the meaning of attributes in the organization’s data sets. Finally, project staff used the Snowflake CoWork agent to create a natural language interface that allows anyone to ask questions about flood readiness.</p><p>“That capability was amazingly well received,” he says. “People can use the interface to query six well-organized and well-formatted data sets. The extraction of insights from documents, the semantic layer, and the CoWork frontend combined to create this powerful capability.”</p><h2 id="the-right-data-in-the-right-hands">The right data, in the right hands</h2><p>"Data is at the heart of making informed decisions. As this project shows, it's rare that one body holds all the relevant data or that this data is in the same format,” says Fawad Qureshi, global field CTO at Snowflake. </p><p>“But we're now in an era where technology can bring together the right people and the right data to collaborate on making better-informed decisions."</p><p>By combining OS building data with information on flooding, social deprivation, and 3,000 pages of Flood Risk Management Plans, the model allows decision-makers to understand the potential impact of flooding in more detail than ever before. Chilton says these insights will help policymakers better understand the likelihood of flooding.</p><p>“There are already flood risk models; that idea is not new,” he says. “What is new is the ability to bring in much more granular data tied to flood risks. Not everyone in government was aware we had that level of detail. This initiative has provided an effective, practical application of some of our knowledge.”</p><p>Further work is planned in the wake of the model’s success. OS aims to make it easier for users to ask questions of data. The organization is exploring new technologies, including AI, to make data more accessible, enabling a wider range of users to unlock its value.</p><p>“We're actually ahead of the curve in comparison to many of our customers and our partners,” says Chilton. </p><p>“We're educating through doing and sharing demonstrators and great case studies like this model, and gradually you can see that cultural shift with people saying, ‘I get it, I know why there's a lot of fuss about AI and data, and we're going to give it a go.”</p><p>Other potential data sources include information from the Office for National Statistics, the British Geological Survey, and the National Underground Asset Register. In fact, OS aims to deliver an integrated approach to data within the next 12 months. Chilton returns to his key message for other digital leaders in the public sector considering AI projects.</p><p>“Give it a go,” he says. “I've seen the governance, security, data protection, and robustness of these tools. We've gone through the due diligence process, and Snowflake is a system that we trust to hold our data.” </p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/technology/artificial-intelligence/using-data-to-help-deal-with-ever-changing-and-unpredictable-weather-conditions</link>
                                                                            <description>
                            <![CDATA[ Ordnance Survey and Snowflake have partnered on the creation of an IFRM to help better identify flood risks ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">ZvkZCTns26M8VSbu6CLt9J</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/RwdcJk7qpC8JGyYinCwZTF-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Wed, 01 Jul 2026 07:00:00 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:17:17 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Platforms]]></category>
                                                    <category><![CDATA[Artificial Intelligence]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                                                                                    <dc:creator><![CDATA[ Mark Samuels ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/rfAoiWsTvmT4koiuWLLZBi-320-70.jpeg ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Mark Samuels is a freelance writer specializing in business and technology. For the past two decades, he has produced extensive work on subjects such as the adoption of technology by C-suite executives.&lt;/p&gt;&lt;p&gt;At ITPro, Mark has provided long-form content on C-suite strategy, particularly relating to chief information officers (CIOs), as well as digital transformation case studies, and explainers on cloud computing architecture.&lt;/p&gt;&lt;p&gt;Mark has written for publications including The Guardian, ZDNet, TechRepublic, Times Higher Education, and CIONET. He started working as a staff writer at Computing in 2000, where he later became the publication’s features editor. In 2008, he took charge of the brand’s monthly supplement Computing Business alongside his features responsibilities.&lt;/p&gt;&lt;p&gt;From 2008 to 2014, Mark was also editor of the membership magazine for IT leadership forum CIO Connect. As part of the role, Mark oversaw the editorial content for CIO Connect, edited research reports, and maintained an extensive network of industry experts.&lt;/p&gt;&lt;p&gt;Before his career in journalism, Mark achieved a BA in geography and MSc in World Space Economy at the University of Birmingham, as well as a PhD in economic geography at the University of Sheffield.&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/RwdcJk7qpC8JGyYinCwZTF-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Storm Dennis flooding]]></media:description>                                                            <media:text><![CDATA[Storm Dennis flooding]]></media:text>
                                <media:title type="plain"><![CDATA[Storm Dennis flooding]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/RwdcJk7qpC8JGyYinCwZTF-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Britain might be in the middle of a heatwave, but cast your mind back a few weeks, and you’ll remember the rain.</p><p>In fact, Met Office estimates suggest 2026 has seen well-above-average rainfall, with some areas recording their wettest conditions in over 100 years during January and February, followed by a notably unsettled and wet spell across May and early June.</p><p>Such are the fluctuations in weather conditions that sudden rainfall can result in flooding, creating huge challenges for residents and public sector organizations. It’s into this fast-changing environment that an innovative project between Ordnance Survey (OS), Britain’s national mapping service, and technology specialist Snowflake aims to bring data-led clarity.</p><p>The two businesses have worked together to create an Intelligent Flood Readiness Model (IFRM), which has identified 1.2 million undefended buildings at risk of flooding in England, many in the most deprived parts of the country. </p><h2 id="harnessing-the-power-of-data-led-insight">Harnessing the power of data-led insight</h2><p>The initiative is opening eyes to data-powered opportunities, according to Tim Chilton, managing geospatial consultant at OS. </p><p>“We’re trying to create a broader conversation around the types of things technology can do across government,” he says. </p><p>“Several parties have come to us and said, ‘This is interesting, can we talk?’ What I'm trying to do on behalf of OS is to create those conversations and ask, ‘What could you achieve with our data and this kind of technology?’”</p><p>Chilton helps OS explore new commercial opportunities from its treasure troves of data. The organization started working with Snowflake in 2024. The organization uses the Snowflake Marketplace to share open data with public-sector organizations and explore commercial avenues. The priority now is ensuring OS embraces other data-led advances. </p><p>“We have a platform strategy, which is about putting our data where the customer works,” he says. </p><p>“The person who uses our data might work in geospatial, they might be a data scientist, and increasingly, as you'll find with the IFRM, they could be a businessperson who wants to ask a natural language query and be confident the results are correct.”</p><p>That approach resonates with Snowflake’s longer-term business strategy. At its recent Summit 2026 event in San Francisco, senior executives outlined the company’s plans to use agentic AI to open data access to IT and non-IT professionals. Chilton says the IFRM is an exemplar of the joined-up initiatives that will help organizations make the most of data in the age of AI.</p><p>“The model is about Snowflake and us talking about how AI can supercharge the timelines around having a problem and trying to solve it. Geospatial data really brings that data-led journey to life. A lot of government strategies are based around multi-year plans, but the climate is changing more frequently and regularly in more extreme ways than before,” he says. </p><p>“The question we asked was, ‘How could we use technology and bring in the latest data to check that those plans are still right for specific areas and even individual buildings?’ We hoped the model could help us keep on top of the issues and monitor and measure the impact of that plan on the ground.”</p><h2 id="finding-the-path-forward">Finding the path forward</h2><p>OS and Snowflake started the initiative in early 2026. After spending a couple of months working on the model, including ensuring the right data sets were being tapped, the organizations recognized that other sources could provide further depth, particularly the National Geographic Database. Chilton says the model will continue to be honed iteratively.</p><p>“If someone says, ‘Ah, but you didn't include this data that we've just released,’ we can say, ‘Good point, give us a week, and we'll give you some early results with your data included,’” he says. </p><p>“So, the model is a collaborative way of working, where we’re reacting to those changes in the model and the data that it uses.”</p><p>The model combines six data streams into a single layer. This layer produces key insights. For example, cross-referencing OS building datasets with the Indices of Deprivation in England identifies where physical vulnerability intersects with social risk. This insight is then layered against other information, such as Environment Agency flood and risk data. </p><p>Chilton says three key steps were crucial in the development of the model. First, project staff used the Snowflake CoCo agent to turn text-heavy documents, such as Flood Risk Management Plans, into data that the model could read in natural language.</p><p>Second, Snowflake’s semantic layer technology helped the model to understand, with guidance from OS experts, the meaning of attributes in the organization’s data sets. Finally, project staff used the Snowflake CoWork agent to create a natural language interface that allows anyone to ask questions about flood readiness.</p><p>“That capability was amazingly well received,” he says. “People can use the interface to query six well-organized and well-formatted data sets. The extraction of insights from documents, the semantic layer, and the CoWork frontend combined to create this powerful capability.”</p><h2 id="the-right-data-in-the-right-hands">The right data, in the right hands</h2><p>"Data is at the heart of making informed decisions. As this project shows, it's rare that one body holds all the relevant data or that this data is in the same format,” says Fawad Qureshi, global field CTO at Snowflake. </p><p>“But we're now in an era where technology can bring together the right people and the right data to collaborate on making better-informed decisions."</p><p>By combining OS building data with information on flooding, social deprivation, and 3,000 pages of Flood Risk Management Plans, the model allows decision-makers to understand the potential impact of flooding in more detail than ever before. Chilton says these insights will help policymakers better understand the likelihood of flooding.</p><p>“There are already flood risk models; that idea is not new,” he says. “What is new is the ability to bring in much more granular data tied to flood risks. Not everyone in government was aware we had that level of detail. This initiative has provided an effective, practical application of some of our knowledge.”</p><p>Further work is planned in the wake of the model’s success. OS aims to make it easier for users to ask questions of data. The organization is exploring new technologies, including AI, to make data more accessible, enabling a wider range of users to unlock its value.</p><p>“We're actually ahead of the curve in comparison to many of our customers and our partners,” says Chilton. </p><p>“We're educating through doing and sharing demonstrators and great case studies like this model, and gradually you can see that cultural shift with people saying, ‘I get it, I know why there's a lot of fuss about AI and data, and we're going to give it a go.”</p><p>Other potential data sources include information from the Office for National Statistics, the British Geological Survey, and the National Underground Asset Register. In fact, OS aims to deliver an integrated approach to data within the next 12 months. Chilton returns to his key message for other digital leaders in the public sector considering AI projects.</p><p>“Give it a go,” he says. “I've seen the governance, security, data protection, and robustness of these tools. We've gone through the due diligence process, and Snowflake is a system that we trust to hold our data.” </p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ Everpure wants you to get your data AI-ready  ]]></title>
                                                                                                <dc:content><![CDATA[ <p>"Data readiness" has quickly become one of the key challenges facing enterprises dabbling in AI innovation, according to research from IDC, and Everpure wants to help enterprises sharpen up their capabilities.</p><p>The <a href="https://www.itpro.com/server-storage/flash-storage/360883/the-benefits-and-drawbacks-of-flash-storage-today">flash storage</a> and data management company confirmed the general availability of a new platform aimed at streamlining paths to production for AI, helping them prepare and refine unstructured data for use in AI applications. </p><p><a href="https://www.itpro.com/business-intelligence/28220/what-is-data-analytics">Data Stream</a>, which was first announced at <a href="https://www.itpro.com/infrastructure/nvidia-gtc-2025-four-big-announcements-you-need-to-know-about">Nvidia GTC</a>, is based on the Nvidia AI Data Platform design and aims to reduce raw data preparation from "months to minutes". </p><p>Speaking to assembled media ahead of the event, Everpure's chief technology and growth officer, Rob Lee, said the solution fundamentally aims to make data "more usable" and cut down on what has traditionally been an extensive, manual process. </p><p>"One of the problems that we're trying to solve is, how do we automate, how do we make just the whole process of enterprise customers tapping into their vast amounts of data and making that more usable, more easily plumbed into AI workflows," he said. </p><p>Lee noted that Data Stream will allow enterprises to connect "all their data sources" and data streams, with the platform thereafter automatically ingesting data, curating it, classifying it, and indexing it. </p><p>Data Stream will "basically automate the process, which today is altogether too manual". </p><h2 id="data-readiness-in-the-age-of-ai">Data readiness in the age of AI</h2><p>The move by Everpure comes amidst a sharpened focus on data management for the firm, following a <a href="https://www.itpro.com/business/data-and-insights/pure-storage-snaps-up-1touch-in-data-management-pivot">recent rebrand and acquisition of data intelligence firm 1Touch</a>. </p><p>Everpure unveiled the <a href="https://www.itpro.com/business/data-and-insights/everpure-continues-data-management-pivot-with-new-data-intelligence-platform-launch">Data Intelligence platform</a> at its annual conference in Las Vegas. And, like Data Stream, it aims to simplify and streamline data management and bolster AI readiness for firms. </p><p>A common recurring hurdle for enterprises on this front has been data quality, per IDC research. Analysis from the consultancy found 94% of IT leaders identified this as "important or very important to AI project success". </p><p>Similar <a href="https://www.itpro.com/technology/artificial-intelligence/data-quality-worries-holding-back-manufacturer-ai">research from Riverbed</a> also highlighted data quality as a major factor in AI project failures. In a poll last year, 87% of respondents said that high quality data is critical to AI success, yet more than two-thirds (69%) said they had serious doubts over how effective their firm is at maximizing the use of data. </p><p>The Everpure Data Intelligence problem addresses this challenge directly, as <em>ITPro</em> reported, helping enterprises to map data dependencies and therefore providing AI systems with relevant, contextualized data. </p><p>On a broader front, both Data Stream and the Data Intelligence platforms could play a vital role in helping enterprises push AI projects into full production – an area which many have struggled with in recent years. </p><p><a href="https://www.itpro.com/technology/artificial-intelligence/half-of-agentic-ai-projects-are-still-stuck-at-the-pilot-stage-but-thats-not-stopping-enterprises-from-ramping-up-investment">Research from Dynatrace</a> in January this year found roughly half of agentic AI projects were stuck in proof of concept (PoC) stages, with IT leaders failing to push initiatives into full production.  </p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/data-and-insights/everpure-wants-you-to-get-your-data-ai-ready</link>
                                                                            <description>
                            <![CDATA[ With enterprises facing recurring data readiness issues, Everpure wants to streamline the process and deliver AI success ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">cUR8gHYAy4AvHTfD9nNbbf</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/29ZrFaBWCzfjPqnxm3GgVQ-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Wed, 17 Jun 2026 13:00:00 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:16:40 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Management]]></category>
                                                    <category><![CDATA[Data and Insights]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Business]]></category>
                                                                                                <author><![CDATA[ ross.kelly@futurenet.com (Ross Kelly) ]]></author>                    <dc:creator><![CDATA[ Ross Kelly ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/Y5vrV2V98Np6jHAGmAtCd3-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Ross Kelly is ITPro&#039;s News &amp;amp; Analysis Editor, with a keen interest in cyber security, business leadership and emerging technologies.&lt;/p&gt;
&lt;p&gt;He graduated from Edinburgh Napier University in 2016 with a BA (Hons) in Journalism, and joined ITPro in 2022 after four years working in technology conference research.&amp;nbsp;&lt;/p&gt;
&lt;p&gt;In his spare time, Ross enjoys cycling, walking and is an avid reader of history and non-fiction.&lt;/p&gt;
&lt;p&gt;You can contact Ross at ross.kelly@futurenet.com or on &lt;a href=&quot;https://twitter.com/rosswritesetc&quot;&gt;Twitter&lt;/a&gt; and &lt;a href=&quot;https://www.linkedin.com/in/ross-kelly-18a54411a/&quot;&gt;LinkedIn&lt;/a&gt;.&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/29ZrFaBWCzfjPqnxm3GgVQ-1920-80.jpg">
                                                            <media:credit><![CDATA[Future]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Everpure logo at Everpure Accelerate 2026]]></media:description>                                                            <media:text><![CDATA[Everpure logo at Everpure Accelerate 2026]]></media:text>
                                <media:title type="plain"><![CDATA[Everpure logo at Everpure Accelerate 2026]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/29ZrFaBWCzfjPqnxm3GgVQ-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>"Data readiness" has quickly become one of the key challenges facing enterprises dabbling in AI innovation, according to research from IDC, and Everpure wants to help enterprises sharpen up their capabilities.</p><p>The <a href="https://www.itpro.com/server-storage/flash-storage/360883/the-benefits-and-drawbacks-of-flash-storage-today">flash storage</a> and data management company confirmed the general availability of a new platform aimed at streamlining paths to production for AI, helping them prepare and refine unstructured data for use in AI applications. </p><p><a href="https://www.itpro.com/business-intelligence/28220/what-is-data-analytics">Data Stream</a>, which was first announced at <a href="https://www.itpro.com/infrastructure/nvidia-gtc-2025-four-big-announcements-you-need-to-know-about">Nvidia GTC</a>, is based on the Nvidia AI Data Platform design and aims to reduce raw data preparation from "months to minutes". </p><p>Speaking to assembled media ahead of the event, Everpure's chief technology and growth officer, Rob Lee, said the solution fundamentally aims to make data "more usable" and cut down on what has traditionally been an extensive, manual process. </p><p>"One of the problems that we're trying to solve is, how do we automate, how do we make just the whole process of enterprise customers tapping into their vast amounts of data and making that more usable, more easily plumbed into AI workflows," he said. </p><p>Lee noted that Data Stream will allow enterprises to connect "all their data sources" and data streams, with the platform thereafter automatically ingesting data, curating it, classifying it, and indexing it. </p><p>Data Stream will "basically automate the process, which today is altogether too manual". </p><h2 id="data-readiness-in-the-age-of-ai">Data readiness in the age of AI</h2><p>The move by Everpure comes amidst a sharpened focus on data management for the firm, following a <a href="https://www.itpro.com/business/data-and-insights/pure-storage-snaps-up-1touch-in-data-management-pivot">recent rebrand and acquisition of data intelligence firm 1Touch</a>. </p><p>Everpure unveiled the <a href="https://www.itpro.com/business/data-and-insights/everpure-continues-data-management-pivot-with-new-data-intelligence-platform-launch">Data Intelligence platform</a> at its annual conference in Las Vegas. And, like Data Stream, it aims to simplify and streamline data management and bolster AI readiness for firms. </p><p>A common recurring hurdle for enterprises on this front has been data quality, per IDC research. Analysis from the consultancy found 94% of IT leaders identified this as "important or very important to AI project success". </p><p>Similar <a href="https://www.itpro.com/technology/artificial-intelligence/data-quality-worries-holding-back-manufacturer-ai">research from Riverbed</a> also highlighted data quality as a major factor in AI project failures. In a poll last year, 87% of respondents said that high quality data is critical to AI success, yet more than two-thirds (69%) said they had serious doubts over how effective their firm is at maximizing the use of data. </p><p>The Everpure Data Intelligence problem addresses this challenge directly, as <em>ITPro</em> reported, helping enterprises to map data dependencies and therefore providing AI systems with relevant, contextualized data. </p><p>On a broader front, both Data Stream and the Data Intelligence platforms could play a vital role in helping enterprises push AI projects into full production – an area which many have struggled with in recent years. </p><p><a href="https://www.itpro.com/technology/artificial-intelligence/half-of-agentic-ai-projects-are-still-stuck-at-the-pilot-stage-but-thats-not-stopping-enterprises-from-ramping-up-investment">Research from Dynatrace</a> in January this year found roughly half of agentic AI projects were stuck in proof of concept (PoC) stages, with IT leaders failing to push initiatives into full production.  </p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ Everpure continues data management pivot with new Data Intelligence platform launch  ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Everpure has announced the launch of a new Data Intelligence platform aimed at streamlining storage and data management capabilities, marking its latest post-rebrand pivot. </p><p>Unveiled at the company's annual <a href="https://www.itpro.com/business/business-strategy/what-to-expect-at-everpure-accelerate-2026">Pure Accelerate conference in Las Vegas</a>, the new platform aims to simplify data visibility, control, and management. </p><p>The platform boasts three key capabilities, according to Everpure, including "universal" data discovery features providing heightened visibility into structured and unstructured data, regardless of storage format, the company said.</p><p>Elsewhere, automated governance features aimed at bolstering compliance capabilities, along with data mapping to drive "AI-ready context" for agents, were also touted as key differentiators by Everpure. </p><p>"Everpure Data Intelligence discovers, classifies, and contextualizes enterprise information at its source," the company said in a blog post. </p><p>"It works on all data, inclusive of the Everpure Platform, public clouds, <a href="https://www.itpro.com/cloud/software-as-a-service-saas/362655/what-is-saas">SaaS</a> applications, and third-party storage."</p><h2 id="unlocking-trapped-meaning">Unlocking "trapped meaning"</h2><p>A key focus for the Data Intelligence platform lies in unlocking the trapped meaning in enterprise data, which is often hosted in rigid applications or siloed storage infrastructure. </p><p>Analysis from IDC earlier this year identified data siloes as one of the key hurdles to enterprise AI innovation, and Everpure's position on this front is that they're missing out on vital context by failing to centralize and consolidate data sources. </p><p>This 'context' directly impacts AI outputs, with models and agents relying on poor quality data, separate research from IDC found. The vast majority (94%) of respondents to a recent survey found data quality is "important or very important to AI project success". </p><p>Notably, redundant data, siloed storage architectures, and obsolete data were ranked among the three key contributors to poor data quality. </p><p>With <a href="https://www.itpro.com/technology/artificial-intelligence/is-enterprise-agentic-ai-adoption-matching-the-hype">agentic AI adoption</a> continuing at pace, the need to feed agents accurate and relevant data is now critical, Everpure noted, helping to ultimately improve response accuracy and thereby reducing token costs. </p><h2 id="everpure-s-data-management-pivot">Everpure's data management pivot</h2><p>The move by Everpure builds on its recent acquisition of data management firm 1Touch, embedding key features and capabilities of its own platform. </p><p>In a briefing with assembled media ahead of the event, company executives noted the announcement marked the latest shift in its data management pivot. Everpure first signalled its intention on this front at last year's conference with the launch of its <a href="https://www.itpro.com/cloud/cloud-storage/this-was-a-very-purposeful-strategy-pure-storage-unveils-enterprise-data-cloud-in-bid-to-unify-data-storage-management">Enterprise Data Cloud (EDC)</a>.</p><p>That's not to say storage isn't still the company's key focus, but rather represents a shift based on how enterprise storage architectures are changing in the AI era. </p><p>Prakash Darji, general manager for Everpure's digital experience business unit, told assembled media that "data readiness" is now a key focus for enterprise customers. </p><p>Meanwhile, traditional application-centric architectures, which saw data fed into centralized applications, often trapped critical data and context. Darji highlighted specific functions, like sales or finance, as key examples here. </p><p>"Architectural paradigms have fundamentally started with a single building block over time, and that building block was an application. The data comes from the application, like an ERP or CRM system," he explained. </p><p>"The context, the business rules, the pricing logic, everything's encapsulated within that unit of architecture."</p><p>The result here for enterprises is that they're regularly faced with data bottlenecks and blind spots, requiring a shift toward a "data-centric" architectural model, referred to by the firm as a "data primacy model". </p><p>"In a data primacy model, information is liberated from individual applications to become a shared and governed system of record," the company noted in a blog post.</p><p>A key focus here is to ensure that data is "self-describing" and will "carry its own meaning and logic". </p><p>Rob Lee, chief technology and growth officer at Everpure, said this represents flipping these traditional architectures on their head – and it comes at a time when enterprises are increasingly entering an AI-accelerated world. </p><p>"In a data primacy world, what we're saying is 'hey, Mr and Mrs customer, take control of your data, you own your data, you own how to store that and how it's used, and then the applications need to fit into that," he told assembled media. </p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/data-and-insights/everpure-continues-data-management-pivot-with-new-data-intelligence-platform-launch</link>
                                                                            <description>
                            <![CDATA[ The move by Everpure aims to help enterprises maximize the use of AI-ready data and break down silos ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">TVKSb8Jr3QZPx7GDG9zhNd</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/Sut2btnEyRGrjNxA8XqVbc-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Wed, 17 Jun 2026 13:00:00 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:16:52 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Management]]></category>
                                                    <category><![CDATA[Data and Insights]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Business]]></category>
                                                                                                <author><![CDATA[ ross.kelly@futurenet.com (Ross Kelly) ]]></author>                    <dc:creator><![CDATA[ Ross Kelly ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/Y5vrV2V98Np6jHAGmAtCd3-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Ross Kelly is ITPro&#039;s News &amp;amp; Analysis Editor, with a keen interest in cyber security, business leadership and emerging technologies.&lt;/p&gt;
&lt;p&gt;He graduated from Edinburgh Napier University in 2016 with a BA (Hons) in Journalism, and joined ITPro in 2022 after four years working in technology conference research.&amp;nbsp;&lt;/p&gt;
&lt;p&gt;In his spare time, Ross enjoys cycling, walking and is an avid reader of history and non-fiction.&lt;/p&gt;
&lt;p&gt;You can contact Ross at ross.kelly@futurenet.com or on &lt;a href=&quot;https://twitter.com/rosswritesetc&quot;&gt;Twitter&lt;/a&gt; and &lt;a href=&quot;https://www.linkedin.com/in/ross-kelly-18a54411a/&quot;&gt;LinkedIn&lt;/a&gt;.&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/Sut2btnEyRGrjNxA8XqVbc-1920-80.jpg">
                                                            <media:credit><![CDATA[Everpure/Future]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[The Everpure logo on the ITPro background]]></media:description>                                                            <media:text><![CDATA[The Everpure logo on the ITPro background]]></media:text>
                                <media:title type="plain"><![CDATA[The Everpure logo on the ITPro background]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/Sut2btnEyRGrjNxA8XqVbc-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Everpure has announced the launch of a new Data Intelligence platform aimed at streamlining storage and data management capabilities, marking its latest post-rebrand pivot. </p><p>Unveiled at the company's annual <a href="https://www.itpro.com/business/business-strategy/what-to-expect-at-everpure-accelerate-2026">Pure Accelerate conference in Las Vegas</a>, the new platform aims to simplify data visibility, control, and management. </p><p>The platform boasts three key capabilities, according to Everpure, including "universal" data discovery features providing heightened visibility into structured and unstructured data, regardless of storage format, the company said.</p><p>Elsewhere, automated governance features aimed at bolstering compliance capabilities, along with data mapping to drive "AI-ready context" for agents, were also touted as key differentiators by Everpure. </p><p>"Everpure Data Intelligence discovers, classifies, and contextualizes enterprise information at its source," the company said in a blog post. </p><p>"It works on all data, inclusive of the Everpure Platform, public clouds, <a href="https://www.itpro.com/cloud/software-as-a-service-saas/362655/what-is-saas">SaaS</a> applications, and third-party storage."</p><h2 id="unlocking-trapped-meaning">Unlocking "trapped meaning"</h2><p>A key focus for the Data Intelligence platform lies in unlocking the trapped meaning in enterprise data, which is often hosted in rigid applications or siloed storage infrastructure. </p><p>Analysis from IDC earlier this year identified data siloes as one of the key hurdles to enterprise AI innovation, and Everpure's position on this front is that they're missing out on vital context by failing to centralize and consolidate data sources. </p><p>This 'context' directly impacts AI outputs, with models and agents relying on poor quality data, separate research from IDC found. The vast majority (94%) of respondents to a recent survey found data quality is "important or very important to AI project success". </p><p>Notably, redundant data, siloed storage architectures, and obsolete data were ranked among the three key contributors to poor data quality. </p><p>With <a href="https://www.itpro.com/technology/artificial-intelligence/is-enterprise-agentic-ai-adoption-matching-the-hype">agentic AI adoption</a> continuing at pace, the need to feed agents accurate and relevant data is now critical, Everpure noted, helping to ultimately improve response accuracy and thereby reducing token costs. </p><h2 id="everpure-s-data-management-pivot">Everpure's data management pivot</h2><p>The move by Everpure builds on its recent acquisition of data management firm 1Touch, embedding key features and capabilities of its own platform. </p><p>In a briefing with assembled media ahead of the event, company executives noted the announcement marked the latest shift in its data management pivot. Everpure first signalled its intention on this front at last year's conference with the launch of its <a href="https://www.itpro.com/cloud/cloud-storage/this-was-a-very-purposeful-strategy-pure-storage-unveils-enterprise-data-cloud-in-bid-to-unify-data-storage-management">Enterprise Data Cloud (EDC)</a>.</p><p>That's not to say storage isn't still the company's key focus, but rather represents a shift based on how enterprise storage architectures are changing in the AI era. </p><p>Prakash Darji, general manager for Everpure's digital experience business unit, told assembled media that "data readiness" is now a key focus for enterprise customers. </p><p>Meanwhile, traditional application-centric architectures, which saw data fed into centralized applications, often trapped critical data and context. Darji highlighted specific functions, like sales or finance, as key examples here. </p><p>"Architectural paradigms have fundamentally started with a single building block over time, and that building block was an application. The data comes from the application, like an ERP or CRM system," he explained. </p><p>"The context, the business rules, the pricing logic, everything's encapsulated within that unit of architecture."</p><p>The result here for enterprises is that they're regularly faced with data bottlenecks and blind spots, requiring a shift toward a "data-centric" architectural model, referred to by the firm as a "data primacy model". </p><p>"In a data primacy model, information is liberated from individual applications to become a shared and governed system of record," the company noted in a blog post.</p><p>A key focus here is to ensure that data is "self-describing" and will "carry its own meaning and logic". </p><p>Rob Lee, chief technology and growth officer at Everpure, said this represents flipping these traditional architectures on their head – and it comes at a time when enterprises are increasingly entering an AI-accelerated world. </p><p>"In a data primacy world, what we're saying is 'hey, Mr and Mrs customer, take control of your data, you own your data, you own how to store that and how it's used, and then the applications need to fit into that," he told assembled media. </p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ Don’t throw out BI and data analytics in the race for AI ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Data was once the “new oil”. But artificial intelligence, and above all generative AI, look to be eclipsing data analysis projects for enterprises.</p><p>Gartner, for example, predicts that spending on AI will reach a staggering US$2.52tn this year. That figure includes infrastructure, such as data centres, and spending by hyperscalers and AI vendors, not just enterprises using AI tools. Nonetheless, it represents a 44% increase in 2025, according to the analyst firm.</p><p>This dwarfs investment in business intelligence. Analyst firms put the size of the global BI market at around $40bn annually, and the wider data and analytics market at $175bn. A sizable sum, but nowhere near the spending expected on AI.</p><p>But much AI spending leans heavily on prior investments in data and analytics. Enterprises will need to spend more and invest more time in their data assets if they are to make the most of AI and avoid its pitfalls.</p><h2 id="solid-foundations">Solid foundations</h2><p>Business intelligence and AI share more than the need for good-quality data. Predictive analytics, machine learning, and even robotic process automation (RPA) systems have a lot in common with today’s AI tools, even if they lack user-friendly chatbot interfaces.</p><p>As Carlie Idoine, VP analyst, told an audience at Gartner’s recent Data and Analytics summit, AI is not going to replace BI. Instead, it will extend its capabilities. “I don't think AI is going to kill BI,” she said. “AI and BI are going to learn to work together. It’s not AI or BI; they are better together.”</p><p>As Idoine puts it, business intelligence is not a tool, but a discipline. The fundamentals of business intelligence, including metrics, data lineage, observability, and governance, are all equally important for AI projects. </p><p>Many of the lessons learned around BI and advanced analytics are now being relearned for AI. Data quality is as essential for predictive analytics and machine learning as it is for LLMs.</p><p>Poor quality and fragmented data continue to hold back enterprise decision-making. But companies that invest in the foundations of good data science see a clear return on that investment. Research, again from Gartner, found that poor quality data costs businesses on average $12.9m a year. That figure is from 2020, so it does not factor in the cost of poor decisions or reputational damage caused by AI using poor data.</p><p>“BI and AI both depend on trusted, connected, and well-governed data. Whether organisations are pulling reports on cashflow, forecasting demand through BI tools or using AI agents to automate and execute decisions, they need confidence in the quality, lineage, and context of the data powering those decisions,” Levent Ergin, chief strategist for agentic AI, regulatory compliance, and sustainability at Informatica by Salesforce, told <em>IT Pro.</em></p><p>“A single, trusted data foundation helps businesses deliver more consistent reporting, faster insights, and better decision-making across the enterprise. Without trusted context around the data, organisations risk fragmented analytics, conflicting reports, and reduced confidence in business intelligence insights.” </p><h2 id="questions-of-authority">Questions of authority</h2><p>But business intelligence and data analytics are about more than tidying up data sources. </p><p>BI provides what Gartner’s Idoine describes as “analytic authority” and governance to organisations. Done well, BI brings together enterprises’ systems of record in a single version of the truth, and predictive analytics helps businesses to make decisions around that data source.</p><p>AI will not replace that, or at least, not soon.</p><p> “We have millions of people every day that are in there using their analytics to create their dashboards to do their queries,” Gartner’s Idoine says. “You can't change that kind of thing overnight. You might be able to put in an LLM, and somebody can ask a question, but that's not going to run the reports that we really run our business on. It doesn't quite get us there.”</p><p>Over time, BI and artificial intelligence could converge. Already, organisations are making use of LLMs’ ability to work with natural language so employees can interrogate data without the need to resort to code.</p><p>Drawing insights and making projections from data warehouses and data lakes remains a specialist task, even with the current generation of highly sophisticated BI tools.</p><p>“When we’re looking at the future, users are really looking to solve complex questions,” Julian Sun, VP and team manager at Gartner, told the summit. “They are looking for better decision-making processes, where AI can use all the context saved all in different places, which will eventually give you these context-rich insights. We no longer need a separate BI layer; it’s one platform.”</p><p>Nonetheless, Sun agrees that BI and AI will continue to work together, not least because BI delivers consistent results. AI is notoriously non-deterministic, and so could give different answers to the same question.</p><p>But AI has the advantage when it comes to creating a personalized experience, and drawing on domain knowledge across the business, Sun says. He points to areas such as supply chain analytics, vital to day-to-day operations, but which previously needed expert analysts to process that information.</p><h2 id="joint-forces">Joint forces</h2><p>Industry vendors with a foot in both camps agree. “There is naturally overlap between analytics and AI, but I see analytics as the groundwork rather than a competing capability,” Ash Gawthorp, co-founder and CTO at Ten10, an automation and data consultancy, told <em>IT Pro.</em></p><p>“Most organizations are not short of data, but they often struggle to trust it, connect it across systems or act on it quickly enough to make a meaningful difference,” he adds. He sees enterprises moving away from BI as a narrow reporting tool and towards using data to improve their day-to-day business processes. This is also an area where AI tools can help.</p><p>“Although generative AI attracts much of the attention, traditional machine learning continues to deliver meaningful value across areas such as forecasting, matching, optimisation and classification because the outcomes are often measurable and well understood,” Chris Riche-Webber, VP of business intelligence and analytics at SmartRecruiters, an SAP company, told<em> IT Pro. </em></p><p>“There is naturally a significant amount of overlap between analytics and AI, although I think the relationship is often misunderstood. AI is not a replacement for analytics. If anything, it raises the stakes because organisations are dealing with more complexity, more signals and more information than ever before,” he says.</p><p>If enterprises are to exploit AI’s potential, then they should start with both effective analytics and solid data.</p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/technology/artificial-intelligence/dont-throw-out-bi-and-data-analytics-in-the-race-for-ai</link>
                                                                            <description>
                            <![CDATA[ Analytics and effective data management are even more important as enterprises look for value from their AI investments ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">YbZh3sJcsTQTQ7FTpcApo</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/Hv5eL6mTr2kv7Y4y2nEKmT-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Wed, 27 May 2026 07:00:00 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:16:05 +0000</updated>
                                                                                                                                            <category><![CDATA[Business Intelligence]]></category>
                                                    <category><![CDATA[Artificial Intelligence]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                                                                                    <dc:creator><![CDATA[ Stephen Pritchard ]]></dc:creator>                                                                                                        <dc:description><![CDATA[ null ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/Hv5eL6mTr2kv7Y4y2nEKmT-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[AI vector illustration showing digitized human brain surrounded by digital storage systems. ]]></media:description>                                                            <media:text><![CDATA[AI vector illustration showing digitized human brain surrounded by digital storage systems. ]]></media:text>
                                <media:title type="plain"><![CDATA[AI vector illustration showing digitized human brain surrounded by digital storage systems. ]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/Hv5eL6mTr2kv7Y4y2nEKmT-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Data was once the “new oil”. But artificial intelligence, and above all generative AI, look to be eclipsing data analysis projects for enterprises.</p><p>Gartner, for example, predicts that spending on AI will reach a staggering US$2.52tn this year. That figure includes infrastructure, such as data centres, and spending by hyperscalers and AI vendors, not just enterprises using AI tools. Nonetheless, it represents a 44% increase in 2025, according to the analyst firm.</p><p>This dwarfs investment in business intelligence. Analyst firms put the size of the global BI market at around $40bn annually, and the wider data and analytics market at $175bn. A sizable sum, but nowhere near the spending expected on AI.</p><p>But much AI spending leans heavily on prior investments in data and analytics. Enterprises will need to spend more and invest more time in their data assets if they are to make the most of AI and avoid its pitfalls.</p><h2 id="solid-foundations">Solid foundations</h2><p>Business intelligence and AI share more than the need for good-quality data. Predictive analytics, machine learning, and even robotic process automation (RPA) systems have a lot in common with today’s AI tools, even if they lack user-friendly chatbot interfaces.</p><p>As Carlie Idoine, VP analyst, told an audience at Gartner’s recent Data and Analytics summit, AI is not going to replace BI. Instead, it will extend its capabilities. “I don't think AI is going to kill BI,” she said. “AI and BI are going to learn to work together. It’s not AI or BI; they are better together.”</p><p>As Idoine puts it, business intelligence is not a tool, but a discipline. The fundamentals of business intelligence, including metrics, data lineage, observability, and governance, are all equally important for AI projects. </p><p>Many of the lessons learned around BI and advanced analytics are now being relearned for AI. Data quality is as essential for predictive analytics and machine learning as it is for LLMs.</p><p>Poor quality and fragmented data continue to hold back enterprise decision-making. But companies that invest in the foundations of good data science see a clear return on that investment. Research, again from Gartner, found that poor quality data costs businesses on average $12.9m a year. That figure is from 2020, so it does not factor in the cost of poor decisions or reputational damage caused by AI using poor data.</p><p>“BI and AI both depend on trusted, connected, and well-governed data. Whether organisations are pulling reports on cashflow, forecasting demand through BI tools or using AI agents to automate and execute decisions, they need confidence in the quality, lineage, and context of the data powering those decisions,” Levent Ergin, chief strategist for agentic AI, regulatory compliance, and sustainability at Informatica by Salesforce, told <em>IT Pro.</em></p><p>“A single, trusted data foundation helps businesses deliver more consistent reporting, faster insights, and better decision-making across the enterprise. Without trusted context around the data, organisations risk fragmented analytics, conflicting reports, and reduced confidence in business intelligence insights.” </p><h2 id="questions-of-authority">Questions of authority</h2><p>But business intelligence and data analytics are about more than tidying up data sources. </p><p>BI provides what Gartner’s Idoine describes as “analytic authority” and governance to organisations. Done well, BI brings together enterprises’ systems of record in a single version of the truth, and predictive analytics helps businesses to make decisions around that data source.</p><p>AI will not replace that, or at least, not soon.</p><p> “We have millions of people every day that are in there using their analytics to create their dashboards to do their queries,” Gartner’s Idoine says. “You can't change that kind of thing overnight. You might be able to put in an LLM, and somebody can ask a question, but that's not going to run the reports that we really run our business on. It doesn't quite get us there.”</p><p>Over time, BI and artificial intelligence could converge. Already, organisations are making use of LLMs’ ability to work with natural language so employees can interrogate data without the need to resort to code.</p><p>Drawing insights and making projections from data warehouses and data lakes remains a specialist task, even with the current generation of highly sophisticated BI tools.</p><p>“When we’re looking at the future, users are really looking to solve complex questions,” Julian Sun, VP and team manager at Gartner, told the summit. “They are looking for better decision-making processes, where AI can use all the context saved all in different places, which will eventually give you these context-rich insights. We no longer need a separate BI layer; it’s one platform.”</p><p>Nonetheless, Sun agrees that BI and AI will continue to work together, not least because BI delivers consistent results. AI is notoriously non-deterministic, and so could give different answers to the same question.</p><p>But AI has the advantage when it comes to creating a personalized experience, and drawing on domain knowledge across the business, Sun says. He points to areas such as supply chain analytics, vital to day-to-day operations, but which previously needed expert analysts to process that information.</p><h2 id="joint-forces">Joint forces</h2><p>Industry vendors with a foot in both camps agree. “There is naturally overlap between analytics and AI, but I see analytics as the groundwork rather than a competing capability,” Ash Gawthorp, co-founder and CTO at Ten10, an automation and data consultancy, told <em>IT Pro.</em></p><p>“Most organizations are not short of data, but they often struggle to trust it, connect it across systems or act on it quickly enough to make a meaningful difference,” he adds. He sees enterprises moving away from BI as a narrow reporting tool and towards using data to improve their day-to-day business processes. This is also an area where AI tools can help.</p><p>“Although generative AI attracts much of the attention, traditional machine learning continues to deliver meaningful value across areas such as forecasting, matching, optimisation and classification because the outcomes are often measurable and well understood,” Chris Riche-Webber, VP of business intelligence and analytics at SmartRecruiters, an SAP company, told<em> IT Pro. </em></p><p>“There is naturally a significant amount of overlap between analytics and AI, although I think the relationship is often misunderstood. AI is not a replacement for analytics. If anything, it raises the stakes because organisations are dealing with more complexity, more signals and more information than ever before,” he says.</p><p>If enterprises are to exploit AI’s potential, then they should start with both effective analytics and solid data.</p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ Enterprises are slacking on MySQL database security, and it could come back to haunt them ]]></title>
                                                                                                <dc:content><![CDATA[ <p>One-in-four organisations have exposed <a href="https://www.itpro.com/sql/30242/what-is-sql">MySQL </a>databases, according to new research, prompting calls for more robust developer security practices. </p><p>Intruder’s 2026 Attack Surface Management Index warned these databases are becoming an increasingly attractive target for threat actors, particularly ransomware groups. </p><p>Indeed, the study noted that 16% of Postgres databases are also dangerously exposed, alongside <a href="https://www.itpro.com/mobile/remote-access/368105/what-is-rdp">remote desktop (RDP) services</a>, API documentation, and WordPress admin panels. </p><p>Attack surface exposures were categorized by HTTP panels, ports, services, databases, files and information facing the internet. </p><p>While exposed databases ranked as the leading attack surface issue, more than one-in-seven organizations reported exposed API documentation, ahead of RDP services - a common entry point for ransomware attacks.</p><p>Nearly half of organizations were found to have risky exposed ports and services, with RDP being the most commonly exposed. WordPress Admin (15%) and phpMyAdmin (8%) are also frequently left internet-facing, despite being intended for internal use only.</p><p>Notably, legacy services like SNMP (9%) and UPnP (8%) persist on the public internet, again despite being intended for internal networks.</p><p>Chris Wallis, CEO and founder of Intruder, said the findings should serve as a wake-up call for organizations engaging in risk data management security practices.  </p><p>"Many of the exposures we examined don't even need a CVE to be exploited. For example, an exposed database or admin panel can be compromised through brute force or credential stuffing alone,” he said. </p><h2 id="database-security-in-the-spotlight">Database security in the spotlight</h2><p>Intruder noted that lackluster data security practices come amid a perilous time for enterprises. </p><p>The study warned that the rise of autonomous AI models has slashed the time between vulnerability discovery and exploitation – and many organizations are struggling to keep up.</p><p>Midmarket organizations face the longest remediation times, averaging 56 days to close security gaps, making them nearly four-times slower than smaller enterprises.</p><p>There are stark differences between sectors, with banks remediating exposures in just 11 days and retail just ten, while insurance and pharmaceutical firms average more than 40 days.  </p><p>With <a href="https://www.itpro.com/security/brace-yourselves-for-a-vulnerability-explosion-forescout-warns">vulnerability exploitation expected to skyrocket</a> due to the use of powerful new frontier AI models, Wallis said remediation windows are “open far too long”. </p><p>Security experts globally have issued repeated warnings on this front, particularly since the launch of Anthropic’s Claude Mythos model. </p><p>The company announced a gated release of the model to select industry partners in April amid <a href="https://www.itpro.com/technology/artificial-intelligence/project-glasswing-anthropic-announces-big-tech-consortium-to-test-claude-mythos-ai-model-that-could-reshape-cybersecurity">fears the model could be used for nefarious purposes</a>. </p><p>Wallis said the launch of Mythos has “fundamentally shifted” the cybersecurity landscape, meaning enterprises must now move faster than ever to curtail security risks. </p><p>“The security industry is seeing a major compression in the time between vulnerability discovery and exploitation,” he said. </p><p>“In this high-speed era, leaving a MySQL database or private API documentation exposed to the internet is an open invitation for automated, high-speed extortion.</p><h3 class="article-body__section" id="section-follow-us-on-social-media"><span>FOLLOW US ON SOCIAL MEDIA</span></h3> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/security/enterprises-are-slacking-on-mysql-database-security-and-it-could-come-back-to-haunt-them</link>
                                                                            <description>
                            <![CDATA[ Poor database security practices are leaving organizations at huge risk of compromise ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">8MPj7WaAwwgDzozi86CyxK</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/4XZYfjMuoUwrLG8MTcaQBi-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Wed, 13 May 2026 09:17:08 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:17:07 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Platforms]]></category>
                                                    <category><![CDATA[Security]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                                                                                    <dc:creator><![CDATA[ Emma Woollacott ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/aWfskavxoVSMDy6cDWtYmJ-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ null ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/4XZYfjMuoUwrLG8MTcaQBi-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Cybersecurity concept image showing digital data storage modules with padlock symbols in a storage environment.]]></media:description>                                                            <media:text><![CDATA[Cybersecurity concept image showing digital data storage modules with padlock symbols in a storage environment.]]></media:text>
                                <media:title type="plain"><![CDATA[Cybersecurity concept image showing digital data storage modules with padlock symbols in a storage environment.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/4XZYfjMuoUwrLG8MTcaQBi-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>One-in-four organisations have exposed <a href="https://www.itpro.com/sql/30242/what-is-sql">MySQL </a>databases, according to new research, prompting calls for more robust developer security practices. </p><p>Intruder’s 2026 Attack Surface Management Index warned these databases are becoming an increasingly attractive target for threat actors, particularly ransomware groups. </p><p>Indeed, the study noted that 16% of Postgres databases are also dangerously exposed, alongside <a href="https://www.itpro.com/mobile/remote-access/368105/what-is-rdp">remote desktop (RDP) services</a>, API documentation, and WordPress admin panels. </p><p>Attack surface exposures were categorized by HTTP panels, ports, services, databases, files and information facing the internet. </p><p>While exposed databases ranked as the leading attack surface issue, more than one-in-seven organizations reported exposed API documentation, ahead of RDP services - a common entry point for ransomware attacks.</p><p>Nearly half of organizations were found to have risky exposed ports and services, with RDP being the most commonly exposed. WordPress Admin (15%) and phpMyAdmin (8%) are also frequently left internet-facing, despite being intended for internal use only.</p><p>Notably, legacy services like SNMP (9%) and UPnP (8%) persist on the public internet, again despite being intended for internal networks.</p><p>Chris Wallis, CEO and founder of Intruder, said the findings should serve as a wake-up call for organizations engaging in risk data management security practices.  </p><p>"Many of the exposures we examined don't even need a CVE to be exploited. For example, an exposed database or admin panel can be compromised through brute force or credential stuffing alone,” he said. </p><h2 id="database-security-in-the-spotlight">Database security in the spotlight</h2><p>Intruder noted that lackluster data security practices come amid a perilous time for enterprises. </p><p>The study warned that the rise of autonomous AI models has slashed the time between vulnerability discovery and exploitation – and many organizations are struggling to keep up.</p><p>Midmarket organizations face the longest remediation times, averaging 56 days to close security gaps, making them nearly four-times slower than smaller enterprises.</p><p>There are stark differences between sectors, with banks remediating exposures in just 11 days and retail just ten, while insurance and pharmaceutical firms average more than 40 days.  </p><p>With <a href="https://www.itpro.com/security/brace-yourselves-for-a-vulnerability-explosion-forescout-warns">vulnerability exploitation expected to skyrocket</a> due to the use of powerful new frontier AI models, Wallis said remediation windows are “open far too long”. </p><p>Security experts globally have issued repeated warnings on this front, particularly since the launch of Anthropic’s Claude Mythos model. </p><p>The company announced a gated release of the model to select industry partners in April amid <a href="https://www.itpro.com/technology/artificial-intelligence/project-glasswing-anthropic-announces-big-tech-consortium-to-test-claude-mythos-ai-model-that-could-reshape-cybersecurity">fears the model could be used for nefarious purposes</a>. </p><p>Wallis said the launch of Mythos has “fundamentally shifted” the cybersecurity landscape, meaning enterprises must now move faster than ever to curtail security risks. </p><p>“The security industry is seeing a major compression in the time between vulnerability discovery and exploitation,” he said. </p><p>“In this high-speed era, leaving a MySQL database or private API documentation exposed to the internet is an open invitation for automated, high-speed extortion.</p><h3 class="article-body__section" id="section-follow-us-on-social-media"><span>FOLLOW US ON SOCIAL MEDIA</span></h3>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ How EDF is making the most of its data with Snowflake ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Alex Read, senior enterprise product manager for data at energy provider EDF UK, is charged with helping his organization make the most of its information assets. Perhaps unsurprisingly, the hottest technology topic and the issue his bosses raise the most, is exploiting AI.</p><p>“It’s at a point where there are visions at an executive level of where AI is infused throughout our technical services and capabilities,” he says. “Our job as data and technology experts is to understand where we can deliver the most value, and also make sure that what we're doing, from an enablement perspective, is designed to be adopted and operationalized at scale.” </p><p>Read says it’s a responsibility he relishes, describing the demands of his role as fast and varied. As part of the enterprise IT function, Read helps over 1,000 users across the business to make the most of the EDF UK’s data tools. His team sits at the heart of a federated hub-and-spoke model, where they focus on enablement and business units concentrate on value.</p><p>“I'm accountable for the tooling, architecture, and common services-type capabilities in data and <a href="https://www.itpro.com/business-intelligence/28220/what-is-data-analytics"><u>analytics</u></a>,” he says. “Then in the federated business units, they're on the hook for data products and value extraction. They have teams of <a href="https://www.itpro.com/business-strategy/careers-training/30344/what-does-a-data-engineer-do"><u>data engineers</u></a>, <a href="https://www.itpro.com/business-strategy/careers-training/357656/how-to-become-a-data-scientist"><u>data scientists</u></a>, and ML Ops engineers, who are building data, AI, and ML products that create value for EDF UK.”</p><p>Read adds the federated approach gives his business “the best of both worlds” – one data platform across EDF UK that creates a consistent approach to information, and product teams in organizational functions that are naturally closer to business value.</p><p>“That's the sweet spot we've found,” says Read, who explains how the Snowflake AI Data Cloud is the heart of his organization’s data approach. The platform provides a single, consistent one-stop shop for hundreds of potential data sources. </p><p>“The data needs to be available at a cadence that can be used to operationalize near-real-time use cases,” he says. “So, we've got things like dynamic tables and event-driven architectures that enable that data to be brought onto the platform.”</p><p>Snowflake forms part of an integrated data stack that includes dbt, Matillion, <a href="https://www.itpro.com/technology/artificial-intelligence/aws-goes-all-in-on-ai-agents-with-new-features-for-bedrock-and-amazon-q"><u>Amazon Bedrock</u></a>, and <a href="https://www.itpro.com/technology/artificial-intelligence/aws-distances-itself-from-google-microsoft-with-unique-approach-to-generative-ai"><u>Sagemaker</u></a>. Read says people across the organization can use the tools within the stack depending on their role, function, and projects: “Data stacks serve multiple personas – that’s the easiest way to describe it.” </p><p>With solid foundations in place, Read’s team has started enabling the structures that allow the rest of the business to exploit AI and ML. The next step is to ensure enterprise data is high-quality and well-defined so that emerging technologies know its context.</p><p>“We’ve got Snowflake services we're using, like Semantic Tables and Horizon Data Catalogs, whereby we're defining our data assets and making sure they're understandable to <a href="https://www.itpro.com/technology/artificial-intelligence/its-make-or-break-for-ai-agents-in-2026-failure-now-could-set-adoption-back-years"><u>AI agents</u></a>,” he says. “And then, we're building capabilities via Cortex Analyst and Cortex Code on top of that platform.” </p><p>The results of this construction process are becoming visible across the organization. The data platform already supports data initiatives across EDF UK’s Retail, Business, Wholesale Markets, Finance, and Zero Carbon Homes divisions. In Wholesale Markets, the company is rebuilding its volume forecasting platform, the analytics engine behind purchasing and hedging decisions in an energy market worth more than $13.53 billion (£10 billion), on Snowflake.</p><p>“That's about taking data from industry flows, weather providers, and internal retail and business solution consumption patterns,” he says. “We're essentially building forecasts in AI models, whereby we will be able to forecast <a href="https://www.itpro.com/infrastructure/the-power-challenges-uk-data-centers-face"><u>the amount of energy required across the market</u></a>. As these are such big numbers, even small percentage improvements in the margin of error and your ability to forecast, price, and hedge can create significant financial benefits.”</p><p>While those data-enabled efforts take place behind the scenes, Read’s team is also pursuing significant customer-facing initiatives. One major driver for these initiatives is the Market-Wide Half-Hourly Settlement, a program of industry reforms led by energy regulator Ofgem, which aims to provide a more accurate picture of electricity consumption across the UK.</p><p>Read says the regulations have inspired EDF UK to engage with data and explore innovative billing techniques. FreePhase, for instance, offers three pricing bands that reward customers who shift their usage to lower-cost periods. “You can't create those kinds of products without the ability to access data at a fine granularity,” he says.</p><iframe allow="" height="200px" width="100%" id="" style="" class="position-center" data-lazy-priority="low" data-lazy-src="https://player.captivate.fm/episode/8a9416ee-5de8-4334-b12a-8794d2625cd7/" src="https://player.captivate.fm/episode/8a9416ee-5de8-4334-b12a-8794d2625cd7/"></iframe><p>Another example of an innovative billing technique is the Sunday Saver Challenge, EDF UK’s smart meter-enabled program that rewards customers with up to 16 hours of free electricity on Sundays when they shift weekday energy use from peak demand periods, easing pressure on the grid. </p><p>Customers contact the firm with questions about the challenge, such as its rules and benefits. Now, Read is using agentic AI to help service center staff deal with these queries effectively. His team is developing an agent using Snowflake Cortex technology that pulls information from the data platform and presents insight in the staff’s <a href="https://www.itpro.com/software/slack-is-now-the-key-to-salesforces-agentic-ai-plans"><u>Slack</u></a> user interface.</p><p>“The agent is being built as we speak, and is pretty close to being productionized on Cortex,” he says. “That agent will automate a lot of the questions being answered by our energy specialists. A customer query will be automated against Snowflake. So, essentially, they’ll be talking to the data on the platform to answer questions.”</p><p>At a time when <a href="https://www.itpro.com/technology/artificial-intelligence/half-of-agentic-ai-projects-are-still-stuck-at-the-pilot-stage-but-thats-not-stopping-enterprises-from-ramping-up-investment"><u>many businesses struggle to turn agentic explorations into production services</u></a>, the developments from Read’s team demonstrate the potential power of AI to boost internal operations and customer services. The key lesson for other digital leaders is to spend time on delivering the right outcomes.</p><p>“Snowflake comes highly integrated out of the box, and a minimal number of vendors are required to get to value,” he says. “And that's what our focus has been, and that has been the key lesson from this transformation – remove any barriers that get in the way of delivering value quickly.”</p><p>The result is that a business eager to reap the benefits of AI-enabled innovation is beginning to adopt and operationalize data-powered services at scale. Read reflects on progress so far and paints a picture of data and AI-enabled services at EDF UK in the future. </p><p>“Snowflake will be serving near real-time use cases via its platform with data that is of acceptable quality, defined, catalogued, and accessible to AI models, which have touchpoints out into the wider operation,” he says. “People of all skill sets and personas will have AI tools in their hands, fed by Snowflake. I think that's what good looks like for us.”</p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/data-and-insights/how-edf-is-making-the-most-of-its-data-with-snowflake</link>
                                                                            <description>
                            <![CDATA[ Alex Read, senior enterprise product manager for data at EDF UK, explains how EDF is unlocking tangible gains from its data ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">MMpcGCDSHQh8zRroaRUCtm</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/MEpByYvhHBTeAwYuSLRFFn-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Tue, 12 May 2026 09:15:37 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:17:16 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Platforms]]></category>
                                                    <category><![CDATA[Data and Insights]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Business]]></category>
                                                                                                                    <dc:creator><![CDATA[ Mark Samuels ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/rfAoiWsTvmT4koiuWLLZBi-320-70.jpeg ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Mark Samuels is a freelance writer specializing in business and technology. For the past two decades, he has produced extensive work on subjects such as the adoption of technology by C-suite executives.&lt;/p&gt;&lt;p&gt;At ITPro, Mark has provided long-form content on C-suite strategy, particularly relating to chief information officers (CIOs), as well as digital transformation case studies, and explainers on cloud computing architecture.&lt;/p&gt;&lt;p&gt;Mark has written for publications including The Guardian, ZDNet, TechRepublic, Times Higher Education, and CIONET. He started working as a staff writer at Computing in 2000, where he later became the publication’s features editor. In 2008, he took charge of the brand’s monthly supplement Computing Business alongside his features responsibilities.&lt;/p&gt;&lt;p&gt;From 2008 to 2014, Mark was also editor of the membership magazine for IT leadership forum CIO Connect. As part of the role, Mark oversaw the editorial content for CIO Connect, edited research reports, and maintained an extensive network of industry experts.&lt;/p&gt;&lt;p&gt;Before his career in journalism, Mark achieved a BA in geography and MSc in World Space Economy at the University of Birmingham, as well as a PhD in economic geography at the University of Sheffield.&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/MEpByYvhHBTeAwYuSLRFFn-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[The EDF logo shown on a smartphone in front of an abstract background of beams of light.]]></media:description>                                                            <media:text><![CDATA[The EDF logo shown on a smartphone in front of an abstract background of beams of light.]]></media:text>
                                <media:title type="plain"><![CDATA[The EDF logo shown on a smartphone in front of an abstract background of beams of light.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/MEpByYvhHBTeAwYuSLRFFn-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Alex Read, senior enterprise product manager for data at energy provider EDF UK, is charged with helping his organization make the most of its information assets. Perhaps unsurprisingly, the hottest technology topic and the issue his bosses raise the most, is exploiting AI.</p><p>“It’s at a point where there are visions at an executive level of where AI is infused throughout our technical services and capabilities,” he says. “Our job as data and technology experts is to understand where we can deliver the most value, and also make sure that what we're doing, from an enablement perspective, is designed to be adopted and operationalized at scale.” </p><p>Read says it’s a responsibility he relishes, describing the demands of his role as fast and varied. As part of the enterprise IT function, Read helps over 1,000 users across the business to make the most of the EDF UK’s data tools. His team sits at the heart of a federated hub-and-spoke model, where they focus on enablement and business units concentrate on value.</p><p>“I'm accountable for the tooling, architecture, and common services-type capabilities in data and <a href="https://www.itpro.com/business-intelligence/28220/what-is-data-analytics"><u>analytics</u></a>,” he says. “Then in the federated business units, they're on the hook for data products and value extraction. They have teams of <a href="https://www.itpro.com/business-strategy/careers-training/30344/what-does-a-data-engineer-do"><u>data engineers</u></a>, <a href="https://www.itpro.com/business-strategy/careers-training/357656/how-to-become-a-data-scientist"><u>data scientists</u></a>, and ML Ops engineers, who are building data, AI, and ML products that create value for EDF UK.”</p><p>Read adds the federated approach gives his business “the best of both worlds” – one data platform across EDF UK that creates a consistent approach to information, and product teams in organizational functions that are naturally closer to business value.</p><p>“That's the sweet spot we've found,” says Read, who explains how the Snowflake AI Data Cloud is the heart of his organization’s data approach. The platform provides a single, consistent one-stop shop for hundreds of potential data sources. </p><p>“The data needs to be available at a cadence that can be used to operationalize near-real-time use cases,” he says. “So, we've got things like dynamic tables and event-driven architectures that enable that data to be brought onto the platform.”</p><p>Snowflake forms part of an integrated data stack that includes dbt, Matillion, <a href="https://www.itpro.com/technology/artificial-intelligence/aws-goes-all-in-on-ai-agents-with-new-features-for-bedrock-and-amazon-q"><u>Amazon Bedrock</u></a>, and <a href="https://www.itpro.com/technology/artificial-intelligence/aws-distances-itself-from-google-microsoft-with-unique-approach-to-generative-ai"><u>Sagemaker</u></a>. Read says people across the organization can use the tools within the stack depending on their role, function, and projects: “Data stacks serve multiple personas – that’s the easiest way to describe it.” </p><p>With solid foundations in place, Read’s team has started enabling the structures that allow the rest of the business to exploit AI and ML. The next step is to ensure enterprise data is high-quality and well-defined so that emerging technologies know its context.</p><p>“We’ve got Snowflake services we're using, like Semantic Tables and Horizon Data Catalogs, whereby we're defining our data assets and making sure they're understandable to <a href="https://www.itpro.com/technology/artificial-intelligence/its-make-or-break-for-ai-agents-in-2026-failure-now-could-set-adoption-back-years"><u>AI agents</u></a>,” he says. “And then, we're building capabilities via Cortex Analyst and Cortex Code on top of that platform.” </p><p>The results of this construction process are becoming visible across the organization. The data platform already supports data initiatives across EDF UK’s Retail, Business, Wholesale Markets, Finance, and Zero Carbon Homes divisions. In Wholesale Markets, the company is rebuilding its volume forecasting platform, the analytics engine behind purchasing and hedging decisions in an energy market worth more than $13.53 billion (£10 billion), on Snowflake.</p><p>“That's about taking data from industry flows, weather providers, and internal retail and business solution consumption patterns,” he says. “We're essentially building forecasts in AI models, whereby we will be able to forecast <a href="https://www.itpro.com/infrastructure/the-power-challenges-uk-data-centers-face"><u>the amount of energy required across the market</u></a>. As these are such big numbers, even small percentage improvements in the margin of error and your ability to forecast, price, and hedge can create significant financial benefits.”</p><p>While those data-enabled efforts take place behind the scenes, Read’s team is also pursuing significant customer-facing initiatives. One major driver for these initiatives is the Market-Wide Half-Hourly Settlement, a program of industry reforms led by energy regulator Ofgem, which aims to provide a more accurate picture of electricity consumption across the UK.</p><p>Read says the regulations have inspired EDF UK to engage with data and explore innovative billing techniques. FreePhase, for instance, offers three pricing bands that reward customers who shift their usage to lower-cost periods. “You can't create those kinds of products without the ability to access data at a fine granularity,” he says.</p><iframe allow="" height="200px" width="100%" id="" style="" class="position-center" data-lazy-priority="low" data-lazy-src="https://player.captivate.fm/episode/8a9416ee-5de8-4334-b12a-8794d2625cd7/" src="https://player.captivate.fm/episode/8a9416ee-5de8-4334-b12a-8794d2625cd7/"></iframe><p>Another example of an innovative billing technique is the Sunday Saver Challenge, EDF UK’s smart meter-enabled program that rewards customers with up to 16 hours of free electricity on Sundays when they shift weekday energy use from peak demand periods, easing pressure on the grid. </p><p>Customers contact the firm with questions about the challenge, such as its rules and benefits. Now, Read is using agentic AI to help service center staff deal with these queries effectively. His team is developing an agent using Snowflake Cortex technology that pulls information from the data platform and presents insight in the staff’s <a href="https://www.itpro.com/software/slack-is-now-the-key-to-salesforces-agentic-ai-plans"><u>Slack</u></a> user interface.</p><p>“The agent is being built as we speak, and is pretty close to being productionized on Cortex,” he says. “That agent will automate a lot of the questions being answered by our energy specialists. A customer query will be automated against Snowflake. So, essentially, they’ll be talking to the data on the platform to answer questions.”</p><p>At a time when <a href="https://www.itpro.com/technology/artificial-intelligence/half-of-agentic-ai-projects-are-still-stuck-at-the-pilot-stage-but-thats-not-stopping-enterprises-from-ramping-up-investment"><u>many businesses struggle to turn agentic explorations into production services</u></a>, the developments from Read’s team demonstrate the potential power of AI to boost internal operations and customer services. The key lesson for other digital leaders is to spend time on delivering the right outcomes.</p><p>“Snowflake comes highly integrated out of the box, and a minimal number of vendors are required to get to value,” he says. “And that's what our focus has been, and that has been the key lesson from this transformation – remove any barriers that get in the way of delivering value quickly.”</p><p>The result is that a business eager to reap the benefits of AI-enabled innovation is beginning to adopt and operationalize data-powered services at scale. Read reflects on progress so far and paints a picture of data and AI-enabled services at EDF UK in the future. </p><p>“Snowflake will be serving near real-time use cases via its platform with data that is of acceptable quality, defined, catalogued, and accessible to AI models, which have touchpoints out into the wider operation,” he says. “People of all skill sets and personas will have AI tools in their hands, fed by Snowflake. I think that's what good looks like for us.”</p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ How AI is transforming enterprise data ]]></title>
                                                                                                <dc:content><![CDATA[ <iframe allow="" height="200px" width="100%" id="" style="" class="position-center" data-lazy-priority="low" data-lazy-src="https://player.captivate.fm/episode/db98e7d4-39e3-4dfe-bdfa-e05ab9c11b6d/" src="https://player.captivate.fm/episode/db98e7d4-39e3-4dfe-bdfa-e05ab9c11b6d/"></iframe><p>It’s long been said that good data is necessary before you can have good AI. But to an increasing degree, AI is also helping businesses manage, analyze, and generate their data too.</p><p>With AI code generation already well understood, businesses are also leaning on natural language processing and agentic AI to help their experts such as data engineers and data scientists automate their work more effectively.</p><p>What does all this mean for businesses looking to adopt AI? And how is the UK AI market maturing?</p><p>In this episode, recorded on the ground at Databricks AI Days London 2026, Rory speaks to Michael Green, UK&amp;I managing director at Databricks and Richard Shaw, AVP Field Engineering at Databricks, to better understand how data and AI are converging.</p><h2 id="highlights-3">Highlights</h2><p>"Historically, if you look in organizations, people look at things as complex, you're going to need technical teams, you're going to need a data analyst team. And also, there was a timeframe attached to it as well that people, if they wanted that information readily, they'd have to go and speak to that team. They might not get the report back for 24, 48, hours, sometimes days, if not weeks. Actually, depending what it is, natural language has broken that down. It's putting the power into the hands of the business. Putting that power into the hands of the C-suite."</p><p>"Deterministic versus non deterministic is really what what companies are really interested in. Am I going to get the same result with the same question two times? Can I then trust it? Going back a few years, the approach was, some customers would say we're always going to have a human in the loop at this point. That used to happen when cars first hit the road, you'd have person walking in front of me with a flag. But that's not scalable, and you can only have so many people checking the output of these systems."</p><p>"We talk about democratizing data and AI, we often reference that, it's putting that into the hands of their organization. Going back to that point, I said about having my internal LLM, using their data that they've had locked and hidden away for years. So organizations, whether they're new to market, digital natives, or whether we've got large based enterprises that have been around for decades, success for those organizations is unlocking the data, making sure that it's completely governed, it's seure, and then using generative AI and moving into the next modern area of the world to actually drive that value and be a game changer within the market."</p><h2 id="footnotes">Footnotes</h2><ul><li><a href="https://www.itpro.com/machine-learning/33308/what-is-natural-language-processing" target="_blank">What is natural language processing?</a></li><li><a href="https://www.itpro.com/business/business-strategy/a-true-vote-of-confidence-databricks-announces-usd850m-uk-investment-as-firm-looks-to-quadruple-london-office-footprint" target="_blank">‘A true vote of confidence’: Databricks announces $850m UK investment as firm looks to quadruple London office footprint</a></li><li><a href="https://www.itpro.com/business/we-want-ai-to-work-for-britain-the-uk-government-wants-to-upskill-10-million-people-in-ai-by-2030-and-the-courses-are-free-to-access" target="_blank">"We want AI to work for Britain": The UK government wants to upskill 10 million Brits in AI by 2030 – and the courses are free to access</a></li><li><a href="https://www.itpro.com/technology/artificial-intelligence/the-uks-ai-ambitions-depend-on-channel-partners" target="_blank">The UK’s AI ambitions depend on channel partners</a></li><li><a href="https://www.itpro.com/business/business-strategy/microsoft-says-fear-of-falling-behind-is-driving-an-ai-arms-race-among-uk-businesses-and-its-fueling-record-adoption-rates" target="_blank">Microsoft says fear of falling behind is driving an AI arms race among UK businesses – and it's fueling record adoption rates</a></li><li><a href="https://www.itpro.com/business/careers-and-training/databricks-wants-to-train-100-000-people-in-ai-across-the-uk-and-ireland-heres-how-to-get-involved" target="_blank">Databricks wants to train 100,000 people in AI across the UK and Ireland – here's how to get involved</a></li></ul><h2 id="subscribe">Subscribe </h2><ul><li><a href="https://apple.sjv.io/c/221109/473657/7613?subId1=itpro-gb-1243831151189624600&amp;sharedId=itpro-gb&amp;u=https%3A%2F%2Fpodcasts.apple.com%2Fgb%2Fpodcast%2Fthe-itpro-podcast%2Fid1483810154" target="_blank"><u>Subscribe to The IT Pro Podcast on Apple Podcasts</u></a></li><li><a href="https://open.spotify.com/show/7HpYehTy752KmtbwpOAgRZ" target="_blank"><u>Subscribe to The IT Pro Podcast on Spotify</u></a></li><li><a href="https://www.itpro.co.uk/newsletter-signup"><u>Subscribe to the IT Pro newsletter</u></a></li><li><a href="https://uk.linkedin.com/company/itpro-uk" target="_blank"><u>Join us on LinkedIn</u></a></li></ul> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/technology/artificial-intelligence/how-ai-is-transforming-enterprise-data</link>
                                                                            <description>
                            <![CDATA[ With natural language processing, data engineers can explore enterprise data with more ease than ever ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">YTHkZp2suvoQjJYtLLXzr8</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/7DQC9UXxvEQDZ99uYaH2G-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Fri, 03 Apr 2026 06:35:00 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:15:42 +0000</updated>
                                                                                                                                            <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Artificial Intelligence]]></category>
                                                                                                <author><![CDATA[ rory.bathgate@futurenet.com (Rory Bathgate) ]]></author>                    <dc:creator><![CDATA[ Rory Bathgate ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/Vep5JogbPhduK7R6CUWAm6-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Rory Bathgate was the Features and Multimedia Editor at ITPro until 2026, overseeing all in-depth content and case studies. Throughout his time at ITPro, Rory  charted the rise in popularity of generative AI and specifically companies such as Microsoft, OpenAI, and Google. &lt;/p&gt;&lt;p&gt;Alongside this, he delved into increasing calls for ethical and responsible AI as global legislators circle the technology, as well as the latest in mobile networking technology, from 5G mmWave to the 3G sunset and how it will affect businesses.&lt;/p&gt;&lt;p&gt;He  provided coverage from high-profile tech conferences such as Dell Technologies World, SuiteWorld, and VMware Explore Europe. His on-the-ground coverage  included live blogs, extensive daily coverage of the most significant announcements, analysis pieces, and podcast.&lt;/p&gt;&lt;p&gt;Rory was the co-host of the ITPro Podcast alongside Jane McCallion, where he swapped a keyboard for a microphone to discuss the latest learnings in tech.&lt;/p&gt;&lt;p&gt;Rory has an MA in Eighteenth-Century Studies from King’s College London, as well as a BA in English and American Literature from the University of Kent. He joined ITPro in 2022 as a graduate, after four years in student journalism.&lt;/p&gt;&lt;p&gt;In his free time, Rory enjoys photography and video editing, and can often be found at the cinema or reading a good science fiction paperback.&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/7DQC9UXxvEQDZ99uYaH2G-1920-80.jpg">
                                                            <media:credit><![CDATA[Future]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[The text &quot;How AI is transforming enterprise data&quot; against a noisy, purple sankey diagram. The words &quot;AI&quot; and &quot;enterprise data&quot; are in yellow, the rest are in white. In the bottom-right corner, the ITPro Podcast logo is shown.]]></media:description>                                                            <media:text><![CDATA[The text &quot;How AI is transforming enterprise data&quot; against a noisy, purple sankey diagram. The words &quot;AI&quot; and &quot;enterprise data&quot; are in yellow, the rest are in white. In the bottom-right corner, the ITPro Podcast logo is shown.]]></media:text>
                                <media:title type="plain"><![CDATA[The text &quot;How AI is transforming enterprise data&quot; against a noisy, purple sankey diagram. The words &quot;AI&quot; and &quot;enterprise data&quot; are in yellow, the rest are in white. In the bottom-right corner, the ITPro Podcast logo is shown.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/7DQC9UXxvEQDZ99uYaH2G-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <iframe allow="" height="200px" width="100%" id="" style="" class="position-center" data-lazy-priority="low" data-lazy-src="https://player.captivate.fm/episode/db98e7d4-39e3-4dfe-bdfa-e05ab9c11b6d/" src="https://player.captivate.fm/episode/db98e7d4-39e3-4dfe-bdfa-e05ab9c11b6d/"></iframe><p>It’s long been said that good data is necessary before you can have good AI. But to an increasing degree, AI is also helping businesses manage, analyze, and generate their data too.</p><p>With AI code generation already well understood, businesses are also leaning on natural language processing and agentic AI to help their experts such as data engineers and data scientists automate their work more effectively.</p><p>What does all this mean for businesses looking to adopt AI? And how is the UK AI market maturing?</p><p>In this episode, recorded on the ground at Databricks AI Days London 2026, Rory speaks to Michael Green, UK&amp;I managing director at Databricks and Richard Shaw, AVP Field Engineering at Databricks, to better understand how data and AI are converging.</p><h2 id="highlights-3">Highlights</h2><p>"Historically, if you look in organizations, people look at things as complex, you're going to need technical teams, you're going to need a data analyst team. And also, there was a timeframe attached to it as well that people, if they wanted that information readily, they'd have to go and speak to that team. They might not get the report back for 24, 48, hours, sometimes days, if not weeks. Actually, depending what it is, natural language has broken that down. It's putting the power into the hands of the business. Putting that power into the hands of the C-suite."</p><p>"Deterministic versus non deterministic is really what what companies are really interested in. Am I going to get the same result with the same question two times? Can I then trust it? Going back a few years, the approach was, some customers would say we're always going to have a human in the loop at this point. That used to happen when cars first hit the road, you'd have person walking in front of me with a flag. But that's not scalable, and you can only have so many people checking the output of these systems."</p><p>"We talk about democratizing data and AI, we often reference that, it's putting that into the hands of their organization. Going back to that point, I said about having my internal LLM, using their data that they've had locked and hidden away for years. So organizations, whether they're new to market, digital natives, or whether we've got large based enterprises that have been around for decades, success for those organizations is unlocking the data, making sure that it's completely governed, it's seure, and then using generative AI and moving into the next modern area of the world to actually drive that value and be a game changer within the market."</p><h2 id="footnotes">Footnotes</h2><ul><li><a href="https://www.itpro.com/machine-learning/33308/what-is-natural-language-processing" target="_blank">What is natural language processing?</a></li><li><a href="https://www.itpro.com/business/business-strategy/a-true-vote-of-confidence-databricks-announces-usd850m-uk-investment-as-firm-looks-to-quadruple-london-office-footprint" target="_blank">‘A true vote of confidence’: Databricks announces $850m UK investment as firm looks to quadruple London office footprint</a></li><li><a href="https://www.itpro.com/business/we-want-ai-to-work-for-britain-the-uk-government-wants-to-upskill-10-million-people-in-ai-by-2030-and-the-courses-are-free-to-access" target="_blank">"We want AI to work for Britain": The UK government wants to upskill 10 million Brits in AI by 2030 – and the courses are free to access</a></li><li><a href="https://www.itpro.com/technology/artificial-intelligence/the-uks-ai-ambitions-depend-on-channel-partners" target="_blank">The UK’s AI ambitions depend on channel partners</a></li><li><a href="https://www.itpro.com/business/business-strategy/microsoft-says-fear-of-falling-behind-is-driving-an-ai-arms-race-among-uk-businesses-and-its-fueling-record-adoption-rates" target="_blank">Microsoft says fear of falling behind is driving an AI arms race among UK businesses – and it's fueling record adoption rates</a></li><li><a href="https://www.itpro.com/business/careers-and-training/databricks-wants-to-train-100-000-people-in-ai-across-the-uk-and-ireland-heres-how-to-get-involved" target="_blank">Databricks wants to train 100,000 people in AI across the UK and Ireland – here's how to get involved</a></li></ul><h2 id="subscribe">Subscribe </h2><ul><li><a href="https://apple.sjv.io/c/221109/473657/7613?subId1=itpro-gb-1243831151189624600&amp;sharedId=itpro-gb&amp;u=https%3A%2F%2Fpodcasts.apple.com%2Fgb%2Fpodcast%2Fthe-itpro-podcast%2Fid1483810154" target="_blank"><u>Subscribe to The IT Pro Podcast on Apple Podcasts</u></a></li><li><a href="https://open.spotify.com/show/7HpYehTy752KmtbwpOAgRZ" target="_blank"><u>Subscribe to The IT Pro Podcast on Spotify</u></a></li><li><a href="https://www.itpro.co.uk/newsletter-signup"><u>Subscribe to the IT Pro newsletter</u></a></li><li><a href="https://uk.linkedin.com/company/itpro-uk" target="_blank"><u>Join us on LinkedIn</u></a></li></ul>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ How Microsoft is targeting disparate data to boost AI adoption ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Microsoft is consolidating data management and data ontology to support the expansion of agentic AI, with new tools intended to make data analytics, labelling, and context sharing easier than ever. </p><p>At FabCon and SQLCon 2026, held in Atlanta, the tech giant unveiled two new expansions for its SaaS analytics platform Microsoft Fabric. </p><p>Database Hub is a new unified database management plane for Microsoft Fabric, with built-in AI agents and <a href="https://www.itpro.com/software/windows/microsoft-is-rolling-back-unnecessary-copilot-features-on-windows"><u>Microsoft Copilot</u></a> allowing for natural language exploration of enterprise data across Azure SQL, Azure Cosmos DB, <a href="https://www.itpro.com/databases/34533/what-is-azure-database-for-postgresql"><u>Azure Database for PostgreSQL</u></a>, and others. </p><p>Microsoft is also expanding the extent to which enterprises can ground AI in business context through <a href="https://www.itpro.com/technology/artificial-intelligence/microsoft-unveils-foundry-overhaul-for-managing-optimizing-ai-agents"><u>Fabric IQ</u></a>, with new semantic and ontological controls supported through a new <a href="https://www.itpro.com/technology/artificial-intelligence/what-is-model-context-protocol-mcp"><u>model context protocol (MCP)</u></a> server in preview. </p><p><em>ITPro</em> spoke to Amir Netz, CTO of Microsoft Fabric, to understand the context for the announcements and the problems Microsoft is looking to solve at the data layer. </p><p>Netz is one of the original creators of the data analytics and visualization suite <a href="https://www.itpro.com/business-intelligence/29132/the-best-business-intelligence-tool-tableau-vs-microsoft-power-bi-1">Power BI,</a> which started life as Power Pivot and Power Query within Microsoft Excel. </p><p>He told <em>ITPro</em> he is “incredibly happy” with the uptake in the years since, and that his team has now turned its attention to further consolidating and easing the process of data retrieval and analytics.  </p><p>The goal, he noted, is to do for data what Microsoft Office did for productivity, by rolling multiple products into one.</p><p>“You would never think about buying Google Sheets and using it with Word, that seems kind of ludicrous, because the power of integration is amazing and people really appreciate integration over almost any other feature you can have in a suite. </p><p>“And the world of data is so complex, and so fragmented, that when we came with Fabric we said, ‘we want to really do what Office did for productivity, we want to do with data’.” </p><p>This involved taking approximately 20 distinct data services at Microsoft and integrating them into a single product to meet enterprise data workload needs, Netz explained. It includes batch data, streaming data, data warehousing, business intelligence, machine learning, Internet of Things (IoT), and data lakes. </p><p>Netz added that 90% of the Fortune 500 now uses Fabric, with revenue and users on the rise.</p><h2 id="fabric-iq-and-onelake">Fabric, IQ, and OneLake</h2><p>In 2023, <a href="https://www.itpro.com/software/microsoft/microsoft-build-2023-microsoft-fabric-and-oodles-of-azure-ai-integrations-announced"><u>Microsoft launched Fabric</u></a> in preview along with OneLake, a new unified SaaS data lake that Netz dubs “the OneDrive for data”. </p><p>Within OneLake, organizations can use ‘shortcuts’ to point to external data without duplicating it. Another solution, Mirroring in Fabric, allows users to replicate data sources such as Azure SQL, Google BigQuery, Oracle, SAP, or Snowflake directly within OneLake with low latency.</p><p>“It doesn't really matter where it's physically sitting, and that's super, super important, because  fragmentation is poison, it's so hard to work with data that is fragmented,” Netz said.</p><p>Data is often named and labelled poorly, Netz said, which can lead even the most qualified experts to struggle to use it to its full potential.</p><p>“If I took the smartest person in the world, IQ 180, just graduated from MIT, and I brought them in front of the data lake with 100,000 tables, and I gave them a business question, they will struggle,” Netz told <em>ITPro</em>.</p><iframe allow="" height="200px" width="100%" id="" style="" class="position-center" data-lazy-priority="low" data-lazy-src="https://player.captivate.fm/episode/b6147684-d254-40d8-9409-5f76f5abd749/" src="https://player.captivate.fm/episode/b6147684-d254-40d8-9409-5f76f5abd749/"></iframe><p>Microsoft is looking to Power BI to solve this problem with semantic models, which help to describe, define, and act as a “reference manual” for dense data, Netz explained.</p><p>On top of this foundation, <a href="https://www.itpro.com/strategy/28181/what-is-ai">AI </a>can begin to process and reason through institutional knowledge, beyond basic functions such as analytics or reporting.</p><p>At launch, the natural language function within Database Hub is powered by Microsoft’s default OpenAI models, but Netz added that in the near future customers will be able to pick their own including those by Anthropic or others.</p><p>“I think the world of BI is moving to the same place,” Netz said.</p><p>“Instead of the human users going report by report, page by page, visual by visual, we are going to see the humans going to the Copilot and asking the question, and letting the AI be the one who is visiting the reports, reading what’s on the pages, the visualization, synthesizing the answers, and giving the answer back.”</p><h2 id="using-ontology-for-reliable-agentic-ai">Using Ontology for reliable agentic AI</h2><p>Throughout his conversation with <em>ITPro, </em>Netz stressed the importance of institutional knowledge for making sure AI agents act in a similar manner to human workers. </p><p>He gave the example of an airline, which has data like any other organization but will also have unique organizational processes that need insider knowledge to run properly.</p><p>“I can imagine how British Airways works, but I don't really know how British Airways works,” he said. </p><p>“When a British Airways employee is joining British Airways, they're getting orientation, somebody explains how the organization is working. And there's a lot to know, like how do you assign flight crews to the plane? How do you make sure that the baggage is offloaded online and getting the right carousel? There is a process.”</p><p>This is where ontology comes in, providing machine-readable mapping of an organization’s data, its properties, and the relationships between entities within databases in the context of the organization. </p><div  class="fancy-box"><div class="fancy_box-title">YOU MAY ALSO LIKE</div><div class="fancy_box_body"><p class="fancy-box__body-text"><ul><li><a data-analytics-id="inline-link" href="https://www.itpro.com/technology/artificial-intelligence/half-of-agentic-ai-projects-are-still-stuck-at-the-pilot-stage-but-thats-not-stopping-enterprises-from-ramping-up-investment">Half of agentic AI projects are still stuck at the pilot stage</a></li><li><a data-analytics-id="inline-link" href="https://www.itpro.com/technology/artificial-intelligence/practical-ai-the-age-of-agentic-ai">Practical AI: the age of agentic AI</a></li><li><a data-analytics-id="inline-link" href="https://www.itpro.com/technology/artificial-intelligence/agentic-ai-development-project-delivery-databricks">Stop treating agentic AI like traditional software</a></li></ul></p></div></div><p>Microsoft uses Ontology in Fabric IQ for this functionality, as Netz explained.</p><p>“The ontology is describing your business in the most operational aspect of the business. How are things related? What are the rules? What are the policies? What are the actions you can take? What can I do with a plane? I can assign a crew to a plane. I can divert the plane. I can ground a plane. I can load the plane with luggage.”</p><p>An understanding of organizational ontology is essential for agentic AI, Netz added. <a href="https://www.itpro.com/business/microsoft-expects-1-3-billion-ai-agents-to-be-in-operation-by-2028-heres-how-it-plans-to-get-them-working-together"><u>Microsoft expects 1.3 billion agents to go live by 2028</u></a> and leaders will need to <a href="https://www.itpro.com/security/enterprises-need-to-think-of-agents-as-digital-co-workers-and-that-means-implementing-the-same-security-safeguards"><u>implement organizational guardrails</u></a> to prevent them from misbehaving. </p><p><a href="https://www.itpro.com/software/28109/what-is-open-source">Open source</a> standards such as MCP and <a href="https://www.itpro.com/technology/artificial-intelligence/dell-technologies-cto-john-roese-ai-agents"><u>agent to agent (A2A)</u></a> can impose specific behavioral limits for agents, as well as set ethical constraints such as how tools can be used and who is allowed to access specific data. </p><p>But because these rules are invoked at the execution stage, they aren’t a comprehensive method for keeping AI agents predictable.</p><p>Netz told <em>ITPro</em> that Microsoft thinks agents will have human managers and lower-level work carried out by database administrators will be automated to an increasing extent.</p><p>As organizations deploy AI agents such as <a href="https://www.itpro.com/technology/artificial-intelligence/nvidia-targets-open-source-interoperability-with-new-model-coalitions-agentic-frameworks"><u>OpenClaw</u></a>, they will need to clearly map out business goals and values through ontology to ensure tasks are completed in line with all expectations.</p><p>“Think back to British Airways: they want to be profitable, but they also want to have customer satisfaction and they also want to take off and land the plane safely. </p><p>“Which one takes precedence over which? How much are you willing to sacrifice in safety to get more profitability? These are things that MCP tools don't tell you, because these are the things that we expect employees to understand… you don’t do these things, you don’t take risks with planes not landing safely just to make a few more dollars. But AI may not know that.”</p><h3 class="article-body__section" id="section-follow-us-on-social-media"><span>FOLLOW US ON SOCIAL MEDIA</span></h3> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/technology/artificial-intelligence/fragmentation-is-poison-how-microsoft-is-targeting-disparate-data-to-boost-ai-adoption</link>
                                                                            <description>
                            <![CDATA[ Amir Netz, the co-creator of Microsoft's Power BI service, tells ITPro that business context is key to effective AI deployment. ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">6aXpcAHbobAxRLFc9Pqx9b</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/hnJfsmgKFbPVuGP5idio46-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Tue, 31 Mar 2026 07:32:03 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:16:20 +0000</updated>
                                                                                                                                            <category><![CDATA[Business Intelligence]]></category>
                                                    <category><![CDATA[Artificial Intelligence]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                                                                <author><![CDATA[ rory.bathgate@futurenet.com (Rory Bathgate) ]]></author>                    <dc:creator><![CDATA[ Rory Bathgate ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/Vep5JogbPhduK7R6CUWAm6-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Rory Bathgate was the Features and Multimedia Editor at ITPro until 2026, overseeing all in-depth content and case studies. Throughout his time at ITPro, Rory  charted the rise in popularity of generative AI and specifically companies such as Microsoft, OpenAI, and Google. &lt;/p&gt;&lt;p&gt;Alongside this, he delved into increasing calls for ethical and responsible AI as global legislators circle the technology, as well as the latest in mobile networking technology, from 5G mmWave to the 3G sunset and how it will affect businesses.&lt;/p&gt;&lt;p&gt;He  provided coverage from high-profile tech conferences such as Dell Technologies World, SuiteWorld, and VMware Explore Europe. His on-the-ground coverage  included live blogs, extensive daily coverage of the most significant announcements, analysis pieces, and podcast.&lt;/p&gt;&lt;p&gt;Rory was the co-host of the ITPro Podcast alongside Jane McCallion, where he swapped a keyboard for a microphone to discuss the latest learnings in tech.&lt;/p&gt;&lt;p&gt;Rory has an MA in Eighteenth-Century Studies from King’s College London, as well as a BA in English and American Literature from the University of Kent. He joined ITPro in 2022 as a graduate, after four years in student journalism.&lt;/p&gt;&lt;p&gt;In his free time, Rory enjoys photography and video editing, and can often be found at the cinema or reading a good science fiction paperback.&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/hnJfsmgKFbPVuGP5idio46-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Microsoft logo and branding illuminated against a dark backdrop on the company&#039;s vendor stall at Fira Gran Via during Mobile World Congress (MWC) 2026.]]></media:description>                                                            <media:text><![CDATA[Microsoft logo and branding illuminated against a dark backdrop on the company&#039;s vendor stall at Fira Gran Via during Mobile World Congress (MWC) 2026.]]></media:text>
                                <media:title type="plain"><![CDATA[Microsoft logo and branding illuminated against a dark backdrop on the company&#039;s vendor stall at Fira Gran Via during Mobile World Congress (MWC) 2026.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/hnJfsmgKFbPVuGP5idio46-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Microsoft is consolidating data management and data ontology to support the expansion of agentic AI, with new tools intended to make data analytics, labelling, and context sharing easier than ever. </p><p>At FabCon and SQLCon 2026, held in Atlanta, the tech giant unveiled two new expansions for its SaaS analytics platform Microsoft Fabric. </p><p>Database Hub is a new unified database management plane for Microsoft Fabric, with built-in AI agents and <a href="https://www.itpro.com/software/windows/microsoft-is-rolling-back-unnecessary-copilot-features-on-windows"><u>Microsoft Copilot</u></a> allowing for natural language exploration of enterprise data across Azure SQL, Azure Cosmos DB, <a href="https://www.itpro.com/databases/34533/what-is-azure-database-for-postgresql"><u>Azure Database for PostgreSQL</u></a>, and others. </p><p>Microsoft is also expanding the extent to which enterprises can ground AI in business context through <a href="https://www.itpro.com/technology/artificial-intelligence/microsoft-unveils-foundry-overhaul-for-managing-optimizing-ai-agents"><u>Fabric IQ</u></a>, with new semantic and ontological controls supported through a new <a href="https://www.itpro.com/technology/artificial-intelligence/what-is-model-context-protocol-mcp"><u>model context protocol (MCP)</u></a> server in preview. </p><p><em>ITPro</em> spoke to Amir Netz, CTO of Microsoft Fabric, to understand the context for the announcements and the problems Microsoft is looking to solve at the data layer. </p><p>Netz is one of the original creators of the data analytics and visualization suite <a href="https://www.itpro.com/business-intelligence/29132/the-best-business-intelligence-tool-tableau-vs-microsoft-power-bi-1">Power BI,</a> which started life as Power Pivot and Power Query within Microsoft Excel. </p><p>He told <em>ITPro</em> he is “incredibly happy” with the uptake in the years since, and that his team has now turned its attention to further consolidating and easing the process of data retrieval and analytics.  </p><p>The goal, he noted, is to do for data what Microsoft Office did for productivity, by rolling multiple products into one.</p><p>“You would never think about buying Google Sheets and using it with Word, that seems kind of ludicrous, because the power of integration is amazing and people really appreciate integration over almost any other feature you can have in a suite. </p><p>“And the world of data is so complex, and so fragmented, that when we came with Fabric we said, ‘we want to really do what Office did for productivity, we want to do with data’.” </p><p>This involved taking approximately 20 distinct data services at Microsoft and integrating them into a single product to meet enterprise data workload needs, Netz explained. It includes batch data, streaming data, data warehousing, business intelligence, machine learning, Internet of Things (IoT), and data lakes. </p><p>Netz added that 90% of the Fortune 500 now uses Fabric, with revenue and users on the rise.</p><h2 id="fabric-iq-and-onelake">Fabric, IQ, and OneLake</h2><p>In 2023, <a href="https://www.itpro.com/software/microsoft/microsoft-build-2023-microsoft-fabric-and-oodles-of-azure-ai-integrations-announced"><u>Microsoft launched Fabric</u></a> in preview along with OneLake, a new unified SaaS data lake that Netz dubs “the OneDrive for data”. </p><p>Within OneLake, organizations can use ‘shortcuts’ to point to external data without duplicating it. Another solution, Mirroring in Fabric, allows users to replicate data sources such as Azure SQL, Google BigQuery, Oracle, SAP, or Snowflake directly within OneLake with low latency.</p><p>“It doesn't really matter where it's physically sitting, and that's super, super important, because  fragmentation is poison, it's so hard to work with data that is fragmented,” Netz said.</p><p>Data is often named and labelled poorly, Netz said, which can lead even the most qualified experts to struggle to use it to its full potential.</p><p>“If I took the smartest person in the world, IQ 180, just graduated from MIT, and I brought them in front of the data lake with 100,000 tables, and I gave them a business question, they will struggle,” Netz told <em>ITPro</em>.</p><iframe allow="" height="200px" width="100%" id="" style="" class="position-center" data-lazy-priority="low" data-lazy-src="https://player.captivate.fm/episode/b6147684-d254-40d8-9409-5f76f5abd749/" src="https://player.captivate.fm/episode/b6147684-d254-40d8-9409-5f76f5abd749/"></iframe><p>Microsoft is looking to Power BI to solve this problem with semantic models, which help to describe, define, and act as a “reference manual” for dense data, Netz explained.</p><p>On top of this foundation, <a href="https://www.itpro.com/strategy/28181/what-is-ai">AI </a>can begin to process and reason through institutional knowledge, beyond basic functions such as analytics or reporting.</p><p>At launch, the natural language function within Database Hub is powered by Microsoft’s default OpenAI models, but Netz added that in the near future customers will be able to pick their own including those by Anthropic or others.</p><p>“I think the world of BI is moving to the same place,” Netz said.</p><p>“Instead of the human users going report by report, page by page, visual by visual, we are going to see the humans going to the Copilot and asking the question, and letting the AI be the one who is visiting the reports, reading what’s on the pages, the visualization, synthesizing the answers, and giving the answer back.”</p><h2 id="using-ontology-for-reliable-agentic-ai">Using Ontology for reliable agentic AI</h2><p>Throughout his conversation with <em>ITPro, </em>Netz stressed the importance of institutional knowledge for making sure AI agents act in a similar manner to human workers. </p><p>He gave the example of an airline, which has data like any other organization but will also have unique organizational processes that need insider knowledge to run properly.</p><p>“I can imagine how British Airways works, but I don't really know how British Airways works,” he said. </p><p>“When a British Airways employee is joining British Airways, they're getting orientation, somebody explains how the organization is working. And there's a lot to know, like how do you assign flight crews to the plane? How do you make sure that the baggage is offloaded online and getting the right carousel? There is a process.”</p><p>This is where ontology comes in, providing machine-readable mapping of an organization’s data, its properties, and the relationships between entities within databases in the context of the organization. </p><div  class="fancy-box"><div class="fancy_box-title">YOU MAY ALSO LIKE</div><div class="fancy_box_body"><p class="fancy-box__body-text"><ul><li><a data-analytics-id="inline-link" href="https://www.itpro.com/technology/artificial-intelligence/half-of-agentic-ai-projects-are-still-stuck-at-the-pilot-stage-but-thats-not-stopping-enterprises-from-ramping-up-investment">Half of agentic AI projects are still stuck at the pilot stage</a></li><li><a data-analytics-id="inline-link" href="https://www.itpro.com/technology/artificial-intelligence/practical-ai-the-age-of-agentic-ai">Practical AI: the age of agentic AI</a></li><li><a data-analytics-id="inline-link" href="https://www.itpro.com/technology/artificial-intelligence/agentic-ai-development-project-delivery-databricks">Stop treating agentic AI like traditional software</a></li></ul></p></div></div><p>Microsoft uses Ontology in Fabric IQ for this functionality, as Netz explained.</p><p>“The ontology is describing your business in the most operational aspect of the business. How are things related? What are the rules? What are the policies? What are the actions you can take? What can I do with a plane? I can assign a crew to a plane. I can divert the plane. I can ground a plane. I can load the plane with luggage.”</p><p>An understanding of organizational ontology is essential for agentic AI, Netz added. <a href="https://www.itpro.com/business/microsoft-expects-1-3-billion-ai-agents-to-be-in-operation-by-2028-heres-how-it-plans-to-get-them-working-together"><u>Microsoft expects 1.3 billion agents to go live by 2028</u></a> and leaders will need to <a href="https://www.itpro.com/security/enterprises-need-to-think-of-agents-as-digital-co-workers-and-that-means-implementing-the-same-security-safeguards"><u>implement organizational guardrails</u></a> to prevent them from misbehaving. </p><p><a href="https://www.itpro.com/software/28109/what-is-open-source">Open source</a> standards such as MCP and <a href="https://www.itpro.com/technology/artificial-intelligence/dell-technologies-cto-john-roese-ai-agents"><u>agent to agent (A2A)</u></a> can impose specific behavioral limits for agents, as well as set ethical constraints such as how tools can be used and who is allowed to access specific data. </p><p>But because these rules are invoked at the execution stage, they aren’t a comprehensive method for keeping AI agents predictable.</p><p>Netz told <em>ITPro</em> that Microsoft thinks agents will have human managers and lower-level work carried out by database administrators will be automated to an increasing extent.</p><p>As organizations deploy AI agents such as <a href="https://www.itpro.com/technology/artificial-intelligence/nvidia-targets-open-source-interoperability-with-new-model-coalitions-agentic-frameworks"><u>OpenClaw</u></a>, they will need to clearly map out business goals and values through ontology to ensure tasks are completed in line with all expectations.</p><p>“Think back to British Airways: they want to be profitable, but they also want to have customer satisfaction and they also want to take off and land the plane safely. </p><p>“Which one takes precedence over which? How much are you willing to sacrifice in safety to get more profitability? These are things that MCP tools don't tell you, because these are the things that we expect employees to understand… you don’t do these things, you don’t take risks with planes not landing safely just to make a few more dollars. But AI may not know that.”</p><h3 class="article-body__section" id="section-follow-us-on-social-media"><span>FOLLOW US ON SOCIAL MEDIA</span></h3>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ McLaren Racing's Dan Keyworth on how data drives F1 in 2026 ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Last year was a big year for McLaren Racing, as the team won its second consecutive Constructors' Championship and tenth overall. British driver Lando Norris won his first driver's title, while Oscar Piastri finished third.</p><p>With the new F1 season looming, the team will be aiming to repeat their recent successes. </p><p><em>ITPro </em>sat down with Dan Keyworth, executive director of performance technology and systems at McLaren Racing, on site at the McLaren Technology Centre (MTC) in Woking. </p><p>This is the headquarters of the McLaren Group, including its racing and automotive businesses, a Norman Foster-designed campus that houses some of the team’s most famous race-winning cars. Against this historic backdrop, Keyworth reflects on the pace of change in Formula 1 and says the influence of technology and data continues to increase. </p><p>“Even in the last decade, the trend is almost parabolic,” he says, referring to the steep and rapid acceleration in the use of technology in the sport. “Every year, there's more data that we can <a href="https://www.itpro.com/business/business-strategy/what-does-data-driven-mean-in-business"><u>digest and gain insight from</u></a>.” </p><p>Keyworth says the modern F1 car includes about 300 sensors that capture information from practice and race-day sessions. The aim is to ensure the technologists and data professionals in his team are dialed into these insights and looking for signs of a potential competitive advantage. </p><p>“That work might include correlating those insights with data from <a href="https://www.itpro.com/technology/artificial-intelligence/are-ai-digital-twins-a-match-made-in-heaven"><u>computational fluid dynamics</u></a>, the wind tunnel, and the driver simulator,” he says. “These are all indicators of performance that you want to make sure you recognize at the track.”</p><p>The challenge for McLaren is arguably greater this year than ever before, with a <a href="https://www.bbc.co.uk/sport/formula1/articles/c14mk1vp5vmo" target="_blank">raft of new rules</a> and regulations covering power units, chassis, tyres, and fuel creating a step change in the sport. </p><p>The good news is that McLaren team principal Andrea Stella recognizes the scale of the challenge and the role technology will play in helping McLaren to maintain its advantage. To that end, Keyworth was recently promoted to his current position, having formerly held the role of director of business technology.</p><p>“That change is something that’s naturally been happening over the last couple of years, which is just the convergence of technology in all areas, across engineering, production, and the race team. You've got to evolve in this sport. You stand still; you’re going backwards,” he says.</p><p>“What's clear to us as a team is that technology is another battleground in the sport. Ultimately, we're designing the car, building it, and then going racing. We've got 1,200 people here at Woking doing the first two things, and we need the best technology and systems to drive performance into the car and give the guys at the track the best possible product.”</p><h2 id="data-analytics-has-revolutionized-mclaren">Data analytics has revolutionized McLaren</h2><p>Having spent nine years with technology specialist Fujitsu, Keyworth joined McLaren in September 2017. He lives locally and was a fan of Mika Häkkinen driving for the team as a child. Now approaching a decade with McLaren, Keyworth describes the role of overseeing technology as a privilege.</p><p>“It's a very historic brand, which comes with pressure, because it's 60 years of huge success, particularly in the last two years,” he says. “But that pressure is also the thing that energizes me. I'm quite a stable person, quite calm. So, I like the pressure cooker of Formula One. And I like the intersection between the sport and my interest in technology.”</p><p>While the team can bask in the glow of its recent successes, Keyworth recognizes there have been harder times along the road to victory. When he joined, the team was struggling at the back of the grid. Technology has played a crucial role in supporting progress on and off the track.</p><p>“I worked with the commercial team to bring in some great technology partners, such as <a href="https://www.itpro.com/cloud/cloud-computing/google-cloud-teases-revamped-partner-program-ahead-of-2026"><u>Google</u></a>, <a href="https://www.itpro.com/hardware/everything-you-need-to-know-about-dell"><u>Dell Technologies</u></a>, and <a href="https://www.itpro.com/infrastructure/networking/everything-you-need-to-know-about-cisco"><u>Cisco</u></a>. Some of those relationships are now very long-standing. These partnerships are not just about putting a sticker on the car for a couple of years. This work is about longevity,” he says.</p><p>“The other achievement is getting our technology genuinely focused on lap time and performance. There's been a huge amount of support from the board and from our leadership team. We put investment into our tools and infrastructure, which has given us an on-track advantage.”</p><p>One of the team’s key technology partners is <a href="https://www.itpro.com/business/business-operations/367877/best-itsm-tools"><u>IT service management (ITSM)</u></a> specialist Freshworks. Keyworth describes ITSM as the stable technology layer that supports the team. “It’s the beating heart,” he says. “If you lose any IT during the race, we’re completely out of business, so it's a critical component.”</p><iframe allow="" height="200px" width="100%" id="" style="" class="position-center" data-lazy-priority="low" data-lazy-src="https://player.captivate.fm/episode/dd292200-93b9-4e0b-86e3-492606241c36/" src="https://player.captivate.fm/episode/dd292200-93b9-4e0b-86e3-492606241c36/"></iframe><p>Keyworth says the lightweight nature of Freshworks’ technology means the team can make ITSM changes as circumstances demand. That capability is critical given the fast-paced nature of F1 and the raft of new rules and regulations. </p><p>“An F1 team doesn’t run like a traditional business,” he says. “You've got to have flexibility. Freshworks has been a good advocate of moving fast and being adaptable, and that's the DNA of our team. Everything we do is supported by technology, and it must roll at the same pace as our organization.”</p><p>This season’s new regulations mean the changes are coming more quickly and in greater numbers than usual. While the rules are a big shift for the team’s drivers on the track, Keyworth recognizes that the modifications also create new demands for people off the track. </p><p>“Like any change, good preparation means good execution,” he says. “This team's awesome. We've all rolled up our sleeves and embraced the new regulations, rather than felt defeated by them. It's been good to see our culture challenged by the change, and I'd say we're stronger than ever.”</p><p>It’s not just regulatory changes that present a challenge to Keyworth. While digital leaders in F1 tend to avoid bleeding-edge developments in favor of tried-and-tested technologies, he recognizes the need to keep an eye on AI through partners such as <a href="https://www.itpro.com/technology/artificial-intelligence/google-launches-flagship-gemini-3-model-and-google-antigravity-a-new-agentic-ai-development-platform"><u>Google Gemini</u></a> and Freshworks.</p><p>“There’s the ability to make processes more optimal by pairing AI with traditional machine learning and asking natural language questions, like, ‘Show me the best lap between Lando and Oscar in a practice session per sector,’ and suddenly there's a graph in front of you,” he says.</p><p>“Through our partnership with Freshworks, we've been using Freddy AI, which is an overlay into our service management processes for things like grouping tickets and spotting problems. A lot of this work was quite manual in the past. That overlay of intelligence means our people can focus on fixing problems.”</p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/data-and-insights/mclaren-racings-dan-keyworth-on-how-data-drives-f1</link>
                                                                            <description>
                            <![CDATA[ With new rules to contend with and mounting sensor data, McLaren Racing has doubled down on in-house specialists and partner expertise ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">f5o8jAuCRa2Ku9usB2txqW</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/t9ubVg3Jmx8GNXziEbL8cn-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Mon, 09 Mar 2026 13:19:27 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:15:42 +0000</updated>
                                                                                                                                            <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Data and Insights]]></category>
                                                    <category><![CDATA[Business]]></category>
                                                                                                                    <dc:creator><![CDATA[ Mark Samuels ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/rfAoiWsTvmT4koiuWLLZBi-320-70.jpeg ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Mark Samuels is a freelance writer specializing in business and technology. For the past two decades, he has produced extensive work on subjects such as the adoption of technology by C-suite executives.&lt;/p&gt;&lt;p&gt;At ITPro, Mark has provided long-form content on C-suite strategy, particularly relating to chief information officers (CIOs), as well as digital transformation case studies, and explainers on cloud computing architecture.&lt;/p&gt;&lt;p&gt;Mark has written for publications including The Guardian, ZDNet, TechRepublic, Times Higher Education, and CIONET. He started working as a staff writer at Computing in 2000, where he later became the publication’s features editor. In 2008, he took charge of the brand’s monthly supplement Computing Business alongside his features responsibilities.&lt;/p&gt;&lt;p&gt;From 2008 to 2014, Mark was also editor of the membership magazine for IT leadership forum CIO Connect. As part of the role, Mark oversaw the editorial content for CIO Connect, edited research reports, and maintained an extensive network of industry experts.&lt;/p&gt;&lt;p&gt;Before his career in journalism, Mark achieved a BA in geography and MSc in World Space Economy at the University of Birmingham, as well as a PhD in economic geography at the University of Sheffield.&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/t9ubVg3Jmx8GNXziEbL8cn-1920-80.jpg">
                                                            <media:credit><![CDATA[McLaren Racing]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[A headshot of Dan Keyworth, executive director of performance technology and systems at McLaren Racing.]]></media:description>                                                            <media:text><![CDATA[A headshot of Dan Keyworth, executive director of performance technology and systems at McLaren Racing.]]></media:text>
                                <media:title type="plain"><![CDATA[A headshot of Dan Keyworth, executive director of performance technology and systems at McLaren Racing.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/t9ubVg3Jmx8GNXziEbL8cn-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Last year was a big year for McLaren Racing, as the team won its second consecutive Constructors' Championship and tenth overall. British driver Lando Norris won his first driver's title, while Oscar Piastri finished third.</p><p>With the new F1 season looming, the team will be aiming to repeat their recent successes. </p><p><em>ITPro </em>sat down with Dan Keyworth, executive director of performance technology and systems at McLaren Racing, on site at the McLaren Technology Centre (MTC) in Woking. </p><p>This is the headquarters of the McLaren Group, including its racing and automotive businesses, a Norman Foster-designed campus that houses some of the team’s most famous race-winning cars. Against this historic backdrop, Keyworth reflects on the pace of change in Formula 1 and says the influence of technology and data continues to increase. </p><p>“Even in the last decade, the trend is almost parabolic,” he says, referring to the steep and rapid acceleration in the use of technology in the sport. “Every year, there's more data that we can <a href="https://www.itpro.com/business/business-strategy/what-does-data-driven-mean-in-business"><u>digest and gain insight from</u></a>.” </p><p>Keyworth says the modern F1 car includes about 300 sensors that capture information from practice and race-day sessions. The aim is to ensure the technologists and data professionals in his team are dialed into these insights and looking for signs of a potential competitive advantage. </p><p>“That work might include correlating those insights with data from <a href="https://www.itpro.com/technology/artificial-intelligence/are-ai-digital-twins-a-match-made-in-heaven"><u>computational fluid dynamics</u></a>, the wind tunnel, and the driver simulator,” he says. “These are all indicators of performance that you want to make sure you recognize at the track.”</p><p>The challenge for McLaren is arguably greater this year than ever before, with a <a href="https://www.bbc.co.uk/sport/formula1/articles/c14mk1vp5vmo" target="_blank">raft of new rules</a> and regulations covering power units, chassis, tyres, and fuel creating a step change in the sport. </p><p>The good news is that McLaren team principal Andrea Stella recognizes the scale of the challenge and the role technology will play in helping McLaren to maintain its advantage. To that end, Keyworth was recently promoted to his current position, having formerly held the role of director of business technology.</p><p>“That change is something that’s naturally been happening over the last couple of years, which is just the convergence of technology in all areas, across engineering, production, and the race team. You've got to evolve in this sport. You stand still; you’re going backwards,” he says.</p><p>“What's clear to us as a team is that technology is another battleground in the sport. Ultimately, we're designing the car, building it, and then going racing. We've got 1,200 people here at Woking doing the first two things, and we need the best technology and systems to drive performance into the car and give the guys at the track the best possible product.”</p><h2 id="data-analytics-has-revolutionized-mclaren">Data analytics has revolutionized McLaren</h2><p>Having spent nine years with technology specialist Fujitsu, Keyworth joined McLaren in September 2017. He lives locally and was a fan of Mika Häkkinen driving for the team as a child. Now approaching a decade with McLaren, Keyworth describes the role of overseeing technology as a privilege.</p><p>“It's a very historic brand, which comes with pressure, because it's 60 years of huge success, particularly in the last two years,” he says. “But that pressure is also the thing that energizes me. I'm quite a stable person, quite calm. So, I like the pressure cooker of Formula One. And I like the intersection between the sport and my interest in technology.”</p><p>While the team can bask in the glow of its recent successes, Keyworth recognizes there have been harder times along the road to victory. When he joined, the team was struggling at the back of the grid. Technology has played a crucial role in supporting progress on and off the track.</p><p>“I worked with the commercial team to bring in some great technology partners, such as <a href="https://www.itpro.com/cloud/cloud-computing/google-cloud-teases-revamped-partner-program-ahead-of-2026"><u>Google</u></a>, <a href="https://www.itpro.com/hardware/everything-you-need-to-know-about-dell"><u>Dell Technologies</u></a>, and <a href="https://www.itpro.com/infrastructure/networking/everything-you-need-to-know-about-cisco"><u>Cisco</u></a>. Some of those relationships are now very long-standing. These partnerships are not just about putting a sticker on the car for a couple of years. This work is about longevity,” he says.</p><p>“The other achievement is getting our technology genuinely focused on lap time and performance. There's been a huge amount of support from the board and from our leadership team. We put investment into our tools and infrastructure, which has given us an on-track advantage.”</p><p>One of the team’s key technology partners is <a href="https://www.itpro.com/business/business-operations/367877/best-itsm-tools"><u>IT service management (ITSM)</u></a> specialist Freshworks. Keyworth describes ITSM as the stable technology layer that supports the team. “It’s the beating heart,” he says. “If you lose any IT during the race, we’re completely out of business, so it's a critical component.”</p><iframe allow="" height="200px" width="100%" id="" style="" class="position-center" data-lazy-priority="low" data-lazy-src="https://player.captivate.fm/episode/dd292200-93b9-4e0b-86e3-492606241c36/" src="https://player.captivate.fm/episode/dd292200-93b9-4e0b-86e3-492606241c36/"></iframe><p>Keyworth says the lightweight nature of Freshworks’ technology means the team can make ITSM changes as circumstances demand. That capability is critical given the fast-paced nature of F1 and the raft of new rules and regulations. </p><p>“An F1 team doesn’t run like a traditional business,” he says. “You've got to have flexibility. Freshworks has been a good advocate of moving fast and being adaptable, and that's the DNA of our team. Everything we do is supported by technology, and it must roll at the same pace as our organization.”</p><p>This season’s new regulations mean the changes are coming more quickly and in greater numbers than usual. While the rules are a big shift for the team’s drivers on the track, Keyworth recognizes that the modifications also create new demands for people off the track. </p><p>“Like any change, good preparation means good execution,” he says. “This team's awesome. We've all rolled up our sleeves and embraced the new regulations, rather than felt defeated by them. It's been good to see our culture challenged by the change, and I'd say we're stronger than ever.”</p><p>It’s not just regulatory changes that present a challenge to Keyworth. While digital leaders in F1 tend to avoid bleeding-edge developments in favor of tried-and-tested technologies, he recognizes the need to keep an eye on AI through partners such as <a href="https://www.itpro.com/technology/artificial-intelligence/google-launches-flagship-gemini-3-model-and-google-antigravity-a-new-agentic-ai-development-platform"><u>Google Gemini</u></a> and Freshworks.</p><p>“There’s the ability to make processes more optimal by pairing AI with traditional machine learning and asking natural language questions, like, ‘Show me the best lap between Lando and Oscar in a practice session per sector,’ and suddenly there's a graph in front of you,” he says.</p><p>“Through our partnership with Freshworks, we've been using Freddy AI, which is an overlay into our service management processes for things like grouping tickets and spotting problems. A lot of this work was quite manual in the past. That overlay of intelligence means our people can focus on fixing problems.”</p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ What is a vector database?  ]]></title>
                                                                                                <dc:content><![CDATA[ <p>In the enterprise world in 2026, vector databases are increasingly under discussion in the same breath as <a href="https://www.itpro.com/strategy/29606/what-is-the-semantic-web"><u>semantic search</u></a>,<a href="https://www.itpro.com/technology/artificial-intelligence/what-is-retrieval-augmented-generation-rag"><u> retrieval-augmented generation</u></a> (RAG), and other ‘AI-ready’ ways of finding and using information inside an organization.</p><p>The basic driver is straightforward: teams want systems that can retrieve results based on meaning, and similarity, rather than relying solely on exact keywords, rigid schemas, or purely structured querying.</p><p>To understand the sector, <em>ITPro</em> spoke to Devin Pratt, research director at IDC and Noel Yuhanna, VP and principal analyst at Forrester, about what a vector database actually is, where it fits compared to other enterprise options, and what organizations should weigh up. </p><p>Vector databases have gone from a specialist concept to a practical talking point for IT teams in fairly rapid fashion, largely because so many modern AI projects now depend on finding the right information quickly and reliably.</p><h2 id="what-is-a-vector-database-for">What is a vector database for?</h2><p>At its simplest, a vector database is a system designed to make “similarity” a first-class way of searching and retrieving data. </p><p>Instead of treating a query as a strict match, it returns items that are closest to what you asked for, based on how the underlying information is represented, making it particularly relevant for organizations dealing with large volumes of <a href="https://www.itpro.com/big-data-analytics/34532/structured-vs-unstructured-data-management"><u>unstructured data</u></a> – documents, support tickets, product catalogues, and so on – where the intent of a question matters.</p><p>“A vector database is designed to <a href="https://www.itpro.com/technology/artificial-intelligence/oracle-bets-on-vector-search-capabilities-to-drive-enterprise-ai-value">search by semantic meaning</a> rather than exact matches, making it fundamentally different from <a href="https://www.itpro.com/data-insights/31725/what-is-a-relational-database"><u>relational databases</u></a>, key-value stores, or search engines,” Yuhanna explains. </p><p>“Vector databases are built from the ground up to perform fast, large-scale similarity search using specialized indexing and vector embeddings,” he says. “It makes them especially suited for AI use cases like semantic search, RAG, and modern AI applications.” </p><h2 id="how-do-vector-databases-work">How do vector databases work?</h2><p>In practical terms, vector databases rest on the idea that content can be represented in a form that makes “closeness” measurable, so a system can return results that are similar to a query, even when the wording is different.</p><p>This setup is what enables meaning-based retrieval across messy, unstructured information, where a keyword search might miss useful context, or return too much noise.</p><p>The database’s job, then, is not just to store these representations, but to retrieve the nearest matches quickly enough to be useful in real applications. A major reason vector databases can do this at scale is indexing. As Pratt notes, vector databases “implement advanced indexing techniques like HNSW, PQ, or DiskANN to optimize similarity searches.” </p><p>The details vary by product, and that is where performance and cost trade-offs appear. </p><p>Yuhanna points out that “different products use a variety of indexing methods… which can have significant implications for query speed, accuracy, and efficiency depending on the workload.”</p><h2 id="what-can-you-use-a-vector-database-for">What can you use a vector database for?</h2><p>Most organizations look at vector databases when they need better retrieval over unstructured information. The common goal is to help people and systems find the most relevant material even when the query does not share the same wording as the source.</p><p>In that sense, vector databases are often less about 'adding AI' in the abstract and more about making search, discovery, and information access work properly at scale.</p><p>A related capability is combining similarity search with more traditional constraints, such as filtering by department, document type, customer segment, date range, or permissions. </p><p>Yuhanna argues that “The ability to perform hybrid searches that combine vector similarity with non-vector data, such as master data or metadata, will become essential for most enterprise use cases.”</p><p>Vector databases are often compared to <a href="https://www.itpro.com/cloud/367937/best-cloud-databases-in-2022"><u>relational databases</u></a>, key–value stores, and traditional search engines, but the more useful comparison is usually between a purpose-built vector database and a general-purpose platform with vector indexing.</p><p>In other words, the decision is not always “vector database or nothing” – it is whether vector search is central enough to justify adopting a dedicated system, or whether you can meet your needs within the database and operational model you already run.</p><p>Yuhanna is clear that a general-purpose approach can be sensible in the right circumstances: “A general-purpose database with a vector index is sufficient when vector search is secondary, data volumes are moderate, or the application needs to combine vector search with non-vector data to provide a broader context.”</p><h2 id="native-or-integrated-vector-databases">Native or integrated vector databases?</h2><p>In 2026, most organizations will encounter vector search in two broad forms. </p><p>The first is a purpose-built, native vector database, where similarity search is the core design goal. The second is an integrated approach, where vector indexing and query capabilities are added into a general-purpose platform, often to align data, <a href="https://www.itpro.com/security/privacy/ai-is-forcing-a-fundamental-shift-in-data-privacy-and-governance">governance</a>, and operations.</p><p>In practice, the right choice tends to depend less on ideology and more on what you are building, as well as how central vector search is to the application.</p><p>Pratt draws a clear line between the two options, noting that in a native approach “the vector store is purpose-built and optimized specifically for managing high-dimensional vectors,” while integrated platforms are increasingly common because teams want consolidation.</p><p>“Integrated vector databases are the clear platform of choice for storing and querying vector embeddings, as organizations favor unified, governed environments for <a href="https://www.itpro.com/technology/artificial-intelligence/practical-ai-the-age-of-agentic-ai">agentic AI</a>,” he adds.</p><p>More broadly, Pratt explains that vector search is increasingly paired with RAG as an embedded function within mainstream database architectures. </p><p>Pratt also makes the trade-off more concrete. Integrated options can “embed vector stores within a broader framework that combines traditional structured data management with vector processing capabilities”. </p><h2 id="vector-databases-pros-and-cons">Vector databases: Pros and cons</h2><p>In simple terms, the case for vector databases is strongest when an organization needs more effective retrieval across unstructured information, and when “similarity” is a better fit than strict matching.</p><p>Implementing this can unlock experiences where search feels less brittle, and where applications can pull back the most relevant context even when users do not phrase a question in the same way the source content was written. </p><p>In that sense, vector databases are often less about replacing existing systems and more about adding a capability that traditional services struggle with.</p><p>However, the trade-offs tend to appear after deployment, when systems move from a proof of concept to a service that has to meet performance, security, and operational expectations.</p><p>“The biggest risks organizations face after deployment typically include performance bottlenecks at scale, declining search relevance, insufficient data security controls, operational complexity, skills shortages, and a lack of clarity about what vector databases can deliver,” Yuhanna warns.</p><p>From Pratt’s perspective, governance concerns are also front of mind. </p><p>“Security vulnerabilities (26%) and data privacy breaches (24%) are the leading concerns when deploying agentic AI,” he says, which makes it important to treat vector search as an enterprise data problem, not just an experiment</p><h2 id="how-to-choose-and-deploy-safely">How to choose and deploy safely</h2><p>Choosing a vector database is rarely a matter of picking the “best” product in the abstract. Yuhanna urges leaders to filter by “security controls, governance capabilities, TCO, hybrid search, scalability, performance, customization options, and search relevance”. </p><p>He also cautions against over-simplifying the category: “Common misconceptions include assuming that all vector databases scale equally, that all can perform vector and non-vector searches in a single query, or that they all use the same vector indexing <a href="https://www.itpro.com/data-insights/30212/what-is-an-algorithm">algorithm</a>.”</p><p>Leaders keen to implement vector databases can also fall into the trap of focusing too much on the technology and not enough on assessing their specific organizational needs. </p><p>Pratt acknowledges this and warns that vector capability is easy to over-simplify during procurement: “The most misunderstood point is treating ‘vector support’ as a checkbox rather than validating fit across governance needs, indexing requirements, and performance at target scale.”</p><p>In practice, reducing risk means treating deployment as an ongoing operational discipline, rather than a one-off build. </p><p>“Companies mitigate these risks by implementing stronger security controls, continuously monitoring vector performance, managing the lifecycle of vector data, selecting appropriate indexing strategies, and focusing on specific, relevant use cases that vectors can support,” Yuhanna adds.</p><h2 id="vector-databases-in-2026-and-beyond">Vector databases in 2026 and beyond </h2><p>Over the next year and beyond, the most important change is likely to be less about a single breakthrough feature and more about convergence. </p><p>As mainstream database platforms add vector capabilities, and more teams try to run vector search alongside existing operational and analytical workloads, the category is starting to look less like a standalone niche and more like an expected part of the broader data stack.</p><p>Techniques such as <a href="https://www.itpro.com/technology/big-data/what-is-database-sharding-how-benefit-enterprise-it"><u>database sharding</u></a> will be used to partition datasets across nodes, for the faster, distributed similarity searches relied upon by tools such as <a href="https://www.itpro.com/technology/artificial-intelligence/practical-ai-the-age-of-agentic-ai"><u>AI agents</u></a>.</p><p>Both experts predict a convergence of native and integrated vector databases, with the core motivation being better support for AI deployment. But even as the market converges, Yuhanna argues the practical success factors will look familiar to anyone who has put a database into production. </p><p>“Enterprise-grade security, governance, and compliance, along with platforms that can scale automatically and reliably, will be critical to succeed.”</p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/technology/big-data/what-is-a-vector-database</link>
                                                                            <description>
                            <![CDATA[ Storing data as mathematical values provides critical functionality for ML and AI ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">biJbPSsFtFHcxjf2jpGdWL</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/j27KBd3UnvrmEGcCNVGgiB-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Mon, 09 Feb 2026 06:00:00 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:17:05 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Platforms]]></category>
                                                    <category><![CDATA[Big Data]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                                                                                    <dc:creator><![CDATA[ Max Slater-Robins ]]></dc:creator>                                                                                                        <dc:description><![CDATA[ null ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/j27KBd3UnvrmEGcCNVGgiB-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[An abstract digital generated image of multicoloured AI data labels and node connections in orange on top of an orange and purple cloud, against light blue background.]]></media:description>                                                            <media:text><![CDATA[An abstract digital generated image of multicoloured AI data labels and node connections in orange on top of an orange and purple cloud, against light blue background.]]></media:text>
                                <media:title type="plain"><![CDATA[An abstract digital generated image of multicoloured AI data labels and node connections in orange on top of an orange and purple cloud, against light blue background.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/j27KBd3UnvrmEGcCNVGgiB-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>In the enterprise world in 2026, vector databases are increasingly under discussion in the same breath as <a href="https://www.itpro.com/strategy/29606/what-is-the-semantic-web"><u>semantic search</u></a>,<a href="https://www.itpro.com/technology/artificial-intelligence/what-is-retrieval-augmented-generation-rag"><u> retrieval-augmented generation</u></a> (RAG), and other ‘AI-ready’ ways of finding and using information inside an organization.</p><p>The basic driver is straightforward: teams want systems that can retrieve results based on meaning, and similarity, rather than relying solely on exact keywords, rigid schemas, or purely structured querying.</p><p>To understand the sector, <em>ITPro</em> spoke to Devin Pratt, research director at IDC and Noel Yuhanna, VP and principal analyst at Forrester, about what a vector database actually is, where it fits compared to other enterprise options, and what organizations should weigh up. </p><p>Vector databases have gone from a specialist concept to a practical talking point for IT teams in fairly rapid fashion, largely because so many modern AI projects now depend on finding the right information quickly and reliably.</p><h2 id="what-is-a-vector-database-for">What is a vector database for?</h2><p>At its simplest, a vector database is a system designed to make “similarity” a first-class way of searching and retrieving data. </p><p>Instead of treating a query as a strict match, it returns items that are closest to what you asked for, based on how the underlying information is represented, making it particularly relevant for organizations dealing with large volumes of <a href="https://www.itpro.com/big-data-analytics/34532/structured-vs-unstructured-data-management"><u>unstructured data</u></a> – documents, support tickets, product catalogues, and so on – where the intent of a question matters.</p><p>“A vector database is designed to <a href="https://www.itpro.com/technology/artificial-intelligence/oracle-bets-on-vector-search-capabilities-to-drive-enterprise-ai-value">search by semantic meaning</a> rather than exact matches, making it fundamentally different from <a href="https://www.itpro.com/data-insights/31725/what-is-a-relational-database"><u>relational databases</u></a>, key-value stores, or search engines,” Yuhanna explains. </p><p>“Vector databases are built from the ground up to perform fast, large-scale similarity search using specialized indexing and vector embeddings,” he says. “It makes them especially suited for AI use cases like semantic search, RAG, and modern AI applications.” </p><h2 id="how-do-vector-databases-work">How do vector databases work?</h2><p>In practical terms, vector databases rest on the idea that content can be represented in a form that makes “closeness” measurable, so a system can return results that are similar to a query, even when the wording is different.</p><p>This setup is what enables meaning-based retrieval across messy, unstructured information, where a keyword search might miss useful context, or return too much noise.</p><p>The database’s job, then, is not just to store these representations, but to retrieve the nearest matches quickly enough to be useful in real applications. A major reason vector databases can do this at scale is indexing. As Pratt notes, vector databases “implement advanced indexing techniques like HNSW, PQ, or DiskANN to optimize similarity searches.” </p><p>The details vary by product, and that is where performance and cost trade-offs appear. </p><p>Yuhanna points out that “different products use a variety of indexing methods… which can have significant implications for query speed, accuracy, and efficiency depending on the workload.”</p><h2 id="what-can-you-use-a-vector-database-for">What can you use a vector database for?</h2><p>Most organizations look at vector databases when they need better retrieval over unstructured information. The common goal is to help people and systems find the most relevant material even when the query does not share the same wording as the source.</p><p>In that sense, vector databases are often less about 'adding AI' in the abstract and more about making search, discovery, and information access work properly at scale.</p><p>A related capability is combining similarity search with more traditional constraints, such as filtering by department, document type, customer segment, date range, or permissions. </p><p>Yuhanna argues that “The ability to perform hybrid searches that combine vector similarity with non-vector data, such as master data or metadata, will become essential for most enterprise use cases.”</p><p>Vector databases are often compared to <a href="https://www.itpro.com/cloud/367937/best-cloud-databases-in-2022"><u>relational databases</u></a>, key–value stores, and traditional search engines, but the more useful comparison is usually between a purpose-built vector database and a general-purpose platform with vector indexing.</p><p>In other words, the decision is not always “vector database or nothing” – it is whether vector search is central enough to justify adopting a dedicated system, or whether you can meet your needs within the database and operational model you already run.</p><p>Yuhanna is clear that a general-purpose approach can be sensible in the right circumstances: “A general-purpose database with a vector index is sufficient when vector search is secondary, data volumes are moderate, or the application needs to combine vector search with non-vector data to provide a broader context.”</p><h2 id="native-or-integrated-vector-databases">Native or integrated vector databases?</h2><p>In 2026, most organizations will encounter vector search in two broad forms. </p><p>The first is a purpose-built, native vector database, where similarity search is the core design goal. The second is an integrated approach, where vector indexing and query capabilities are added into a general-purpose platform, often to align data, <a href="https://www.itpro.com/security/privacy/ai-is-forcing-a-fundamental-shift-in-data-privacy-and-governance">governance</a>, and operations.</p><p>In practice, the right choice tends to depend less on ideology and more on what you are building, as well as how central vector search is to the application.</p><p>Pratt draws a clear line between the two options, noting that in a native approach “the vector store is purpose-built and optimized specifically for managing high-dimensional vectors,” while integrated platforms are increasingly common because teams want consolidation.</p><p>“Integrated vector databases are the clear platform of choice for storing and querying vector embeddings, as organizations favor unified, governed environments for <a href="https://www.itpro.com/technology/artificial-intelligence/practical-ai-the-age-of-agentic-ai">agentic AI</a>,” he adds.</p><p>More broadly, Pratt explains that vector search is increasingly paired with RAG as an embedded function within mainstream database architectures. </p><p>Pratt also makes the trade-off more concrete. Integrated options can “embed vector stores within a broader framework that combines traditional structured data management with vector processing capabilities”. </p><h2 id="vector-databases-pros-and-cons">Vector databases: Pros and cons</h2><p>In simple terms, the case for vector databases is strongest when an organization needs more effective retrieval across unstructured information, and when “similarity” is a better fit than strict matching.</p><p>Implementing this can unlock experiences where search feels less brittle, and where applications can pull back the most relevant context even when users do not phrase a question in the same way the source content was written. </p><p>In that sense, vector databases are often less about replacing existing systems and more about adding a capability that traditional services struggle with.</p><p>However, the trade-offs tend to appear after deployment, when systems move from a proof of concept to a service that has to meet performance, security, and operational expectations.</p><p>“The biggest risks organizations face after deployment typically include performance bottlenecks at scale, declining search relevance, insufficient data security controls, operational complexity, skills shortages, and a lack of clarity about what vector databases can deliver,” Yuhanna warns.</p><p>From Pratt’s perspective, governance concerns are also front of mind. </p><p>“Security vulnerabilities (26%) and data privacy breaches (24%) are the leading concerns when deploying agentic AI,” he says, which makes it important to treat vector search as an enterprise data problem, not just an experiment</p><h2 id="how-to-choose-and-deploy-safely">How to choose and deploy safely</h2><p>Choosing a vector database is rarely a matter of picking the “best” product in the abstract. Yuhanna urges leaders to filter by “security controls, governance capabilities, TCO, hybrid search, scalability, performance, customization options, and search relevance”. </p><p>He also cautions against over-simplifying the category: “Common misconceptions include assuming that all vector databases scale equally, that all can perform vector and non-vector searches in a single query, or that they all use the same vector indexing <a href="https://www.itpro.com/data-insights/30212/what-is-an-algorithm">algorithm</a>.”</p><p>Leaders keen to implement vector databases can also fall into the trap of focusing too much on the technology and not enough on assessing their specific organizational needs. </p><p>Pratt acknowledges this and warns that vector capability is easy to over-simplify during procurement: “The most misunderstood point is treating ‘vector support’ as a checkbox rather than validating fit across governance needs, indexing requirements, and performance at target scale.”</p><p>In practice, reducing risk means treating deployment as an ongoing operational discipline, rather than a one-off build. </p><p>“Companies mitigate these risks by implementing stronger security controls, continuously monitoring vector performance, managing the lifecycle of vector data, selecting appropriate indexing strategies, and focusing on specific, relevant use cases that vectors can support,” Yuhanna adds.</p><h2 id="vector-databases-in-2026-and-beyond">Vector databases in 2026 and beyond </h2><p>Over the next year and beyond, the most important change is likely to be less about a single breakthrough feature and more about convergence. </p><p>As mainstream database platforms add vector capabilities, and more teams try to run vector search alongside existing operational and analytical workloads, the category is starting to look less like a standalone niche and more like an expected part of the broader data stack.</p><p>Techniques such as <a href="https://www.itpro.com/technology/big-data/what-is-database-sharding-how-benefit-enterprise-it"><u>database sharding</u></a> will be used to partition datasets across nodes, for the faster, distributed similarity searches relied upon by tools such as <a href="https://www.itpro.com/technology/artificial-intelligence/practical-ai-the-age-of-agentic-ai"><u>AI agents</u></a>.</p><p>Both experts predict a convergence of native and integrated vector databases, with the core motivation being better support for AI deployment. But even as the market converges, Yuhanna argues the practical success factors will look familiar to anyone who has put a database into production. </p><p>“Enterprise-grade security, governance, and compliance, along with platforms that can scale automatically and reliably, will be critical to succeed.”</p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ Buoyed by OpenAI partnership, Snowflake teases more big things to come ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Snowflake’s recent <a href="https://www.itpro.com/business/data-and-insights/snowflake-and-openai-are-teaming-up-to-help-enterprises-capitalize-on-their-most-valuable-asset"><u>$200 million partnership announcement with OpenA</u></a>I is but one example of how the firm has its foot on the gas to accelerate innovation and deliver on its mission statement to help simplify complexity for organizations. </p><p>So says Christian Kleinerman, the firm’s executive vice president of product, who spoke with <em>ITPro</em> ahead of Snowflake's BUILD 2026 event in London this week. </p><p>“OpenAI is clearly a very prominent leader in the world of AI. I think what they've done with ChatGPT is nothing short of phenomenal, he said. </p><p>“The partnership is significant because now we're saying, let's bring those models into the enterprise and help customers connect the data that they've already entrusted Snowflake with to those models. I point out to customers that AI in the enterprise - without their data or without context – is the same as <a href="https://www.itpro.com/technology/artificial-intelligence/everything-you-need-to-know-about-chatgpt-pro-including-pricing-features-and-available-models">ChatGPT</a>. </p><p>"But, once they plug in their context or information, their customer information, it lights up to provide answers that are relevant and meaningful to a company. That's the significance of bringing OpenAI models natively into Snowflake.” </p><p>In a press release detailing the OpenAI collaboration, <a href="https://www.itpro.com/technology/artificial-intelligence/snowflake-ceo-many-vendors-sell-you-parts-of-a-car-and-tell-you-to-build-it-yourself-at-snowflake-we-have-a-different-philosophy-we-want-to-give-you-the-car">Snowflake CEO Sridhar Ramaswamy</a> said the union set “a new standard for innovation.”</p><p>News of the partnership broke on the eve of the BUILD event, which itself brought a raft of announcements – including Cortex Code and Semantic View Autopilot GA and soon-to-be available <a href="https://www.snowflake.com/en/news/press-releases/snowflake-makes-enterprise-data-ai-ready-with-snowflake-postgres-and-advanced-innovations-for-open-data-interoperability/">Snowflake Postgres</a>, which builds on 2025’s <a href="https://www.itpro.com/business/acquisition/snowflake-crunchy-data-acquisition"><u>Crunchy Data acquisition</u></a> –  showcasing much innovation behind the scenes. </p><p>“We're announcing today all the major things we've done in the last three months, which maybe is the other thing to highlight: The pace of innovation at Snowflake is in overdrive. We held a BUILD broadcast from the US at the beginning of November. And here we are, three months later, with another truckload of innovation. That's how we're operating,” Kleinerman said, adding that, for him, the pace of innovation was “phenomenal.”</p><p>“It's an amazing type of busy. We're very proud of what we do.”</p><p>On the theme of doing rather than just talking about it, Kleinerman stressed the importance of organizations breaking away from AI theory into AI action. And quickly so. </p><p>“AI is happening today. AI is not something to talk about for next year or the next quarter. It is a reality. That’s the call to action: stop the testing and experimentation and the [talk of] we’ll do it at some point. The productivity gains are real, and the benefits are very measurable. Similar to what happened with data 10/15 years ago, those who get on board earlier are gonna have a competitive advantage,” he said. </p><p>“AI is happening now. Get on it. If you're not looking for the use case that you can have in production for your organization in the next couple of weeks, you're behind.” </p><p>Kleinerman’s keynote speech at the event drilled home the same message, with his presentation bookended by a slide that simply stayed “AI is today.”</p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/technology/artificial-intelligence/the-pace-of-innovation-at-snowflake-is-in-overdrive-buoyed-by-openai-partnership-firm-teases-more-big-things-to-come</link>
                                                                            <description>
                            <![CDATA[ Snowflake’s executive vice president of product highlights key innovations that are being brought to market at super speed ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">nyhFnR8y2z6rTk6Mc5zeVn</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/bHzvSdFUXwjSPRDncxLWwk-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Fri, 06 Feb 2026 16:35:11 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:17:06 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Platforms]]></category>
                                                    <category><![CDATA[Artificial Intelligence]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                                                                <author><![CDATA[ Maggie.holland@futurenet.com (Maggie Holland) ]]></author>                    <dc:creator><![CDATA[ Maggie Holland ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/yR3aBSQeNTZZ8SzoXbFEQ3-320-70.png ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Maggie has been a journalist since 1999. She started her career as an editorial assistant on then-weekly magazine Computing, before working her way up to senior reporter level. After several years on the magazine, she moved to &#039;the other side of the fence&#039; to work as a copywriter for a marketing agency, writing case studies and working on ad and website copy for companies such as eBay, Dell, Microsoft and more. In 2006, just weeks before&amp;nbsp;ITPro&amp;nbsp;was launched, Maggie joined Dennis Publishing as a reporter. Having worked her way up to editor of ITPro, she was appointed group editor of&amp;nbsp;CloudPro&amp;nbsp;and&amp;nbsp;ITPro&amp;nbsp;in April 2012. She became the editorial director and took responsibility for&amp;nbsp;ChannelPro,&amp;nbsp;in 2016.&lt;/p&gt;
&lt;p&gt;Her areas of particular interest, aside from cloud, include management and C-level issues, the business value of technology, green and environmental issues and careers to name but a few.&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/bHzvSdFUXwjSPRDncxLWwk-1920-80.jpg">
                                                            <media:credit><![CDATA[Snowflake]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Christian Kleinerman, EVP, product, Snowflake, speaking on stage during his keynote at the firm&#039;s BUILD 2026 event in London]]></media:description>                                                            <media:text><![CDATA[Christian Kleinerman, EVP, product, Snowflake, speaking on stage during his keynote at the firm&#039;s BUILD 2026 event in London]]></media:text>
                                <media:title type="plain"><![CDATA[Christian Kleinerman, EVP, product, Snowflake, speaking on stage during his keynote at the firm&#039;s BUILD 2026 event in London]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/bHzvSdFUXwjSPRDncxLWwk-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Snowflake’s recent <a href="https://www.itpro.com/business/data-and-insights/snowflake-and-openai-are-teaming-up-to-help-enterprises-capitalize-on-their-most-valuable-asset"><u>$200 million partnership announcement with OpenA</u></a>I is but one example of how the firm has its foot on the gas to accelerate innovation and deliver on its mission statement to help simplify complexity for organizations. </p><p>So says Christian Kleinerman, the firm’s executive vice president of product, who spoke with <em>ITPro</em> ahead of Snowflake's BUILD 2026 event in London this week. </p><p>“OpenAI is clearly a very prominent leader in the world of AI. I think what they've done with ChatGPT is nothing short of phenomenal, he said. </p><p>“The partnership is significant because now we're saying, let's bring those models into the enterprise and help customers connect the data that they've already entrusted Snowflake with to those models. I point out to customers that AI in the enterprise - without their data or without context – is the same as <a href="https://www.itpro.com/technology/artificial-intelligence/everything-you-need-to-know-about-chatgpt-pro-including-pricing-features-and-available-models">ChatGPT</a>. </p><p>"But, once they plug in their context or information, their customer information, it lights up to provide answers that are relevant and meaningful to a company. That's the significance of bringing OpenAI models natively into Snowflake.” </p><p>In a press release detailing the OpenAI collaboration, <a href="https://www.itpro.com/technology/artificial-intelligence/snowflake-ceo-many-vendors-sell-you-parts-of-a-car-and-tell-you-to-build-it-yourself-at-snowflake-we-have-a-different-philosophy-we-want-to-give-you-the-car">Snowflake CEO Sridhar Ramaswamy</a> said the union set “a new standard for innovation.”</p><p>News of the partnership broke on the eve of the BUILD event, which itself brought a raft of announcements – including Cortex Code and Semantic View Autopilot GA and soon-to-be available <a href="https://www.snowflake.com/en/news/press-releases/snowflake-makes-enterprise-data-ai-ready-with-snowflake-postgres-and-advanced-innovations-for-open-data-interoperability/">Snowflake Postgres</a>, which builds on 2025’s <a href="https://www.itpro.com/business/acquisition/snowflake-crunchy-data-acquisition"><u>Crunchy Data acquisition</u></a> –  showcasing much innovation behind the scenes. </p><p>“We're announcing today all the major things we've done in the last three months, which maybe is the other thing to highlight: The pace of innovation at Snowflake is in overdrive. We held a BUILD broadcast from the US at the beginning of November. And here we are, three months later, with another truckload of innovation. That's how we're operating,” Kleinerman said, adding that, for him, the pace of innovation was “phenomenal.”</p><p>“It's an amazing type of busy. We're very proud of what we do.”</p><p>On the theme of doing rather than just talking about it, Kleinerman stressed the importance of organizations breaking away from AI theory into AI action. And quickly so. </p><p>“AI is happening today. AI is not something to talk about for next year or the next quarter. It is a reality. That’s the call to action: stop the testing and experimentation and the [talk of] we’ll do it at some point. The productivity gains are real, and the benefits are very measurable. Similar to what happened with data 10/15 years ago, those who get on board earlier are gonna have a competitive advantage,” he said. </p><p>“AI is happening now. Get on it. If you're not looking for the use case that you can have in production for your organization in the next couple of weeks, you're behind.” </p><p>Kleinerman’s keynote speech at the event drilled home the same message, with his presentation bookended by a slide that simply stayed “AI is today.”</p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ What is database sharding and how does it benefit enterprise IT? ]]></title>
                                                                                                <dc:content><![CDATA[ <p>As enterprises grow their operations and customer base, it can become more difficult to keep on top of the amount of data that needs to be stored and managed. In particular, the traditional database server can become a bottleneck when multiple users try to save, access, and retrieve data and in extreme circumstances the system might crash or deliver a compromised user experience. </p><p>Database sharding is the process of splitting a large database into multiple smaller, independent, and manageable databases distributed across multiple machines or nodes within an enterprise network. It exists to alleviate the problems that come with storing enterprise datasets, including big data.</p><p>"Picture a massive library split into separate rooms,” says Paul Done, field CTO Modernization at MongoDB, one of the largest database companies to implement sharding. </p><p>“Instead of cramming every book into one room, books are spread across different rooms. Finding what you need remains quick as the number of books increases over time, and there isn’t a single room that becomes overcrowded."</p><p>A typical database server stores data in multiple rows and columns. Each shard contains unique but interrelated rows and columns of data, which are always a subset of a larger database. </p><p>There are three components of shards:</p><ul><li><strong>Logical shard</strong>: a set of data that has been systematically partitioned into smaller units - the shard we just defined.</li><li><strong>Physical shard</strong>: the actual hardware that “physically” holds logical shards is known as a physical shard.</li><li><strong>Shard key:</strong> a field that determines how data is divided and distributed across shards.</li></ul><h2 id="business-benefits-of-sharding">Business benefits of sharding</h2><p>Databases can be scaled vertically and horizontally. Vertical scaling expands the capabilities of a single database server by using more memory, cloud storage, CPU power, and parallel processing. A vertically scaled database can handle large volumes of data.</p><p><strong>Horizontal scalability</strong>: Sharding can horizontally scale databases. Adding more shards, volume data handling, memory load distribution, and higher transaction throughput support horizontal scaling for big data and intensive deep learning workloads. </p><p><strong>Cost-cutting</strong>: Enterprises increase storage and computational power by spending a significant portion of their IT budgets. “For firms, database sharding is far more cost-effective than upgrading one large server, which at some point isn’t possible to go any further with,” Done explains.</p><p><strong>Improved response time</strong>: Even if a single database server tries to store large chunks of data, it can process a limited number of queries and return small amounts of data. By splitting the database into smaller parts, queries need to search fewer rows and columns. Query response times improve drastically, making it easier for enterprises to retrieve data.</p><p><strong>Fault tolerance</strong>: In <a href="https://www.itpro.com/business/data-and-insights/in-the-age-of-ai-leaders-need-scrap-monolithic-data-transformations"><u>monolithic</u></a> databases, hardware malfunction, software downtime, or even planned maintenance would limit database operations and availability. It results in a single point of failure (SPOF), a total service outage that compromises business continuity. Data sharding is built on a shared-nothing architecture, where each shard is an independent data block. Failure of a shard’s host node does not impact the entire database, which allows the rest of the database to remain functional for enterprise operations. </p><h2 id="how-to-perform-database-sharding">How to perform database sharding</h2><p>Database sharding isn’t a silver bullet, nor is it the method to use in every circumstance. “Sharding methods should be selected based on specific enterprise needs,” says Radoslaw Szulgo, senior product manager at database company Percona. In addition, the choice of shard keys affects the performance and scalability of database management systems.</p><p>Let’s consider a dataset: Customer_id, name, age, and city to understand sharding. </p><div ><table><tbody><tr><td class="firstcol " ><p><strong>Entry number</strong></p></td><td  ><p><strong>Customer ID</strong></p></td><td  ><p><strong>Name</strong></p></td><td  ><p><strong>Age</strong></p></td><td  ><p><strong>City</strong></p></td></tr><tr><td class="firstcol " ><p>1</p></td><td  ><p>1000</p></td><td  ><p>Jack</p></td><td  ><p>35</p></td><td  ><p>London</p></td></tr><tr><td class="firstcol " ><p>2</p></td><td  ><p>1001</p></td><td  ><p>Kim</p></td><td  ><p>28</p></td><td  ><p>Seoul </p></td></tr><tr><td class="firstcol " ><p>3</p></td><td  ><p>1002</p></td><td  ><p>Nick</p></td><td  ><p>43</p></td><td  ><p>Edinburgh</p></td></tr><tr><td class="firstcol " ><p>4</p></td><td  ><p>1003</p></td><td  ><p>Olivia</p></td><td  ><p>22</p></td><td  ><p>Mumbai</p></td></tr><tr><td class="firstcol " ><p>5</p></td><td  ><p>1004</p></td><td  ><p>George</p></td><td  ><p>31</p></td><td  ><p>San Diego</p></td></tr><tr><td class="firstcol " ><p>6</p></td><td  ><p>1005</p></td><td  ><p>Lily</p></td><td  ><p>26</p></td><td  ><p>Tokyo</p></td></tr><tr><td class="firstcol " ><p>7</p></td><td  ><p>1006</p></td><td  ><p>James</p></td><td  ><p>30</p></td><td  ><p>Chicago </p></td></tr><tr><td class="firstcol " ><p>…</p></td><td  ><p>…</p></td><td  ><p>…</p></td><td  ><p>…</p></td><td  ><p>…</p></td></tr><tr><td class="firstcol " ><p>5000</p></td><td  ><p>5999</p></td><td  ><p>Carol</p></td><td  ><p>32</p></td><td  ><p>Berlin</p></td></tr></tbody></table></div><h3 class="article-body__section" id="section-dynamic-sharding"><span>Dynamic sharding</span></h3><p>Also known as range-based sharding, dynamic sharding splits database rows into a range of values, based on any field from the database. By setting a predefined range, data from the larger database is split into shards. </p><p>The system starts with fewer shards. As entries increase, multiple shards appear. When a single shard becomes too large or busy for user queries, it automatically splits into two or more.</p><p>For example, shard A contains all customers from 1 to 5000. When shard A becomes busy, it splits into two shards, A1 containing customer entries from 1 to 2500, and A2 containing customer entries from 2501 to 5000.</p><p>The automatic splitting property and quick implementation make dynamic sharding an ideal choice for enterprises in industries with fast-moving, large-scale information such as healthcare and finance.  </p><h3 class="article-body__section" id="section-hashed-sharding"><span>Hashed sharding</span></h3><p>Hashed sharding is also known as algorithmic sharding because it applies an <a href="https://www.itpro.com/data-insights/30212/what-is-an-algorithm">algorithm</a>, known as the hash function, to the shard key in each row. The value returned by the hash function determines the number of shards and the assignment of entries. </p><p>For example, let’s suppose that the customer ID is the shard key. The hashing function can be Customer_ID % 4.</p><div ><table><tbody><tr><td class="firstcol " ><p><strong>Customer ID</strong></p></td><td  ><p><strong>Shard assignment</strong></p></td></tr><tr><td class="firstcol " ><p>1000</p></td><td  ><p>0</p></td></tr><tr><td class="firstcol " ><p>1001</p></td><td  ><p>1</p></td></tr><tr><td class="firstcol " ><p>1002</p></td><td  ><p>2</p></td></tr><tr><td class="firstcol " ><p>1003</p></td><td  ><p>3</p></td></tr><tr><td class="firstcol " ><p>1004</p></td><td  ><p>0</p></td></tr><tr><td class="firstcol " ><p>1005</p></td><td  ><p>1</p></td></tr><tr><td class="firstcol " ><p>1006</p></td><td  ><p>2</p></td></tr><tr><td class="firstcol " ><p>…</p></td><td  ><p>…</p></td></tr><tr><td class="firstcol " ><p>5999</p></td><td  ><p>3</p></td></tr></tbody></table></div><p>There will be four shards, numbered 0, 1, 2, and 3. The table shows the assignment of customer IDs 1000 and 1004 into shard A and so on. </p><p>"The most common sharding method we’ve seen at enterprises is 'hash-based' sharding because it reliably offers uniform data distribution,” Szulgo says.</p><h3 class="article-body__section" id="section-geolocation-sharding"><span>Geolocation sharding</span></h3><p>Geolocation sharding, used by large-scale multinational corporations, considers location as the shard key. Physical shards are geo-located. </p><div ><table><tbody><tr><td class="firstcol " ><p><strong>Name</strong></p></td><td  ><p><strong>City</strong></p></td><td  ><p><strong>Shard</strong></p></td></tr><tr><td class="firstcol " ><p>Jack</p></td><td  ><p>London</p></td><td  ><p>Europe</p></td></tr><tr><td class="firstcol " ><p>Kim</p></td><td  ><p>Seoul </p></td><td  ><p>Asia</p></td></tr><tr><td class="firstcol " ><p>Nick</p></td><td  ><p>Edinburgh</p></td><td  ><p>Europe</p></td></tr><tr><td class="firstcol " ><p>Olivia</p></td><td  ><p>Mumbai</p></td><td  ><p>Asia</p></td></tr><tr><td class="firstcol " ><p>George</p></td><td  ><p>San Diego</p></td><td  ><p>North America </p></td></tr><tr><td class="firstcol " ><p>Lily</p></td><td  ><p>Tokyo</p></td><td  ><p>Asia</p></td></tr><tr><td class="firstcol " ><p>James</p></td><td  ><p>Chicago </p></td><td  ><p>North America</p></td></tr><tr><td class="firstcol " ><p>…</p></td><td  ><p>…</p></td><td  ><p>…</p></td></tr><tr><td class="firstcol " ><p>Carol</p></td><td  ><p>Berlin</p></td><td  ><p>Europe</p></td></tr></tbody></table></div><p>As data is stored near the customer location, <a href="https://www.itpro.com/infrastructure/networking/is-latency-always-important"><u>latency</u></a> and <a href="https://www.itpro.com/business/policy-and-legislation/governance-risk-and-compliance-is-a-major-growth-opportunity-but-how-will-the-market-develop"><u>compliance</u></a> risks remain low. Due to extensive use in certain regions, some shards can become overloaded while others in less active locations remain near empty. These ‘data hotspots’ limit the ability of sharded databases to perform load balancing and run fast queries.</p><p>To get around this, enterprises can further divide popular locations into distinct shards, or fine-tune the distribution of shard keys.</p><p>Shard keys must have high cardinality, which are unique values that facilitate even distribution of data. Another factor is the frequency of the shard key, which defines how often a value appears in a database. The frequency of a shard key must not be too high or low, but balanced. </p><h2 id="enterprise-strategy-sharding-with-partitioning-and-replication">Enterprise strategy: sharding with partitioning and replication</h2><p>Data replication maintains identical copies across multiple physical nodes in the enterprise network. When data replication is implemented with sharding, each shard is a replica set so that if one shard becomes unavailable, the database remains functional. Due to replication, shards that run on multiple nodes are consistent with a similar schema or design. Hence, data can be retrieved from another shard. </p><p>Data partitioning is another database management strategy that divides data into manageable segments, known as partitions. The difference between partitioning and sharding is that partitioning runs on the same database server while shards run on different servers and machines. Enterprises implement partitioning for databases that handle a high volume of read operations, whereas sharding is used for write operations.</p><p>Enterprises implement partitioning for databases that handle a high volume of read operations, whereas sharding is used for write operations. Done properly, they can work in tandem to radically improve performance. But enterprises need to carefully consider their data architecture and implementation lest they accidentally overcomplicate systems and introduce data silos.</p><p>"Frequent queries and cross-system requests require intricate coordination, sometimes leading to ungoverned local copies and security risks,” explains Tom Peirson-Webber, VP Engineering at Harbr Data.</p><p>"The solution is architectural – centralizing access and governance while keeping storage distributed.”</p><p>Enterprises need to consider whether their database is large enough to be sharded. Big data, in the order of multiple terabytes and petabytes, must be sharded because vertical scaling would exhaust <a href="https://www.itpro.com/broadband/30274/what-is-bandwidth">bandwidth</a> and increase latency. The overhead of managing multiple complex database partitions would burn CapEX. </p><p>Database sharding can lower latency radically, but the architecture needs a router to check multiple shards to return queries. Higher volume may burden routers in communicating with multiple shards and collecting data. This results in query overload and increased workload on a single physical node. </p><p>While growing databases call for high computational power, operational overhead, and increased costs, database sharding improves data storage patterns and contributes to effective big data management.</p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/technology/big-data/what-is-database-sharding-how-benefit-enterprise-it</link>
                                                                            <description>
                            <![CDATA[ Implemented properly, database sharding can radically improve performance and scalability ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">aGtJuYNEdWyBwZFSiAfdE3</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/2UYM3k4bcX6huVPzuVzHuC-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Tue, 03 Feb 2026 12:45:13 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:17:17 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Platforms]]></category>
                                                    <category><![CDATA[Big Data]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                                                                                    <dc:creator><![CDATA[ Venus Kohli ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/MDHLkwNFLuDTZe75iZQLSU-320-70.png ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Venus is a freelance technology writer specializing in IT, quantum physics, electronics, and among other technical fields. She holds a degree in Electronics and Telecommunications Engineering from Mumbai University, India. &lt;/p&gt;&lt;p&gt;Alongside &lt;em&gt;ITPro&lt;/em&gt;, Venus has written for brands including &lt;em&gt;TechTarget, &lt;/em&gt;Kigen, Wevolver, and Narrato.&lt;/p&gt;&lt;p&gt;With years of experience in writing for global media brands and IT companies, she enjoys translating complex content into engaging stories. When she’s not writing about the latest IT trends, Venus can be found tracking  enterprise trends or the newest processor in town.&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/2UYM3k4bcX6huVPzuVzHuC-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[A CGI illustration showing yellow server disks rotating around a central point to form a large circle, against a grey background.]]></media:description>                                                            <media:text><![CDATA[A CGI illustration showing yellow server disks rotating around a central point to form a large circle, against a grey background.]]></media:text>
                                <media:title type="plain"><![CDATA[A CGI illustration showing yellow server disks rotating around a central point to form a large circle, against a grey background.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/2UYM3k4bcX6huVPzuVzHuC-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>As enterprises grow their operations and customer base, it can become more difficult to keep on top of the amount of data that needs to be stored and managed. In particular, the traditional database server can become a bottleneck when multiple users try to save, access, and retrieve data and in extreme circumstances the system might crash or deliver a compromised user experience. </p><p>Database sharding is the process of splitting a large database into multiple smaller, independent, and manageable databases distributed across multiple machines or nodes within an enterprise network. It exists to alleviate the problems that come with storing enterprise datasets, including big data.</p><p>"Picture a massive library split into separate rooms,” says Paul Done, field CTO Modernization at MongoDB, one of the largest database companies to implement sharding. </p><p>“Instead of cramming every book into one room, books are spread across different rooms. Finding what you need remains quick as the number of books increases over time, and there isn’t a single room that becomes overcrowded."</p><p>A typical database server stores data in multiple rows and columns. Each shard contains unique but interrelated rows and columns of data, which are always a subset of a larger database. </p><p>There are three components of shards:</p><ul><li><strong>Logical shard</strong>: a set of data that has been systematically partitioned into smaller units - the shard we just defined.</li><li><strong>Physical shard</strong>: the actual hardware that “physically” holds logical shards is known as a physical shard.</li><li><strong>Shard key:</strong> a field that determines how data is divided and distributed across shards.</li></ul><h2 id="business-benefits-of-sharding">Business benefits of sharding</h2><p>Databases can be scaled vertically and horizontally. Vertical scaling expands the capabilities of a single database server by using more memory, cloud storage, CPU power, and parallel processing. A vertically scaled database can handle large volumes of data.</p><p><strong>Horizontal scalability</strong>: Sharding can horizontally scale databases. Adding more shards, volume data handling, memory load distribution, and higher transaction throughput support horizontal scaling for big data and intensive deep learning workloads. </p><p><strong>Cost-cutting</strong>: Enterprises increase storage and computational power by spending a significant portion of their IT budgets. “For firms, database sharding is far more cost-effective than upgrading one large server, which at some point isn’t possible to go any further with,” Done explains.</p><p><strong>Improved response time</strong>: Even if a single database server tries to store large chunks of data, it can process a limited number of queries and return small amounts of data. By splitting the database into smaller parts, queries need to search fewer rows and columns. Query response times improve drastically, making it easier for enterprises to retrieve data.</p><p><strong>Fault tolerance</strong>: In <a href="https://www.itpro.com/business/data-and-insights/in-the-age-of-ai-leaders-need-scrap-monolithic-data-transformations"><u>monolithic</u></a> databases, hardware malfunction, software downtime, or even planned maintenance would limit database operations and availability. It results in a single point of failure (SPOF), a total service outage that compromises business continuity. Data sharding is built on a shared-nothing architecture, where each shard is an independent data block. Failure of a shard’s host node does not impact the entire database, which allows the rest of the database to remain functional for enterprise operations. </p><h2 id="how-to-perform-database-sharding">How to perform database sharding</h2><p>Database sharding isn’t a silver bullet, nor is it the method to use in every circumstance. “Sharding methods should be selected based on specific enterprise needs,” says Radoslaw Szulgo, senior product manager at database company Percona. In addition, the choice of shard keys affects the performance and scalability of database management systems.</p><p>Let’s consider a dataset: Customer_id, name, age, and city to understand sharding. </p><div ><table><tbody><tr><td class="firstcol " ><p><strong>Entry number</strong></p></td><td  ><p><strong>Customer ID</strong></p></td><td  ><p><strong>Name</strong></p></td><td  ><p><strong>Age</strong></p></td><td  ><p><strong>City</strong></p></td></tr><tr><td class="firstcol " ><p>1</p></td><td  ><p>1000</p></td><td  ><p>Jack</p></td><td  ><p>35</p></td><td  ><p>London</p></td></tr><tr><td class="firstcol " ><p>2</p></td><td  ><p>1001</p></td><td  ><p>Kim</p></td><td  ><p>28</p></td><td  ><p>Seoul </p></td></tr><tr><td class="firstcol " ><p>3</p></td><td  ><p>1002</p></td><td  ><p>Nick</p></td><td  ><p>43</p></td><td  ><p>Edinburgh</p></td></tr><tr><td class="firstcol " ><p>4</p></td><td  ><p>1003</p></td><td  ><p>Olivia</p></td><td  ><p>22</p></td><td  ><p>Mumbai</p></td></tr><tr><td class="firstcol " ><p>5</p></td><td  ><p>1004</p></td><td  ><p>George</p></td><td  ><p>31</p></td><td  ><p>San Diego</p></td></tr><tr><td class="firstcol " ><p>6</p></td><td  ><p>1005</p></td><td  ><p>Lily</p></td><td  ><p>26</p></td><td  ><p>Tokyo</p></td></tr><tr><td class="firstcol " ><p>7</p></td><td  ><p>1006</p></td><td  ><p>James</p></td><td  ><p>30</p></td><td  ><p>Chicago </p></td></tr><tr><td class="firstcol " ><p>…</p></td><td  ><p>…</p></td><td  ><p>…</p></td><td  ><p>…</p></td><td  ><p>…</p></td></tr><tr><td class="firstcol " ><p>5000</p></td><td  ><p>5999</p></td><td  ><p>Carol</p></td><td  ><p>32</p></td><td  ><p>Berlin</p></td></tr></tbody></table></div><h3 class="article-body__section" id="section-dynamic-sharding"><span>Dynamic sharding</span></h3><p>Also known as range-based sharding, dynamic sharding splits database rows into a range of values, based on any field from the database. By setting a predefined range, data from the larger database is split into shards. </p><p>The system starts with fewer shards. As entries increase, multiple shards appear. When a single shard becomes too large or busy for user queries, it automatically splits into two or more.</p><p>For example, shard A contains all customers from 1 to 5000. When shard A becomes busy, it splits into two shards, A1 containing customer entries from 1 to 2500, and A2 containing customer entries from 2501 to 5000.</p><p>The automatic splitting property and quick implementation make dynamic sharding an ideal choice for enterprises in industries with fast-moving, large-scale information such as healthcare and finance.  </p><h3 class="article-body__section" id="section-hashed-sharding"><span>Hashed sharding</span></h3><p>Hashed sharding is also known as algorithmic sharding because it applies an <a href="https://www.itpro.com/data-insights/30212/what-is-an-algorithm">algorithm</a>, known as the hash function, to the shard key in each row. The value returned by the hash function determines the number of shards and the assignment of entries. </p><p>For example, let’s suppose that the customer ID is the shard key. The hashing function can be Customer_ID % 4.</p><div ><table><tbody><tr><td class="firstcol " ><p><strong>Customer ID</strong></p></td><td  ><p><strong>Shard assignment</strong></p></td></tr><tr><td class="firstcol " ><p>1000</p></td><td  ><p>0</p></td></tr><tr><td class="firstcol " ><p>1001</p></td><td  ><p>1</p></td></tr><tr><td class="firstcol " ><p>1002</p></td><td  ><p>2</p></td></tr><tr><td class="firstcol " ><p>1003</p></td><td  ><p>3</p></td></tr><tr><td class="firstcol " ><p>1004</p></td><td  ><p>0</p></td></tr><tr><td class="firstcol " ><p>1005</p></td><td  ><p>1</p></td></tr><tr><td class="firstcol " ><p>1006</p></td><td  ><p>2</p></td></tr><tr><td class="firstcol " ><p>…</p></td><td  ><p>…</p></td></tr><tr><td class="firstcol " ><p>5999</p></td><td  ><p>3</p></td></tr></tbody></table></div><p>There will be four shards, numbered 0, 1, 2, and 3. The table shows the assignment of customer IDs 1000 and 1004 into shard A and so on. </p><p>"The most common sharding method we’ve seen at enterprises is 'hash-based' sharding because it reliably offers uniform data distribution,” Szulgo says.</p><h3 class="article-body__section" id="section-geolocation-sharding"><span>Geolocation sharding</span></h3><p>Geolocation sharding, used by large-scale multinational corporations, considers location as the shard key. Physical shards are geo-located. </p><div ><table><tbody><tr><td class="firstcol " ><p><strong>Name</strong></p></td><td  ><p><strong>City</strong></p></td><td  ><p><strong>Shard</strong></p></td></tr><tr><td class="firstcol " ><p>Jack</p></td><td  ><p>London</p></td><td  ><p>Europe</p></td></tr><tr><td class="firstcol " ><p>Kim</p></td><td  ><p>Seoul </p></td><td  ><p>Asia</p></td></tr><tr><td class="firstcol " ><p>Nick</p></td><td  ><p>Edinburgh</p></td><td  ><p>Europe</p></td></tr><tr><td class="firstcol " ><p>Olivia</p></td><td  ><p>Mumbai</p></td><td  ><p>Asia</p></td></tr><tr><td class="firstcol " ><p>George</p></td><td  ><p>San Diego</p></td><td  ><p>North America </p></td></tr><tr><td class="firstcol " ><p>Lily</p></td><td  ><p>Tokyo</p></td><td  ><p>Asia</p></td></tr><tr><td class="firstcol " ><p>James</p></td><td  ><p>Chicago </p></td><td  ><p>North America</p></td></tr><tr><td class="firstcol " ><p>…</p></td><td  ><p>…</p></td><td  ><p>…</p></td></tr><tr><td class="firstcol " ><p>Carol</p></td><td  ><p>Berlin</p></td><td  ><p>Europe</p></td></tr></tbody></table></div><p>As data is stored near the customer location, <a href="https://www.itpro.com/infrastructure/networking/is-latency-always-important"><u>latency</u></a> and <a href="https://www.itpro.com/business/policy-and-legislation/governance-risk-and-compliance-is-a-major-growth-opportunity-but-how-will-the-market-develop"><u>compliance</u></a> risks remain low. Due to extensive use in certain regions, some shards can become overloaded while others in less active locations remain near empty. These ‘data hotspots’ limit the ability of sharded databases to perform load balancing and run fast queries.</p><p>To get around this, enterprises can further divide popular locations into distinct shards, or fine-tune the distribution of shard keys.</p><p>Shard keys must have high cardinality, which are unique values that facilitate even distribution of data. Another factor is the frequency of the shard key, which defines how often a value appears in a database. The frequency of a shard key must not be too high or low, but balanced. </p><h2 id="enterprise-strategy-sharding-with-partitioning-and-replication">Enterprise strategy: sharding with partitioning and replication</h2><p>Data replication maintains identical copies across multiple physical nodes in the enterprise network. When data replication is implemented with sharding, each shard is a replica set so that if one shard becomes unavailable, the database remains functional. Due to replication, shards that run on multiple nodes are consistent with a similar schema or design. Hence, data can be retrieved from another shard. </p><p>Data partitioning is another database management strategy that divides data into manageable segments, known as partitions. The difference between partitioning and sharding is that partitioning runs on the same database server while shards run on different servers and machines. Enterprises implement partitioning for databases that handle a high volume of read operations, whereas sharding is used for write operations.</p><p>Enterprises implement partitioning for databases that handle a high volume of read operations, whereas sharding is used for write operations. Done properly, they can work in tandem to radically improve performance. But enterprises need to carefully consider their data architecture and implementation lest they accidentally overcomplicate systems and introduce data silos.</p><p>"Frequent queries and cross-system requests require intricate coordination, sometimes leading to ungoverned local copies and security risks,” explains Tom Peirson-Webber, VP Engineering at Harbr Data.</p><p>"The solution is architectural – centralizing access and governance while keeping storage distributed.”</p><p>Enterprises need to consider whether their database is large enough to be sharded. Big data, in the order of multiple terabytes and petabytes, must be sharded because vertical scaling would exhaust <a href="https://www.itpro.com/broadband/30274/what-is-bandwidth">bandwidth</a> and increase latency. The overhead of managing multiple complex database partitions would burn CapEX. </p><p>Database sharding can lower latency radically, but the architecture needs a router to check multiple shards to return queries. Higher volume may burden routers in communicating with multiple shards and collecting data. This results in query overload and increased workload on a single physical node. </p><p>While growing databases call for high computational power, operational overhead, and increased costs, database sharding improves data storage patterns and contributes to effective big data management.</p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ Snowflake and OpenAI are teaming up to help enterprises capitalize on their "most valuable asset" ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Snowflake and OpenAI have announced a $200 million multi-year partnership aimed at driving enterprise agentic AI adoption. </p><p>The tie-up builds on an existing partnership between the two companies, and according to Snowflake, will help customers derive “greater value" from in-house data and simplify agent adoption. </p><p>Key to this will be the integration of OpenAI models within the company’s flagship Cortex platform, which allows customers to build and deploy custom AI applications.</p><p>OpenAI models will now be available natively within the Cortex platform for the company’s 12,000+ customers, for example. Elsewhere, models including GPT-5.2 will also be accessible through Snowflake Intelligence, the firm’s enterprise agent platform. </p><p><a href="https://www.itpro.com/technology/artificial-intelligence/snowflake-ceo-many-vendors-sell-you-parts-of-a-car-and-tell-you-to-build-it-yourself-at-snowflake-we-have-a-different-philosophy-we-want-to-give-you-the-car">Snowflake CEO Sridhar Ramaswamy</a> said the partnership will allow customers to take advantage of their “most valuable asset”. </p><p>“Customers can now harness all their enterprise knowledge in Snowflake together with the world-class intelligence of OpenAI models, enabling them to build AI agents that are powerful, responsible, and trustworthy,” he said. </p><p>“Together, we’re setting a new standard for AI innovation, helping businesses transform with confidence, while maintaining strong security and compliance standards."</p><p>The deal with OpenAI comes just weeks after a similar tie-up with one of the company's key rivals in the generative AI space, Anthropic. </p><p>In early December, Snowflake <a href="https://www.itpro.com/technology/artificial-intelligence/snowflake-inks-usd200m-deal-with-anthropic-to-drive-agentic-ai-in-the-enterprise">announced a multi-year partnership with the firm</a> – also valued at around $200 million – to integrate Anthropic's Claude models across the Cortex and Intelligence platforms. </p><h2 id="what-can-snowflake-customers-expect">What can Snowflake customers expect?</h2><p>According to Snowflake, the partnership will help simplify custom agent development, an area OpenAI has focused heavily on over the last year. </p><p>In March last year, the firm announced the <a href="https://www.itpro.com/technology/artificial-intelligence/openai-agentic-ai-development-tools">launch of a new ‘Agents Software Development Kit’ (SDK)</a> aimed at streamlining the creation, deployment, and monitoring of agents. </p><p>The tool includes observability features that allow developers to see how agents are performing, allowing them to fine-tune and tweak based on individual needs.</p><p>Snowflake noted that the duo will work closely to integrate new SDK-based features within core products, including Cortex. Agents run directly on enterprise data, but many businesses face significant hurdles unlocking value from that data - largely due to poor quality or siloed environments. </p><p>Elsewhere, integration of <a href="https://www.itpro.com/technology/artificial-intelligence/openai-says-gpt-5-2-codex-is-its-most-advanced-agentic-coding-model-yet-heres-what-developers-and-cyber-teams-can-expect">GPT-5.2</a> within Snowflake Intelligence will also give users more granular insights into enterprise data, the company noted. The platform allows users to query and interpret both structured and unstructured data using natural language prompts. </p><p>“This partnership brings our advanced models directly into that environment, making it easier to deploy AI agents and apps, so businesses can close the gap between what AI is capable of and the value they can create today,” said Fidji Simo, CEO of applications at OpenAI. </p><h3 class="article-body__section" id="section-follow-us-on-social-media"><span>FOLLOW US ON SOCIAL MEDIA</span></h3> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/data-and-insights/snowflake-and-openai-are-teaming-up-to-help-enterprises-capitalize-on-their-most-valuable-asset</link>
                                                                            <description>
                            <![CDATA[ OpenAI models and tools will now be embedded within the Snowflake Intelligence and Cortex platforms ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">N9RiKcQgeA2gyQYwH2kxP</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/ACdw6kV3yAVRtXt2xBp3Cb-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Mon, 02 Feb 2026 17:17:44 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:17:06 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Platforms]]></category>
                                                    <category><![CDATA[Data and Insights]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Business]]></category>
                                                                                                <author><![CDATA[ ross.kelly@futurenet.com (Ross Kelly) ]]></author>                    <dc:creator><![CDATA[ Ross Kelly ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/Y5vrV2V98Np6jHAGmAtCd3-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Ross Kelly is ITPro&#039;s News &amp;amp; Analysis Editor, with a keen interest in cyber security, business leadership and emerging technologies.&lt;/p&gt;
&lt;p&gt;He graduated from Edinburgh Napier University in 2016 with a BA (Hons) in Journalism, and joined ITPro in 2022 after four years working in technology conference research.&amp;nbsp;&lt;/p&gt;
&lt;p&gt;In his spare time, Ross enjoys cycling, walking and is an avid reader of history and non-fiction.&lt;/p&gt;
&lt;p&gt;You can contact Ross at ross.kelly@futurenet.com or on &lt;a href=&quot;https://twitter.com/rosswritesetc&quot;&gt;Twitter&lt;/a&gt; and &lt;a href=&quot;https://www.linkedin.com/in/ross-kelly-18a54411a/&quot;&gt;LinkedIn&lt;/a&gt;.&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/ACdw6kV3yAVRtXt2xBp3Cb-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Snowflake logo and branding pictured at Mobile World Congress 2024 in Barcelona, Spain.]]></media:description>                                                            <media:text><![CDATA[Snowflake logo and branding pictured at Mobile World Congress 2024 in Barcelona, Spain.]]></media:text>
                                <media:title type="plain"><![CDATA[Snowflake logo and branding pictured at Mobile World Congress 2024 in Barcelona, Spain.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/ACdw6kV3yAVRtXt2xBp3Cb-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Snowflake and OpenAI have announced a $200 million multi-year partnership aimed at driving enterprise agentic AI adoption. </p><p>The tie-up builds on an existing partnership between the two companies, and according to Snowflake, will help customers derive “greater value" from in-house data and simplify agent adoption. </p><p>Key to this will be the integration of OpenAI models within the company’s flagship Cortex platform, which allows customers to build and deploy custom AI applications.</p><p>OpenAI models will now be available natively within the Cortex platform for the company’s 12,000+ customers, for example. Elsewhere, models including GPT-5.2 will also be accessible through Snowflake Intelligence, the firm’s enterprise agent platform. </p><p><a href="https://www.itpro.com/technology/artificial-intelligence/snowflake-ceo-many-vendors-sell-you-parts-of-a-car-and-tell-you-to-build-it-yourself-at-snowflake-we-have-a-different-philosophy-we-want-to-give-you-the-car">Snowflake CEO Sridhar Ramaswamy</a> said the partnership will allow customers to take advantage of their “most valuable asset”. </p><p>“Customers can now harness all their enterprise knowledge in Snowflake together with the world-class intelligence of OpenAI models, enabling them to build AI agents that are powerful, responsible, and trustworthy,” he said. </p><p>“Together, we’re setting a new standard for AI innovation, helping businesses transform with confidence, while maintaining strong security and compliance standards."</p><p>The deal with OpenAI comes just weeks after a similar tie-up with one of the company's key rivals in the generative AI space, Anthropic. </p><p>In early December, Snowflake <a href="https://www.itpro.com/technology/artificial-intelligence/snowflake-inks-usd200m-deal-with-anthropic-to-drive-agentic-ai-in-the-enterprise">announced a multi-year partnership with the firm</a> – also valued at around $200 million – to integrate Anthropic's Claude models across the Cortex and Intelligence platforms. </p><h2 id="what-can-snowflake-customers-expect">What can Snowflake customers expect?</h2><p>According to Snowflake, the partnership will help simplify custom agent development, an area OpenAI has focused heavily on over the last year. </p><p>In March last year, the firm announced the <a href="https://www.itpro.com/technology/artificial-intelligence/openai-agentic-ai-development-tools">launch of a new ‘Agents Software Development Kit’ (SDK)</a> aimed at streamlining the creation, deployment, and monitoring of agents. </p><p>The tool includes observability features that allow developers to see how agents are performing, allowing them to fine-tune and tweak based on individual needs.</p><p>Snowflake noted that the duo will work closely to integrate new SDK-based features within core products, including Cortex. Agents run directly on enterprise data, but many businesses face significant hurdles unlocking value from that data - largely due to poor quality or siloed environments. </p><p>Elsewhere, integration of <a href="https://www.itpro.com/technology/artificial-intelligence/openai-says-gpt-5-2-codex-is-its-most-advanced-agentic-coding-model-yet-heres-what-developers-and-cyber-teams-can-expect">GPT-5.2</a> within Snowflake Intelligence will also give users more granular insights into enterprise data, the company noted. The platform allows users to query and interpret both structured and unstructured data using natural language prompts. </p><p>“This partnership brings our advanced models directly into that environment, making it easier to deploy AI agents and apps, so businesses can close the gap between what AI is capable of and the value they can create today,” said Fidji Simo, CEO of applications at OpenAI. </p><h3 class="article-body__section" id="section-follow-us-on-social-media"><span>FOLLOW US ON SOCIAL MEDIA</span></h3>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ CDOs are facing an uphill battle with upskilling and data management ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Europe is rushing to adopt AI, but many organizations don't trust their data and almost all say staff need more training.</p><p>Findings from Informatica’s annual <a href="https://www.informatica.com/lp/cdo-insights-2026_5264.html" target="_blank"><u>CDO Insights</u></a> study show almost eight-in-ten businesses will have adopted generative AI by the end of this quarter, and 68% will have started <a href="https://www.itpro.com/technology/artificial-intelligence/half-of-agentic-ai-projects-are-still-stuck-at-the-pilot-stage-but-thats-not-stopping-enterprises-from-ramping-up-investment">agentic AI pilots</a>. </p><p>Businesses in the UK are moving at a slower pace, however, with just 61% planning to introduce agentic AI.  </p><p>CDOs are hoping that AI will improve business decision-making and enhance employee collaboration, both cited by 32%, while 28% are looking to optimize internal processes and 27% to enhance customer experience and loyalty.</p><p>However, there's a big paradox when it comes to trust. While data leaders believe that 61% of employees - 52% in the UK - trust ‘most’ or ‘all’ of the data that their organizations are using for AI, 96% say that staff need more training in AI or data literacy to use the technology responsibly. </p><p>"Although employees generally trust the data used for AI, many are lacking in data and AI literacy skills, and organizations lack underlying AI governance structures for achieving the responsible and ethical outcomes they desire," said Krish Vitaldevara, chief product officer at Informatica from Salesforce.</p><p>This poses significant risk exposure and hurts confidence in AI initiatives."  </p><p>Most European businesses (55%) are opting to buy vendor-supplied agents, though the figure is just 44% for UK firms. Meanwhile, 45% of European organizations, and 55% in the UK, are developing and/or managing agents in-house. Of these, 21% are choosing to build using no- or low-code platforms.  </p><h2 id="too-much-too-fast">Too much, too fast</h2><p>Notably, Informatica warned enterprises may be moving too fast, with more than three-quarters of respondents saying their company’s AI visibility and governance has not kept pace with employee use of AI technology. </p><p>When it comes to AI literacy, data leaders believe that the majority of employees trust ‘most’ or ‘all’ of the data that their organizations are using for AI. However, 96% reckon employees need more data or AI literacy training in order to use AI or its outputs responsibly.</p><p>There is, though, money to deal with these issues: 85% of European businesses are increasing their data management investments in 2026, with 23% expecting to significantly increase their spend. </p><p>The top drivers for this are upskilling employees to improve data and AI fluency, improving data privacy and security, and enhancing data and AI governance, all cited by 44%. In the UK, 49% are planning to invest in data literacy.</p><p>For 57% of European data leaders and 60% of UK leaders, poor data reliability is delaying moving generative AI initiatives from pilot to production. Half are ‘very’ or ‘extremely’ concerned that new AI pilots will move forward without addressing the data reliability problems evident in previous initiatives.  </p><p>Other major blockers include security concerns, lack of agentic AI expertise, observability issues, insufficient tools for managing AI agents, and lack of safety guardrails.</p><h2 id="data-reliability-problems-persist">Data reliability problems persist</h2><p>When it comes to dealing with data reliability, 58% of organizations are improving workflows around data/AI, and 56% are investing in data and metadata collection and management. </p><p>More than half (55%) are increasing the frequency of data checks while a similar number (54%) of respondents said they are increasing investments in data quality. </p><p> "Encouragingly, there are early signs of maturity in how organisations approach AI and agentic systems”, said Emilio Valdés, SVP sales international, Informatica from Salesforce. </p><p>"Data leaders are recognizing the risk and increasing investment in data governance and compliance foundations."</p><h3 class="article-body__section" id="section-follow-us-on-social-media"><span>FOLLOW US ON SOCIAL MEDIA</span></h3> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/data-and-insights/cdos-are-facing-an-uphill-battle-with-upskilling-and-data-management</link>
                                                                            <description>
                            <![CDATA[ A survey from Informatica shows visibility and governance has not kept pace with the use of AI ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">L7CNqWnkB3T9tRiJUS2aqa</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/aBKCDtKRs8pAMuFuiPBoxF-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Wed, 28 Jan 2026 12:34:56 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:16:43 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Management]]></category>
                                                    <category><![CDATA[Data and Insights]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Business]]></category>
                                                                                                                    <dc:creator><![CDATA[ Emma Woollacott ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/aWfskavxoVSMDy6cDWtYmJ-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ null ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/aBKCDtKRs8pAMuFuiPBoxF-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Female chief data officer (CDO) examines statistics on a tablet device while male counterparts observe figures on a wall-mounted screen.]]></media:description>                                                            <media:text><![CDATA[Female chief data officer (CDO) examines statistics on a tablet device while male counterparts observe figures on a wall-mounted screen.]]></media:text>
                                <media:title type="plain"><![CDATA[Female chief data officer (CDO) examines statistics on a tablet device while male counterparts observe figures on a wall-mounted screen.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/aBKCDtKRs8pAMuFuiPBoxF-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Europe is rushing to adopt AI, but many organizations don't trust their data and almost all say staff need more training.</p><p>Findings from Informatica’s annual <a href="https://www.informatica.com/lp/cdo-insights-2026_5264.html" target="_blank"><u>CDO Insights</u></a> study show almost eight-in-ten businesses will have adopted generative AI by the end of this quarter, and 68% will have started <a href="https://www.itpro.com/technology/artificial-intelligence/half-of-agentic-ai-projects-are-still-stuck-at-the-pilot-stage-but-thats-not-stopping-enterprises-from-ramping-up-investment">agentic AI pilots</a>. </p><p>Businesses in the UK are moving at a slower pace, however, with just 61% planning to introduce agentic AI.  </p><p>CDOs are hoping that AI will improve business decision-making and enhance employee collaboration, both cited by 32%, while 28% are looking to optimize internal processes and 27% to enhance customer experience and loyalty.</p><p>However, there's a big paradox when it comes to trust. While data leaders believe that 61% of employees - 52% in the UK - trust ‘most’ or ‘all’ of the data that their organizations are using for AI, 96% say that staff need more training in AI or data literacy to use the technology responsibly. </p><p>"Although employees generally trust the data used for AI, many are lacking in data and AI literacy skills, and organizations lack underlying AI governance structures for achieving the responsible and ethical outcomes they desire," said Krish Vitaldevara, chief product officer at Informatica from Salesforce.</p><p>This poses significant risk exposure and hurts confidence in AI initiatives."  </p><p>Most European businesses (55%) are opting to buy vendor-supplied agents, though the figure is just 44% for UK firms. Meanwhile, 45% of European organizations, and 55% in the UK, are developing and/or managing agents in-house. Of these, 21% are choosing to build using no- or low-code platforms.  </p><h2 id="too-much-too-fast">Too much, too fast</h2><p>Notably, Informatica warned enterprises may be moving too fast, with more than three-quarters of respondents saying their company’s AI visibility and governance has not kept pace with employee use of AI technology. </p><p>When it comes to AI literacy, data leaders believe that the majority of employees trust ‘most’ or ‘all’ of the data that their organizations are using for AI. However, 96% reckon employees need more data or AI literacy training in order to use AI or its outputs responsibly.</p><p>There is, though, money to deal with these issues: 85% of European businesses are increasing their data management investments in 2026, with 23% expecting to significantly increase their spend. </p><p>The top drivers for this are upskilling employees to improve data and AI fluency, improving data privacy and security, and enhancing data and AI governance, all cited by 44%. In the UK, 49% are planning to invest in data literacy.</p><p>For 57% of European data leaders and 60% of UK leaders, poor data reliability is delaying moving generative AI initiatives from pilot to production. Half are ‘very’ or ‘extremely’ concerned that new AI pilots will move forward without addressing the data reliability problems evident in previous initiatives.  </p><p>Other major blockers include security concerns, lack of agentic AI expertise, observability issues, insufficient tools for managing AI agents, and lack of safety guardrails.</p><h2 id="data-reliability-problems-persist">Data reliability problems persist</h2><p>When it comes to dealing with data reliability, 58% of organizations are improving workflows around data/AI, and 56% are investing in data and metadata collection and management. </p><p>More than half (55%) are increasing the frequency of data checks while a similar number (54%) of respondents said they are increasing investments in data quality. </p><p> "Encouragingly, there are early signs of maturity in how organisations approach AI and agentic systems”, said Emilio Valdés, SVP sales international, Informatica from Salesforce. </p><p>"Data leaders are recognizing the risk and increasing investment in data governance and compliance foundations."</p><h3 class="article-body__section" id="section-follow-us-on-social-media"><span>FOLLOW US ON SOCIAL MEDIA</span></h3>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ Fears over “AI model collapse” are fueling a shift to zero trust data governance strategies ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Fears over unverified AI-generated data are pushing organizations to implement a zero trust posture for stronger data governance.</p><p><a href="https://www.itpro.com/technology/artificial-intelligence/three-open-source-large-language-models-you-can-use-today">Large language models (LLMs)</a> are typically trained on web-scraped data, and as the use of generative AI grows these sources increasingly contain AI-generated content. </p><p>This is set to accelerate in the coming years, according to Gartner. Analysis from the consultancy found 84% of respondents expect their organization to increase funding for <a href="https://www.itpro.com/technology/artificial-intelligence-ai/369959/what-is-generative-ai">generative AI</a> in 2026 – meaning that the volume of AI-generated data will continue to rise. </p><p>As a result, future generations of LLMs will increasingly be trained on outputs from previous models – outputs that may be inaccurate or biased. This means an ever-heightening risk of “model collapse,” where <a href="https://www.itpro.com/technology/artificial-intelligence/amazing-ai-tools-to-try-today">AI tools’</a> responses may no longer accurately reflect reality.</p><p>"Organizations can no longer implicitly trust data or assume it was human-generated,” said Wan Fui Chan, managing VP at Gartner. </p><p>“As AI-generated data becomes pervasive and indistinguishable from human-created data, a zero trust posture establishing authentication and verification measures is essential to safeguard business and financial outcomes.” </p><p>By 2028, Gartner found the proliferation of unverified AI-generated data is set to have prompted 50% of organizations to have implemented a zero trust posture for data governance.</p><p>Active metadata management practices will become a key differentiator for firms, the consultancy said, and organizations should consider taking several strategic actions.</p><h2 id="how-to-approach-a-zero-trust-data-governance-strategy">How to approach a zero trust data governance strategy</h2><p>According to Gartner, IT leaders should appoint a dedicated AI governance leader, responsible for AI governance, including zero trust policies, AI risk management, and compliance operations. </p><p>This person should work closely with data and analytics (D&amp;A) teams to make sure that both AI-ready data and systems are capable of handling AI-generated content.</p><p>Cross-functional teams should also be established, including cybersecurity, D&amp;A, and other relevant stakeholders. </p><p>These teams will carry out comprehensive data risk assessments to identify business risks related to AI-generated data - and decide which activities need new strategies.</p><p>Elsewhere, building on current D&amp;A governance frameworks will be crucial to tackling the issue, according to Gartner. The creation of new or updated frameworks will focus primarily on updating security, metadata management, and ethics-related policies to address new risks arising from AI-generated data.</p><h2 id="regulatory-compliance-challenges-are-afoot">Regulatory compliance challenges are afoot</h2><p>As AI-generated content becomes more prevalent, Chan warned that regulatory requirements for verifying ‘AI-free’ data are likely to intensify. </p><p>Crucially, these could differ significantly across geographies, posing serious compliance challenges. </p><p>“In this evolving regulatory environment, all organizations will need the ability to identify and tag AI-generated data," he warned. </p><p>"Success will depend on having the right tools and a workforce skilled in information and knowledge management, as well as metadata management solutions that are essential for data cataloguing.” </p><h3 class="article-body__section" id="section-follow-us-on-social-media"><span>FOLLOW US ON SOCIAL MEDIA</span></h3> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/security/data-protection/fears-over-ai-model-collapse-are-fueling-a-shift-to-zero-trust-data-governance-strategies</link>
                                                                            <description>
                            <![CDATA[ Gartner warns of "model collapse" as AI-generated data proliferates – and says organizations need to beware ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">jfdsUzHmNHhmH3JsjBzq8d</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/Ux3V79nc6iXyfwiHXRzQi3-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Thu, 22 Jan 2026 08:50:00 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:16:30 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Governance]]></category>
                                                    <category><![CDATA[Data Protection]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Cybersecurity]]></category>
                                                                                                                    <dc:creator><![CDATA[ Emma Woollacott ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/aWfskavxoVSMDy6cDWtYmJ-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ null ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/Ux3V79nc6iXyfwiHXRzQi3-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[AI zero trust concept image showing shield symbol with digitized human brain in a circle, with distributed red data points with skull symbols.]]></media:description>                                                            <media:text><![CDATA[AI zero trust concept image showing shield symbol with digitized human brain in a circle, with distributed red data points with skull symbols.]]></media:text>
                                <media:title type="plain"><![CDATA[AI zero trust concept image showing shield symbol with digitized human brain in a circle, with distributed red data points with skull symbols.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/Ux3V79nc6iXyfwiHXRzQi3-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Fears over unverified AI-generated data are pushing organizations to implement a zero trust posture for stronger data governance.</p><p><a href="https://www.itpro.com/technology/artificial-intelligence/three-open-source-large-language-models-you-can-use-today">Large language models (LLMs)</a> are typically trained on web-scraped data, and as the use of generative AI grows these sources increasingly contain AI-generated content. </p><p>This is set to accelerate in the coming years, according to Gartner. Analysis from the consultancy found 84% of respondents expect their organization to increase funding for <a href="https://www.itpro.com/technology/artificial-intelligence-ai/369959/what-is-generative-ai">generative AI</a> in 2026 – meaning that the volume of AI-generated data will continue to rise. </p><p>As a result, future generations of LLMs will increasingly be trained on outputs from previous models – outputs that may be inaccurate or biased. This means an ever-heightening risk of “model collapse,” where <a href="https://www.itpro.com/technology/artificial-intelligence/amazing-ai-tools-to-try-today">AI tools’</a> responses may no longer accurately reflect reality.</p><p>"Organizations can no longer implicitly trust data or assume it was human-generated,” said Wan Fui Chan, managing VP at Gartner. </p><p>“As AI-generated data becomes pervasive and indistinguishable from human-created data, a zero trust posture establishing authentication and verification measures is essential to safeguard business and financial outcomes.” </p><p>By 2028, Gartner found the proliferation of unverified AI-generated data is set to have prompted 50% of organizations to have implemented a zero trust posture for data governance.</p><p>Active metadata management practices will become a key differentiator for firms, the consultancy said, and organizations should consider taking several strategic actions.</p><h2 id="how-to-approach-a-zero-trust-data-governance-strategy">How to approach a zero trust data governance strategy</h2><p>According to Gartner, IT leaders should appoint a dedicated AI governance leader, responsible for AI governance, including zero trust policies, AI risk management, and compliance operations. </p><p>This person should work closely with data and analytics (D&amp;A) teams to make sure that both AI-ready data and systems are capable of handling AI-generated content.</p><p>Cross-functional teams should also be established, including cybersecurity, D&amp;A, and other relevant stakeholders. </p><p>These teams will carry out comprehensive data risk assessments to identify business risks related to AI-generated data - and decide which activities need new strategies.</p><p>Elsewhere, building on current D&amp;A governance frameworks will be crucial to tackling the issue, according to Gartner. The creation of new or updated frameworks will focus primarily on updating security, metadata management, and ethics-related policies to address new risks arising from AI-generated data.</p><h2 id="regulatory-compliance-challenges-are-afoot">Regulatory compliance challenges are afoot</h2><p>As AI-generated content becomes more prevalent, Chan warned that regulatory requirements for verifying ‘AI-free’ data are likely to intensify. </p><p>Crucially, these could differ significantly across geographies, posing serious compliance challenges. </p><p>“In this evolving regulatory environment, all organizations will need the ability to identify and tag AI-generated data," he warned. </p><p>"Success will depend on having the right tools and a workforce skilled in information and knowledge management, as well as metadata management solutions that are essential for data cataloguing.” </p><h3 class="article-body__section" id="section-follow-us-on-social-media"><span>FOLLOW US ON SOCIAL MEDIA</span></h3>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ UK channel partners to increase data-driven innovation for growth in 2026  ]]></title>
                                                                                                <dc:content><![CDATA[ <p>UK channel partners are prioritizing data-driven innovation in their quest for new growth in 2026, according to the latest research from tech distribution giant Westcon-Comstor.</p><p>As part of its Future Ready program, the company recently quizzed 500 IT strategy decision makers and influencers at partner organizations in the UK, Spain, UAE, Australia, and Singapore on their latest channel priorities.</p><p>The results revealed that almost half (47%) of UK firms plan to invest in <a href="https://www.itpro.com/business-strategy/data-insights/369366/taking-a-design-led-data-driven-approach-to-experience">data-led</a> offerings to help drive new opportunities and increase profitability over the coming year, outpacing the global average of 40%.</p><p>Additionally, 24% of UK respondents view data-driven consulting services as the single most promising revenue stream arising from digital transformation.</p><p>This heightened focus on data edged out other priorities such as market expansion and pivoting to managed services or subscription models, the distributor revealed.</p><p>"UK channel partners are leading the charge on <a href="https://www.itpro.com/technology/artificial-intelligence/maximize-your-data-insights-with-ai">data-driven innovation</a>, with nearly half prioritising analytics to fuel growth in 2026," commented Rene Klein, Westcon-Comstor's executive vice president for Europe. "It's a clear sign that the UK market is setting the pace for smarter, insight-led strategies that unlock new opportunities and deliver real competitive advantage."</p><h2 id="real-time-data">Real-time data</h2><p>Across all five countries surveyed, a majority of partners were found to already be leveraging real-time data to drive customer experience improvements and inform their business decisions.</p><p>Top applications include tracking customer behaviour and preferences (57%), refining marketing and sales strategies (50%), followed by identifying market trends (42%).</p><p>Westcon-Comstor said the findings coincide with increased adoption of its own analytics-driven sales program, Intelligent Demand (ID), which uses predictive analytics to drive growth, customer value improvements, as well as scope new markets for partners and vendors.</p><p>During 2025, Intelligent Demand supported more than 1,200 channel campaigns – up from 540 the previous year and marking a 132% year-on-year increase.</p><p><strong>'Critical driver'</strong></p><p>Commenting on the findings, Atul Damani, Westcon-Comstor's chief data officer said that data-driven innovation has become "embedded as a critical driver" of <a href="https://www.itpro.com/business/business-strategy/ai-is-now-vital-to-msp-growth-but-adoption-challenges-could-hamper-success">AI growth</a> and differentiation across the channel.</p><p>"In the era of lifecycle selling, leveraging AI-powered data and analytics can enable partners to save time, uncover highly targeted sales opportunities, and focus their energy on where they'll get results," he explained.</p><p>"As channel evolution accelerates, the importance of data will only grow, and at Westcon-Comstor, we feel distribution has a vital role to play in ensuring partners are equipped with the insights and capabilities they need to thrive."</p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/technology/big-data/uk-channel-partners-to-increase-data-driven-innovation-for-growth-in-2026</link>
                                                                            <description>
                            <![CDATA[ The latest research from Westcon-Comstor has revealed that almost half of UK channel firms plan to invest in data-led offerings over the coming year ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">JM9XEf8WU7oUAyyqNvrK8W</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/NpxpFqwAS5keGwNzDknpE-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Mon, 12 Jan 2026 16:42:03 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 12:37:01 +0000</updated>
                                                                                                                                            <category><![CDATA[Business]]></category>
                                                    <category><![CDATA[Big Data]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                                                                <author><![CDATA[ itpro@futurenet.com (Daniel Todd) ]]></author>                    <dc:creator><![CDATA[ Daniel Todd ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/SRyC34qeLpNDj3dJtsVDhT-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ null ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/NpxpFqwAS5keGwNzDknpE-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Digital generated image of abstract flowing data made out of numbers and glowing blue and red splines moving away from camera on black background.]]></media:description>                                                            <media:text><![CDATA[Digital generated image of abstract flowing data made out of numbers and glowing blue and red splines moving away from camera on black background.]]></media:text>
                                <media:title type="plain"><![CDATA[Digital generated image of abstract flowing data made out of numbers and glowing blue and red splines moving away from camera on black background.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/NpxpFqwAS5keGwNzDknpE-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>UK channel partners are prioritizing data-driven innovation in their quest for new growth in 2026, according to the latest research from tech distribution giant Westcon-Comstor.</p><p>As part of its Future Ready program, the company recently quizzed 500 IT strategy decision makers and influencers at partner organizations in the UK, Spain, UAE, Australia, and Singapore on their latest channel priorities.</p><p>The results revealed that almost half (47%) of UK firms plan to invest in <a href="https://www.itpro.com/business-strategy/data-insights/369366/taking-a-design-led-data-driven-approach-to-experience">data-led</a> offerings to help drive new opportunities and increase profitability over the coming year, outpacing the global average of 40%.</p><p>Additionally, 24% of UK respondents view data-driven consulting services as the single most promising revenue stream arising from digital transformation.</p><p>This heightened focus on data edged out other priorities such as market expansion and pivoting to managed services or subscription models, the distributor revealed.</p><p>"UK channel partners are leading the charge on <a href="https://www.itpro.com/technology/artificial-intelligence/maximize-your-data-insights-with-ai">data-driven innovation</a>, with nearly half prioritising analytics to fuel growth in 2026," commented Rene Klein, Westcon-Comstor's executive vice president for Europe. "It's a clear sign that the UK market is setting the pace for smarter, insight-led strategies that unlock new opportunities and deliver real competitive advantage."</p><h2 id="real-time-data">Real-time data</h2><p>Across all five countries surveyed, a majority of partners were found to already be leveraging real-time data to drive customer experience improvements and inform their business decisions.</p><p>Top applications include tracking customer behaviour and preferences (57%), refining marketing and sales strategies (50%), followed by identifying market trends (42%).</p><p>Westcon-Comstor said the findings coincide with increased adoption of its own analytics-driven sales program, Intelligent Demand (ID), which uses predictive analytics to drive growth, customer value improvements, as well as scope new markets for partners and vendors.</p><p>During 2025, Intelligent Demand supported more than 1,200 channel campaigns – up from 540 the previous year and marking a 132% year-on-year increase.</p><p><strong>'Critical driver'</strong></p><p>Commenting on the findings, Atul Damani, Westcon-Comstor's chief data officer said that data-driven innovation has become "embedded as a critical driver" of <a href="https://www.itpro.com/business/business-strategy/ai-is-now-vital-to-msp-growth-but-adoption-challenges-could-hamper-success">AI growth</a> and differentiation across the channel.</p><p>"In the era of lifecycle selling, leveraging AI-powered data and analytics can enable partners to save time, uncover highly targeted sales opportunities, and focus their energy on where they'll get results," he explained.</p><p>"As channel evolution accelerates, the importance of data will only grow, and at Westcon-Comstor, we feel distribution has a vital role to play in ensuring partners are equipped with the insights and capabilities they need to thrive."</p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ Solving the data dilemma: Balancing AI innovation with ethics ]]></title>
                                                                                                <dc:content><![CDATA[ <p>The current landscape between websites and AI companies is fraught with conflict.<a href="https://www.hollywoodreporter.com/business/business-news/disney-universal-midjourney-1236262563/"> <u>Disney launched a legal battle with AI company Midjourney</u></a> in 2025, and the <a href="https://www.bbc.com/news/articles/cy7ndgylzzmo"><u>BBC threatened AI firms with legal action</u></a>. </p><p>This ongoing friction is likely to change the way we use the internet, making it more difficult to access information as sites lock away content. However, access to public web data is important. It allows companies globally to develop tools for consumers to easily compare prices, for example.</p><p>Public web data is also vital for channel partners who use it to optimize marketing campaigns, verify ads, and track the price fluctuations of competitors, among other use cases. As a result, we need to ensure public web data stays just that, public and equally accessible for innovation, and that the open internet can continue. </p><h2 id="an-outline-of-web-scraping-practices">An outline of web scraping practices</h2><p>Multiple industries need public web intelligence, such as AI, ecommerce, marketing, finance, and cybersecurity. They utilize proxy IPs and public data collection solutions to access it. </p><p>With these tools, businesses can compete to offer the lowest prices for consumers. Meanwhile, cybersecurity experts use proxies to collect threat intelligence only accessible from specific locations. <a href="https://oxylabs.io/project-4beta"><u>Many universities and NGOs use proxies</u></a> for their research and to track propaganda or disinformation.</p><p>For years, e-commerce has used web intelligence to compare the prices of products against competitors. E-commerce companies also track price and inventory changes ahead of the holiday season or a specific promotion. For this reason, closing off public data access would be detrimental to channel partners who depend on intelligence gathered from the web. </p><h2 id="the-role-of-public-data-in-google-search">The role of public data in Google search </h2><p>Web scraping is almost as old as the internet itself, with Google being the biggest and best-known scraper. Originally, Google made the internet usable. But, as the internet has evolved, the way they’re interacting with public data has changed. In the age of AI, Google visits every new website, clicks on each link, gathers all available information, and stores this in its vast datacenters. </p><p>The data is then processed and indexed so that whenever you need to search for something, you simply enter specific keywords and Google will display the top websites with the desired content. </p><p>Google can do this not only because it has previously visited these websites and gathered the content, but also because the owners of those websites are happy with this process. They want Google to list them, as it increases the chances of new visitors clicking on their website.</p><h2 id="the-rise-of-anti-scraping-measures-in-the-age-of-ai">The rise of anti-scraping measures in the age of AI</h2><p>In recent years, a new player has entered the market with huge resources, impacting the whole industry and disrupting the data ecosystem. This new player is, of course, AI. According to live polls during OxyCon sessions, 57% of respondents reported that public web-scraped data remains their main source for training AI models.</p><p>With the sudden surge of AI development leading to complicated legal battles on both sides regarding training data, there are no clear rules for compliance. This is evident in the legal battle we saw X take on recently.<a href="https://techcrunch.com/2025/06/05/x-changes-its-terms-to-bar-training-of-ai-models-using-its-content/"><u> X did not want its data being used for LLM training</u></a> and, as a result, they started blocking the traffic and using their lawyers to deter organizations from gathering web intelligence from their site. </p><p>However, since then, they have lost two legal cases where the judge argued that content on X generated by users and accessible without login is, in actuality, public data - and therefore does not belong exclusively to X. </p><p>These legal battles are occurring because the landscape is unclear and difficult to navigate. Unsurprisingly, Europe is putting regulations in place the fastest; however, this has not provided a solution, and many consider Europe’s recent regulations to be unclear and too strict. Truthfully, no one in the region has a clear, confident understanding of how to comply.</p><p>Meanwhile, the US has passed 280-plus pieces of legislation in the past 12 months, while Australia is considering an<a href="https://www.theguardian.com/australia-news/2025/jun/12/australia-ai-no-alternative-industry-and-science-minister-tim-ayres"> <u>entirely new approach</u></a> with a focus on innovation. While AI is developing fast, it’s not apparent what needs to be regulated first. Naturally, by the time a new regulation is in place, the AI will have changed so much that it’s difficult to catch up and stay relevant.  </p><h2 id="the-end-of-commerce-as-we-know-it">The end of commerce as we know it </h2><p>At this point, it may seem like AI is going to lead every website to block each other to keep hold of their data. However, the huge popularity of AI suggests that this is not the best route, especially as more and more users are opting to use ChatGPT as a form of ‘search engine’ before making final purchase decisions. </p><p>Once someone has used an LLM as a product research or price comparison tool, they are far more likely, - <a href="https://www.voiceflow.com/blog/conversational-ai-for-e-commerce"><u> four times by some estimates</u></a> - to make their purchase, because the research is done. As an enterprise, if you block AI agents from scraping data from your website, your product will not be reflected in the LLM results given to consumers, and, unsurprisingly, the sales will plummet. </p><p>Web intelligence is critical for the whole digital ecosystem, allowing the building of automations and solutions with consumers in mind. However, the ongoing data wars halt innovation and cause some actors to be excluded. In this scenario, it’s crucial to find a solution for how to access data without damaging the equal opportunities of others</p><p>We’re living in truly fascinating times where technology that was created 10 years ago feels ancient now. If you’re playing by the rules, open data access helps businesses to create innovative solutions. For this reason, it’s important that public web data stays open and equally available for all to utilize.</p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/technology/artificial-intelligence/solving-the-data-dilemma-balancing-ai-innovation-with-ethics</link>
                                                                            <description>
                            <![CDATA[ Public data is a vital channel partner tool that must stay “public” ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">L4EmXZmwQHcSRWTHtjPGZ9</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/Z2DHmFxfS4UNXwoVyPeHic-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Tue, 06 Jan 2026 08:00:00 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:16:30 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Governance]]></category>
                                                    <category><![CDATA[Artificial Intelligence]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                                                                                    <dc:creator><![CDATA[ Vaidotas Sedys ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/tdZ9V2nPTaJkWQEMTxyDhZ-320-70.png ]]></dc:source>
                                                                <dc:description><![CDATA[ null ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/Z2DHmFxfS4UNXwoVyPeHic-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Blue scales with computer coding terms ]]></media:description>                                                            <media:text><![CDATA[Blue scales with computer coding terms ]]></media:text>
                                <media:title type="plain"><![CDATA[Blue scales with computer coding terms ]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/Z2DHmFxfS4UNXwoVyPeHic-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>The current landscape between websites and AI companies is fraught with conflict.<a href="https://www.hollywoodreporter.com/business/business-news/disney-universal-midjourney-1236262563/"> <u>Disney launched a legal battle with AI company Midjourney</u></a> in 2025, and the <a href="https://www.bbc.com/news/articles/cy7ndgylzzmo"><u>BBC threatened AI firms with legal action</u></a>. </p><p>This ongoing friction is likely to change the way we use the internet, making it more difficult to access information as sites lock away content. However, access to public web data is important. It allows companies globally to develop tools for consumers to easily compare prices, for example.</p><p>Public web data is also vital for channel partners who use it to optimize marketing campaigns, verify ads, and track the price fluctuations of competitors, among other use cases. As a result, we need to ensure public web data stays just that, public and equally accessible for innovation, and that the open internet can continue. </p><h2 id="an-outline-of-web-scraping-practices">An outline of web scraping practices</h2><p>Multiple industries need public web intelligence, such as AI, ecommerce, marketing, finance, and cybersecurity. They utilize proxy IPs and public data collection solutions to access it. </p><p>With these tools, businesses can compete to offer the lowest prices for consumers. Meanwhile, cybersecurity experts use proxies to collect threat intelligence only accessible from specific locations. <a href="https://oxylabs.io/project-4beta"><u>Many universities and NGOs use proxies</u></a> for their research and to track propaganda or disinformation.</p><p>For years, e-commerce has used web intelligence to compare the prices of products against competitors. E-commerce companies also track price and inventory changes ahead of the holiday season or a specific promotion. For this reason, closing off public data access would be detrimental to channel partners who depend on intelligence gathered from the web. </p><h2 id="the-role-of-public-data-in-google-search">The role of public data in Google search </h2><p>Web scraping is almost as old as the internet itself, with Google being the biggest and best-known scraper. Originally, Google made the internet usable. But, as the internet has evolved, the way they’re interacting with public data has changed. In the age of AI, Google visits every new website, clicks on each link, gathers all available information, and stores this in its vast datacenters. </p><p>The data is then processed and indexed so that whenever you need to search for something, you simply enter specific keywords and Google will display the top websites with the desired content. </p><p>Google can do this not only because it has previously visited these websites and gathered the content, but also because the owners of those websites are happy with this process. They want Google to list them, as it increases the chances of new visitors clicking on their website.</p><h2 id="the-rise-of-anti-scraping-measures-in-the-age-of-ai">The rise of anti-scraping measures in the age of AI</h2><p>In recent years, a new player has entered the market with huge resources, impacting the whole industry and disrupting the data ecosystem. This new player is, of course, AI. According to live polls during OxyCon sessions, 57% of respondents reported that public web-scraped data remains their main source for training AI models.</p><p>With the sudden surge of AI development leading to complicated legal battles on both sides regarding training data, there are no clear rules for compliance. This is evident in the legal battle we saw X take on recently.<a href="https://techcrunch.com/2025/06/05/x-changes-its-terms-to-bar-training-of-ai-models-using-its-content/"><u> X did not want its data being used for LLM training</u></a> and, as a result, they started blocking the traffic and using their lawyers to deter organizations from gathering web intelligence from their site. </p><p>However, since then, they have lost two legal cases where the judge argued that content on X generated by users and accessible without login is, in actuality, public data - and therefore does not belong exclusively to X. </p><p>These legal battles are occurring because the landscape is unclear and difficult to navigate. Unsurprisingly, Europe is putting regulations in place the fastest; however, this has not provided a solution, and many consider Europe’s recent regulations to be unclear and too strict. Truthfully, no one in the region has a clear, confident understanding of how to comply.</p><p>Meanwhile, the US has passed 280-plus pieces of legislation in the past 12 months, while Australia is considering an<a href="https://www.theguardian.com/australia-news/2025/jun/12/australia-ai-no-alternative-industry-and-science-minister-tim-ayres"> <u>entirely new approach</u></a> with a focus on innovation. While AI is developing fast, it’s not apparent what needs to be regulated first. Naturally, by the time a new regulation is in place, the AI will have changed so much that it’s difficult to catch up and stay relevant.  </p><h2 id="the-end-of-commerce-as-we-know-it">The end of commerce as we know it </h2><p>At this point, it may seem like AI is going to lead every website to block each other to keep hold of their data. However, the huge popularity of AI suggests that this is not the best route, especially as more and more users are opting to use ChatGPT as a form of ‘search engine’ before making final purchase decisions. </p><p>Once someone has used an LLM as a product research or price comparison tool, they are far more likely, - <a href="https://www.voiceflow.com/blog/conversational-ai-for-e-commerce"><u> four times by some estimates</u></a> - to make their purchase, because the research is done. As an enterprise, if you block AI agents from scraping data from your website, your product will not be reflected in the LLM results given to consumers, and, unsurprisingly, the sales will plummet. </p><p>Web intelligence is critical for the whole digital ecosystem, allowing the building of automations and solutions with consumers in mind. However, the ongoing data wars halt innovation and cause some actors to be excluded. In this scenario, it’s crucial to find a solution for how to access data without damaging the equal opportunities of others</p><p>We’re living in truly fascinating times where technology that was created 10 years ago feels ancient now. If you’re playing by the rules, open data access helps businesses to create innovative solutions. For this reason, it’s important that public web data stays open and equally available for all to utilize.</p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ CDOs believe they'll be a 'pivotal' force in the boardroom within five years ]]></title>
                                                                                                <dc:content><![CDATA[ <p><a href="https://www.itpro.com/strategy/28226/cdo-job-description-what-does-a-cdo-do">Chief data officers (CDOs) </a>might not be the most important executives in the C-suite right now, but they’ll rank among the most influential figures in no time. </p><p>That’s according to Deloitte's <a href="https://www.deloitte.com/content/dam/assets-zone2/uk/en/docs/services/risk-advisory/2025/deloitte-chief-data-officer-cdo-survey-interactive-report-2025.pdf" target="_blank"><em>Chief Data Office (CDO) report</em></a>, which found 54% of CDOs believe they have less influence on the business than their C-suite colleagues, but 44% believe that CDOs will become of equal influence by the turn of the decade. </p><p>"While over half of CDOs currently feel less influential than other C-suite leaders, there's a powerful shift on the horizon," said Andy Whitton, data, privacy and analytics partner at Deloitte. </p><p>The survey found that 57% of CDOs now report to a CIO or COO, up from 39% last year. Beyond the C-suite, nearly two-thirds of CDOs predict their teams will add employees over the next year, growing by an average 27%. </p><p>Budgets are also on the rise, with 43% saying they've seen a boost over the last year and 56% reporting an increase in data spend.</p><p>"Organizations are clearly doubling down on data, rapidly increasing their data maturity and literacy to gain crucial competitive advantage," said Whitton. </p><p>"This is positioning the CDO role as a pivotal and increasingly influential force across the C-suite, helping to drive sustained growth."</p><h2 id="chief-data-officers-are-riding-the-ai-wave">Chief data officers are riding the AI wave</h2><p>The rise in influence for CDOs is perhaps no surprise given the sharp enterprise focus on <a href="https://www.itpro.com/strategy/28181/what-is-ai">AI </a>and the key role they play in driving adoption of the technology. </p><p>Half of CDOs polled said they were accountable or responsible for AI or generative AI in their organizations, for example. Indeed, three-quarters of those surveyed revealed they have AI deployments or experiments operational right now. </p><p>Data governance and AI were by far the top priorities for CDOs, though their importance differed by sector. AI was deemed the top priority for CDOs in financial services, highlighted by two-thirds of respondents in that industry. </p><p>Meanwhile, 50% of corporate CDOs and 70% of public sector CDOs said data governance was their key focus.</p><p>Whitton said this highlights a “nuanced approach” taken by CDOs, with those operating across different sectors tailoring their priorities based on individual needs. </p><p>"For example, AI and GenAI are top of the agenda for 66% of financial services CDOs, whereas corporates are homing in on data products, and the public sector is rightly prioritizing <a href="https://www.itpro.com/policy-legislation/data-governance/369834/building-a-data-governance-strategy">data governance</a>,” he said. </p><p>Those CDOs who named AI as their core priority also tended to predict their organization will realize benefits more quickly than those who aren't prioritizing the technology – though perhaps the eye on AI payoffs like productivity gains are why they're choosing to focus on the technology in the first place. </p><p>It’s not all plain sailing for CDOs, however. Long-running finance-related issues were identified as key barriers to progress. </p><p>Nearly half of the CDOs said budget and resource limitations were the biggest hurdle to <a href="https://www.itpro.com/technology/artificial-intelligence/large-enterprises-could-be-wavering-on-ai-adoption">AI adoption</a>, for example, followed by skills gap and ethical and regulatory concerns. </p><p>A separate report from earlier this year found that two-thirds of CDOs believed <a href="https://www.itpro.com/business/data-and-insights/ai-projects-are-faltering-as-cdos-grapple-with-poor-data-quality"><u>data quality was the biggest challenge to AI adoption</u></a>, hampering them from maximizing the use of the technology. </p><h3 class="article-body__section" id="section-more-from-itpro"><span>MORE FROM ITPRO</span></h3><ul><li><a href="https://www.itpro.com/technology/artificial-intelligence-ai/358223/why-diversity-is-key-to-a-successful-ai-strategy">Why diversity is key to a successful AI strategy</a></li><li><a href="https://www.itpro.com/business/data-and-insights/data-governance-in-the-spotlight-as-uk-firms-ramp-up-ai-adoption">Data governance in the spotlight as UK firms ramp up AI adoption</a></li><li><a href="https://www.itpro.com/technology/artificial-intelligence/data-strategy-ai-adoption-failures">A quarter of firms still don’t have a formal data strategy</a></li></ul> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/leadership/chief-data-officers-believe-theyll-be-a-pivotal-force-in-in-the-c-suite-within-five-years</link>
                                                                            <description>
                            <![CDATA[ Chief data officers might not be the most important execs in the C-suite right now, but they’ll soon rank among the most influential figures, according to research from Deloitte. ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">iAvUDJ9pfdsBaGQq4BqVFF</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/ygXp4MyJjUpNiUap5SVveR-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Tue, 25 Nov 2025 11:34:20 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 15:14:08 +0000</updated>
                                                                                                                                            <category><![CDATA[Data and Analytics]]></category>
                                                                                                                    <dc:creator><![CDATA[ Nicole Kobie ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/8Y8JDDTQ7XDEk49FoAFP2S-320-70.png ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Nicole Kobie first started writing for ITPro in 2007. As a freelance journalist covering technology and business, Nicole&#039;s work includes  bylines in New Scientist, Wired, PC Pro and many more. &lt;/p&gt;&lt;p&gt;Nicole the author of a book about the history of technology, The Long History of the Future.&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/ygXp4MyJjUpNiUap5SVveR-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[C-suite strategy concept image showing female chief data officer (CDO) standing while talking to colleagues during a boardroom meeting.]]></media:description>                                                            <media:text><![CDATA[C-suite strategy concept image showing female chief data officer (CDO) standing while talking to colleagues during a boardroom meeting.]]></media:text>
                                <media:title type="plain"><![CDATA[C-suite strategy concept image showing female chief data officer (CDO) standing while talking to colleagues during a boardroom meeting.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/ygXp4MyJjUpNiUap5SVveR-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p><a href="https://www.itpro.com/strategy/28226/cdo-job-description-what-does-a-cdo-do">Chief data officers (CDOs) </a>might not be the most important executives in the C-suite right now, but they’ll rank among the most influential figures in no time. </p><p>That’s according to Deloitte's <a href="https://www.deloitte.com/content/dam/assets-zone2/uk/en/docs/services/risk-advisory/2025/deloitte-chief-data-officer-cdo-survey-interactive-report-2025.pdf" target="_blank"><em>Chief Data Office (CDO) report</em></a>, which found 54% of CDOs believe they have less influence on the business than their C-suite colleagues, but 44% believe that CDOs will become of equal influence by the turn of the decade. </p><p>"While over half of CDOs currently feel less influential than other C-suite leaders, there's a powerful shift on the horizon," said Andy Whitton, data, privacy and analytics partner at Deloitte. </p><p>The survey found that 57% of CDOs now report to a CIO or COO, up from 39% last year. Beyond the C-suite, nearly two-thirds of CDOs predict their teams will add employees over the next year, growing by an average 27%. </p><p>Budgets are also on the rise, with 43% saying they've seen a boost over the last year and 56% reporting an increase in data spend.</p><p>"Organizations are clearly doubling down on data, rapidly increasing their data maturity and literacy to gain crucial competitive advantage," said Whitton. </p><p>"This is positioning the CDO role as a pivotal and increasingly influential force across the C-suite, helping to drive sustained growth."</p><h2 id="chief-data-officers-are-riding-the-ai-wave">Chief data officers are riding the AI wave</h2><p>The rise in influence for CDOs is perhaps no surprise given the sharp enterprise focus on <a href="https://www.itpro.com/strategy/28181/what-is-ai">AI </a>and the key role they play in driving adoption of the technology. </p><p>Half of CDOs polled said they were accountable or responsible for AI or generative AI in their organizations, for example. Indeed, three-quarters of those surveyed revealed they have AI deployments or experiments operational right now. </p><p>Data governance and AI were by far the top priorities for CDOs, though their importance differed by sector. AI was deemed the top priority for CDOs in financial services, highlighted by two-thirds of respondents in that industry. </p><p>Meanwhile, 50% of corporate CDOs and 70% of public sector CDOs said data governance was their key focus.</p><p>Whitton said this highlights a “nuanced approach” taken by CDOs, with those operating across different sectors tailoring their priorities based on individual needs. </p><p>"For example, AI and GenAI are top of the agenda for 66% of financial services CDOs, whereas corporates are homing in on data products, and the public sector is rightly prioritizing <a href="https://www.itpro.com/policy-legislation/data-governance/369834/building-a-data-governance-strategy">data governance</a>,” he said. </p><p>Those CDOs who named AI as their core priority also tended to predict their organization will realize benefits more quickly than those who aren't prioritizing the technology – though perhaps the eye on AI payoffs like productivity gains are why they're choosing to focus on the technology in the first place. </p><p>It’s not all plain sailing for CDOs, however. Long-running finance-related issues were identified as key barriers to progress. </p><p>Nearly half of the CDOs said budget and resource limitations were the biggest hurdle to <a href="https://www.itpro.com/technology/artificial-intelligence/large-enterprises-could-be-wavering-on-ai-adoption">AI adoption</a>, for example, followed by skills gap and ethical and regulatory concerns. </p><p>A separate report from earlier this year found that two-thirds of CDOs believed <a href="https://www.itpro.com/business/data-and-insights/ai-projects-are-faltering-as-cdos-grapple-with-poor-data-quality"><u>data quality was the biggest challenge to AI adoption</u></a>, hampering them from maximizing the use of the technology. </p><h3 class="article-body__section" id="section-more-from-itpro"><span>MORE FROM ITPRO</span></h3><ul><li><a href="https://www.itpro.com/technology/artificial-intelligence-ai/358223/why-diversity-is-key-to-a-successful-ai-strategy">Why diversity is key to a successful AI strategy</a></li><li><a href="https://www.itpro.com/business/data-and-insights/data-governance-in-the-spotlight-as-uk-firms-ramp-up-ai-adoption">Data governance in the spotlight as UK firms ramp up AI adoption</a></li><li><a href="https://www.itpro.com/technology/artificial-intelligence/data-strategy-ai-adoption-failures">A quarter of firms still don’t have a formal data strategy</a></li></ul>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ IBM is targeting 'quantum advantage' in 12 months ]]></title>
                                                                                                <dc:content><![CDATA[ <p><a href="https://www.itpro.com/tag/ibm">IBM</a> predicts it will reach “quantum advantage” in the next 12 months, meaning the time at which quantum algorithms can begin to complement traditional computing for widespread benefits.</p><p>The technology giant has been working on <a href="https://www.itpro.com/technology/31818/what-is-quantum-computing">quantum computing</a> for decades, but in recent years has signaled that quantum computers that can deliver tangible benefits to businesses are just around the corner.</p><p>Further, the firm predicts return on investment (ROI) in quantum across select industries within the next three to five years.</p><p>For example, HSBC has partnered with IBM to develop a new <a href="https://www.itpro.com/strategy/28071/what-is-machine-learning"><u>machine learning (ML)</u></a> model for trades, with the intention of improving its margin via better predictions of buying and selling prices.</p><p>IBM took a year’s worth of HSBC’s data and applied a quantum algorithm for ‘feature selection’, a process that highlights the most relevant aspects of a dataset to improve model performance.</p><p>In tests, IBM and HSBC tracked a 34% increase in successful trades. </p><p>At a briefing on the breakthroughs, Adam Hammond, business leader at IBM Quantum EMEA, told assembled media that the model is not yet in production and still needs more training.</p><p>Nevertheless, it acts as a tangible example of how quantum algorithms could improve business performance. Outside of banking, Hammond said IBM is hoping to apply quantum computing to a wide range of sectors.</p><p>His team is working with Moderna on mRNA vaccines, the Wellcome Sanger Institute on genomics, Boeing on surface chemistry, and Bosch on superconducting hardware, as well as organizations in the farming, life sciences, and electric vehicles sectors.</p><h2 id="a-seismic-shift-in-compute-complexity">A seismic shift in compute complexity</h2><p>At the center of IBM’s latest quantum roadmap is Nighthawk, its new quantum processor which can process up to 120 qubits linked together for a 30% overall increase in complexity. </p><p>“One of the key factors in getting to quantum advantage and to useful quantum is being able to fit the size of your problem into the capabilities of the machine that's running it,” Hammond explained. </p><p>IBM measures quantum performance in ‘operations per circuit’ (OPC), with today’s chips capable of 5,000 OPC. The Nighthawk chip will use these 5,000 operations more efficiently, Hammond explained, providing a boost in the complexity of tasks that Nighthawk can complete.</p><p>On a technical level, IBM has unlocked this capability by moving from a chip layout in which each qubit was entangled with two or three others to one where each qubit is reliably entangled with four qubits. </p><p>Hammond noted that this new configuration could lead to breakthroughs in chemistry in particular, as its lattice-like structure mirrors the makeup of the chemical world.</p><p>By 2028, IBM believes it will be able to reach 15,000 OPC, tackling problems three times larger than today’s. The next year, in 2029, it is targeting full quantum fault tolerance, at which point its quantum systems will be able to produce reliable results.</p><p>The company said it will achieve this with its new large-scale Starling quantum computer, powered by its Loon chip, which will represent a seismic leap forward for the quantum sector. </p><p>It’s aiming for this system to run at 100 million OPC, the computational equivalent of one quindecillion of the world’s most powerful supercomputers – a one followed by 48 zeroes.</p><p>When <em>ITPro </em>asked Hammond to explain what this would mean for the 2030s, he explained that it was incredibly difficult to predict the future.</p><p>“Three years ago, the largest machine we had was 27 qubits – you can simulate a 27 qubit machine on your laptop,” he said.</p><p>“It's only when you get above 100 qubits that actually you can't even simulate that on the largest supercomputer in the world. In fact, actually, if you network them all together, you wouldn't be able to simulate it. </p><p>“So the hardware has made a really dramatic increase in capability in the last three years. Three years ago, I wasn't talking about real use cases with clients. We were talking about doing experimentation. Now we're really actively exploring real use cases in preparation for machines being large enough to run those in production.”</p><p>Despite this, Hammond was resolute that classical computers and AI algorithms will continue to play a huge role in the future of computing. This is because quantum computers are best suited to complex, linear equations – and worse at tasks that today’s computers excel at.</p><p>“So in the same way a GPU solves matrix algebra, what a quantum computer does is it solves complex sets of linear equations – and it so happens that that's something that classical computers really aren't very good at doing,” he said. </p><p>“So optimization tasks actually simulating nature at a sort of a molecular level, is a complex set of linear equations, linear algebra, if you're doing computational fluid dynamics. So I think what will happen is that some of those tasks that we currently use super computers to do today may well get offloaded to quantum processes.</p><p>“But that's all quantum machines do. You're never going to have Excel running on a quantum processor – you might have a particular bit of maths in your Excel spreadsheet that a quantum processor can help you with, but they're never going to replace it.”</p><p>Going forward, IBM is also looking at how these complex quantum algorithms can be integrated in existing enterprise architectures.</p><p>Hammond said in the case of HSBC, it would need to consider how its machine learning model for trading could be made to follow its checks for security, privacy, performance, and resilience.</p><h3 class="article-body__section" id="section-more-from-itpro"><span>MORE FROM ITPRO</span></h3><ul><li><a href="https://www.itpro.com/technology/future-proofing-cybersecurity-understanding-quantum-safe-ai-and-how-to-create-resilient-defences">Understanding quantum-safe AI and how to create resilient defenses</a></li><li><a href="https://www.itpro.com/technology/preparing-for-the-quantum-revolution">Preparing for the quantum revolution</a></li><li><a href="https://www.itpro.com/business/post-quantum-cryptography-is-now-top-of-mind-for-cybersecurity-leaders">Post-quantum cryptography is now top of mind for security leaders</a></li></ul> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/technology/big-data/ibm-is-targeting-quantum-advantage-in-12-months-and-says-useful-quantum-computing-is-just-a-few-years-away</link>
                                                                            <description>
                            <![CDATA[ Leading organizations are already preparing for quantum computing, which could upend our understanding of linear mathematical problems ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">ocCui2k6MVPcpPf4U8LHES</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/UnQMyk4c2W9CEnH6aTa34g-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Mon, 17 Nov 2025 09:25:08 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:31:43 +0000</updated>
                                                                                                                                            <category><![CDATA[IT Infrastructure]]></category>
                                                    <category><![CDATA[Big Data]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                                                                <author><![CDATA[ rory.bathgate@futurenet.com (Rory Bathgate) ]]></author>                    <dc:creator><![CDATA[ Rory Bathgate ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/Vep5JogbPhduK7R6CUWAm6-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Rory Bathgate was the Features and Multimedia Editor at ITPro until 2026, overseeing all in-depth content and case studies. Throughout his time at ITPro, Rory  charted the rise in popularity of generative AI and specifically companies such as Microsoft, OpenAI, and Google. &lt;/p&gt;&lt;p&gt;Alongside this, he delved into increasing calls for ethical and responsible AI as global legislators circle the technology, as well as the latest in mobile networking technology, from 5G mmWave to the 3G sunset and how it will affect businesses.&lt;/p&gt;&lt;p&gt;He  provided coverage from high-profile tech conferences such as Dell Technologies World, SuiteWorld, and VMware Explore Europe. His on-the-ground coverage  included live blogs, extensive daily coverage of the most significant announcements, analysis pieces, and podcast.&lt;/p&gt;&lt;p&gt;Rory was the co-host of the ITPro Podcast alongside Jane McCallion, where he swapped a keyboard for a microphone to discuss the latest learnings in tech.&lt;/p&gt;&lt;p&gt;Rory has an MA in Eighteenth-Century Studies from King’s College London, as well as a BA in English and American Literature from the University of Kent. He joined ITPro in 2022 as a graduate, after four years in student journalism.&lt;/p&gt;&lt;p&gt;In his free time, Rory enjoys photography and video editing, and can often be found at the cinema or reading a good science fiction paperback.&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/UnQMyk4c2W9CEnH6aTa34g-1920-80.jpg">
                                                            <media:credit><![CDATA[ITPro/Rory Bathgate]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[IBM Quantum System One display pictured at the company&#039;s London headquarters. ]]></media:description>                                                            <media:text><![CDATA[IBM Quantum System One display pictured at the company&#039;s London headquarters. ]]></media:text>
                                <media:title type="plain"><![CDATA[IBM Quantum System One display pictured at the company&#039;s London headquarters. ]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/UnQMyk4c2W9CEnH6aTa34g-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p><a href="https://www.itpro.com/tag/ibm">IBM</a> predicts it will reach “quantum advantage” in the next 12 months, meaning the time at which quantum algorithms can begin to complement traditional computing for widespread benefits.</p><p>The technology giant has been working on <a href="https://www.itpro.com/technology/31818/what-is-quantum-computing">quantum computing</a> for decades, but in recent years has signaled that quantum computers that can deliver tangible benefits to businesses are just around the corner.</p><p>Further, the firm predicts return on investment (ROI) in quantum across select industries within the next three to five years.</p><p>For example, HSBC has partnered with IBM to develop a new <a href="https://www.itpro.com/strategy/28071/what-is-machine-learning"><u>machine learning (ML)</u></a> model for trades, with the intention of improving its margin via better predictions of buying and selling prices.</p><p>IBM took a year’s worth of HSBC’s data and applied a quantum algorithm for ‘feature selection’, a process that highlights the most relevant aspects of a dataset to improve model performance.</p><p>In tests, IBM and HSBC tracked a 34% increase in successful trades. </p><p>At a briefing on the breakthroughs, Adam Hammond, business leader at IBM Quantum EMEA, told assembled media that the model is not yet in production and still needs more training.</p><p>Nevertheless, it acts as a tangible example of how quantum algorithms could improve business performance. Outside of banking, Hammond said IBM is hoping to apply quantum computing to a wide range of sectors.</p><p>His team is working with Moderna on mRNA vaccines, the Wellcome Sanger Institute on genomics, Boeing on surface chemistry, and Bosch on superconducting hardware, as well as organizations in the farming, life sciences, and electric vehicles sectors.</p><h2 id="a-seismic-shift-in-compute-complexity">A seismic shift in compute complexity</h2><p>At the center of IBM’s latest quantum roadmap is Nighthawk, its new quantum processor which can process up to 120 qubits linked together for a 30% overall increase in complexity. </p><p>“One of the key factors in getting to quantum advantage and to useful quantum is being able to fit the size of your problem into the capabilities of the machine that's running it,” Hammond explained. </p><p>IBM measures quantum performance in ‘operations per circuit’ (OPC), with today’s chips capable of 5,000 OPC. The Nighthawk chip will use these 5,000 operations more efficiently, Hammond explained, providing a boost in the complexity of tasks that Nighthawk can complete.</p><p>On a technical level, IBM has unlocked this capability by moving from a chip layout in which each qubit was entangled with two or three others to one where each qubit is reliably entangled with four qubits. </p><p>Hammond noted that this new configuration could lead to breakthroughs in chemistry in particular, as its lattice-like structure mirrors the makeup of the chemical world.</p><p>By 2028, IBM believes it will be able to reach 15,000 OPC, tackling problems three times larger than today’s. The next year, in 2029, it is targeting full quantum fault tolerance, at which point its quantum systems will be able to produce reliable results.</p><p>The company said it will achieve this with its new large-scale Starling quantum computer, powered by its Loon chip, which will represent a seismic leap forward for the quantum sector. </p><p>It’s aiming for this system to run at 100 million OPC, the computational equivalent of one quindecillion of the world’s most powerful supercomputers – a one followed by 48 zeroes.</p><p>When <em>ITPro </em>asked Hammond to explain what this would mean for the 2030s, he explained that it was incredibly difficult to predict the future.</p><p>“Three years ago, the largest machine we had was 27 qubits – you can simulate a 27 qubit machine on your laptop,” he said.</p><p>“It's only when you get above 100 qubits that actually you can't even simulate that on the largest supercomputer in the world. In fact, actually, if you network them all together, you wouldn't be able to simulate it. </p><p>“So the hardware has made a really dramatic increase in capability in the last three years. Three years ago, I wasn't talking about real use cases with clients. We were talking about doing experimentation. Now we're really actively exploring real use cases in preparation for machines being large enough to run those in production.”</p><p>Despite this, Hammond was resolute that classical computers and AI algorithms will continue to play a huge role in the future of computing. This is because quantum computers are best suited to complex, linear equations – and worse at tasks that today’s computers excel at.</p><p>“So in the same way a GPU solves matrix algebra, what a quantum computer does is it solves complex sets of linear equations – and it so happens that that's something that classical computers really aren't very good at doing,” he said. </p><p>“So optimization tasks actually simulating nature at a sort of a molecular level, is a complex set of linear equations, linear algebra, if you're doing computational fluid dynamics. So I think what will happen is that some of those tasks that we currently use super computers to do today may well get offloaded to quantum processes.</p><p>“But that's all quantum machines do. You're never going to have Excel running on a quantum processor – you might have a particular bit of maths in your Excel spreadsheet that a quantum processor can help you with, but they're never going to replace it.”</p><p>Going forward, IBM is also looking at how these complex quantum algorithms can be integrated in existing enterprise architectures.</p><p>Hammond said in the case of HSBC, it would need to consider how its machine learning model for trading could be made to follow its checks for security, privacy, performance, and resilience.</p><h3 class="article-body__section" id="section-more-from-itpro"><span>MORE FROM ITPRO</span></h3><ul><li><a href="https://www.itpro.com/technology/future-proofing-cybersecurity-understanding-quantum-safe-ai-and-how-to-create-resilient-defences">Understanding quantum-safe AI and how to create resilient defenses</a></li><li><a href="https://www.itpro.com/technology/preparing-for-the-quantum-revolution">Preparing for the quantum revolution</a></li><li><a href="https://www.itpro.com/business/post-quantum-cryptography-is-now-top-of-mind-for-cybersecurity-leaders">Post-quantum cryptography is now top of mind for security leaders</a></li></ul>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ Data engineers have never been more important, as businesses are starting to find out ]]></title>
                                                                                                <dc:content><![CDATA[ <p>The role of data engineers is changing, according to new research, and they’re becoming increasingly crucial to businesses thanks to the rise of AI. </p><p>Three-quarters of business leaders increasingly believe <a href="https://www.itpro.com/business-strategy/careers-training/30344/what-does-a-data-engineer-do"><u>data engineers</u></a> – those who manage databases and extract information for actionable insights – are now integral to the success of their company, according to a survey from MIT Technology Review and Snowflake. </p><p>That rises to 86% for the largest companies with revenue over $10bn, the survey found. </p><p>"Senior leadership is quickly realizing that if they’re not using data in their decision-making processes, they risk lagging behind their competitors," said Chris Child, VP of product data engineering at Snowflake. </p><p>In a post detailing the survey results, Child noted he saw two trends contributing to the increasingly prominent profile of data engineers. </p><p>"The first is the sheer volume of information being generated and made available today – a function of data being easier to collect and cheaper to store than ever before," Child wrote. </p><p>"The second is a growing realization among top executives that without using data to inform decisions, their organizations are essentially flying blind. This is driving demand for AI to enable the use of data in more and more complex decisions than ever before."</p><p>No wonder then that the survey found three-quarters of companies expect their data engineers to <a href="https://www.itpro.com/business/business-strategy/ai-was-touted-as-a-game-changer-for-productivity-but-employees-are-still-saddled-with-growing-workloads"><u>face ever increasing workloads</u></a>. </p><h2 id="data-engineers-are-swamped-at-work">Data engineers are swamped at work</h2><p>Indeed, the survey found that the amount of time spent by data engineers on AI projects has doubled from 19% of their day in 2023 to 37% this year – and those polled expect that to hit 61% of their work day within two years. </p><p>But they're not just putting work into AI, however, and data engineers are also getting a benefit. Three-quarters of respondents said AI has boosted the output of data engineering teams over the last two years, with a similar figure reporting an improvement in quality of work, too. </p><p>While half of those surveyed plan to begin deploying agentic AI in their workflows in the next year, with 20% already there, respondents reported expectations of continued productivity boosts. </p><p>But that optimism is tempered by concerns about complexity and exacerbating tech stack fragmentation, Snowflake noted. Because of that, the role of data engineers may become more about management. </p><p>"Over time, I think the role of the data engineer will be less about writing code for every single pipeline and more about managing the infrastructure that AI agents are operating in,” Child noted.</p><h2 id="shifting-roles-for-data-engineers">Shifting roles for data engineers</h2><p>The importance of data engineers in AI projects means the C-suite has finally come to realize and acknowledge the importance of the field. </p><p>"This has really brought data engineers to the attention of senior business leaders, with data engineers increasingly serving as essential partners for shaping strategy and driving business outcomes," said Child. </p><p>Indeed, data engineers jobs are evolving – and the role's influence is expanding. </p><p>Two-thirds (66%) of respondents said data engineers are influencing decisions about what tools to invest in and from which vendor. Meanwhile, half said engineers now have an impact on overall data strategy and how AI is used in the business. </p><p>"<a href="https://www.itpro.com/strategy/28181/what-is-ai">AI </a>is pushing leaders to reconsider data processes as a result of a <a href="https://www.itpro.com/strategy/29899/three-reasons-why-digital-transformation-is-essential-for-business-growth">digital transformation</a>," said Child. </p><p>"As <a href="https://www.itpro.com/technology/artificial-intelligence/businesses-are-being-taken-for-fools-with-ai-agents">AI agents</a> take on more work, data engineers will spend less time on extracting, transforming and loading work and more time on the data and AI strategizing that will help take the business forward." </p><p>Child advised data engineers to take advantage of the opportunities offered by the rise in <a href="https://www.itpro.com/technology/artificial-intelligence/workforce-upskilling-key-to-averting-ai-job-loss-apocalypse">AI by upskilling</a> in the subject, ensuring they have a strong understanding of key business objectives, and building strong communication skills to be able to expand their influence further. </p><h3 class="article-body__section" id="section-more-from-itpro"><span>MORE FROM ITPRO</span></h3><ul><li><a href="https://www.itpro.com/business/careers-and-training/databricks-wants-to-train-100-000-people-in-ai-across-the-uk-and-ireland-heres-how-to-get-involved">Databricks wants to train 100,000 people in AI across the UK and Ireland</a></li><li><a href="https://www.itpro.com/business/data-and-insights/data-storage-is-dead-long-live-data-management">Data storage is dead, long live data management</a></li><li><a href="https://www.itpro.com/business/business-strategy/engineering-firms-see-little-productivity-benefit-from-use-of-ai">Engineering firms see little productivity benefit from use of AI</a></li></ul> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/data-and-insights/data-engineers-have-never-been-more-important-and-businesses-are-starting-to-find-out</link>
                                                                            <description>
                            <![CDATA[ An MIT survey for Snowflake shows the changing role of data engineers – and their rise in influence ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">uZsnCQM5RMNTgQrXBxqdpM</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/aAeKTUp9Rq5AaMCtoaJ3AM-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Thu, 23 Oct 2025 13:00:00 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:16:25 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Engineering]]></category>
                                                    <category><![CDATA[Data and Insights]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Business]]></category>
                                                                                                                    <dc:creator><![CDATA[ Nicole Kobie ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/8Y8JDDTQ7XDEk49FoAFP2S-320-70.png ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Nicole Kobie first started writing for ITPro in 2007. As a freelance journalist covering technology and business, Nicole&#039;s work includes  bylines in New Scientist, Wired, PC Pro and many more. &lt;/p&gt;&lt;p&gt;Nicole the author of a book about the history of technology, The Long History of the Future.&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/aAeKTUp9Rq5AaMCtoaJ3AM-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Male and female data engineers discussing strategy and work activities in an office space with sticky notes on a wall in the background.]]></media:description>                                                            <media:text><![CDATA[Male and female data engineers discussing strategy and work activities in an office space with sticky notes on a wall in the background.]]></media:text>
                                <media:title type="plain"><![CDATA[Male and female data engineers discussing strategy and work activities in an office space with sticky notes on a wall in the background.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/aAeKTUp9Rq5AaMCtoaJ3AM-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>The role of data engineers is changing, according to new research, and they’re becoming increasingly crucial to businesses thanks to the rise of AI. </p><p>Three-quarters of business leaders increasingly believe <a href="https://www.itpro.com/business-strategy/careers-training/30344/what-does-a-data-engineer-do"><u>data engineers</u></a> – those who manage databases and extract information for actionable insights – are now integral to the success of their company, according to a survey from MIT Technology Review and Snowflake. </p><p>That rises to 86% for the largest companies with revenue over $10bn, the survey found. </p><p>"Senior leadership is quickly realizing that if they’re not using data in their decision-making processes, they risk lagging behind their competitors," said Chris Child, VP of product data engineering at Snowflake. </p><p>In a post detailing the survey results, Child noted he saw two trends contributing to the increasingly prominent profile of data engineers. </p><p>"The first is the sheer volume of information being generated and made available today – a function of data being easier to collect and cheaper to store than ever before," Child wrote. </p><p>"The second is a growing realization among top executives that without using data to inform decisions, their organizations are essentially flying blind. This is driving demand for AI to enable the use of data in more and more complex decisions than ever before."</p><p>No wonder then that the survey found three-quarters of companies expect their data engineers to <a href="https://www.itpro.com/business/business-strategy/ai-was-touted-as-a-game-changer-for-productivity-but-employees-are-still-saddled-with-growing-workloads"><u>face ever increasing workloads</u></a>. </p><h2 id="data-engineers-are-swamped-at-work">Data engineers are swamped at work</h2><p>Indeed, the survey found that the amount of time spent by data engineers on AI projects has doubled from 19% of their day in 2023 to 37% this year – and those polled expect that to hit 61% of their work day within two years. </p><p>But they're not just putting work into AI, however, and data engineers are also getting a benefit. Three-quarters of respondents said AI has boosted the output of data engineering teams over the last two years, with a similar figure reporting an improvement in quality of work, too. </p><p>While half of those surveyed plan to begin deploying agentic AI in their workflows in the next year, with 20% already there, respondents reported expectations of continued productivity boosts. </p><p>But that optimism is tempered by concerns about complexity and exacerbating tech stack fragmentation, Snowflake noted. Because of that, the role of data engineers may become more about management. </p><p>"Over time, I think the role of the data engineer will be less about writing code for every single pipeline and more about managing the infrastructure that AI agents are operating in,” Child noted.</p><h2 id="shifting-roles-for-data-engineers">Shifting roles for data engineers</h2><p>The importance of data engineers in AI projects means the C-suite has finally come to realize and acknowledge the importance of the field. </p><p>"This has really brought data engineers to the attention of senior business leaders, with data engineers increasingly serving as essential partners for shaping strategy and driving business outcomes," said Child. </p><p>Indeed, data engineers jobs are evolving – and the role's influence is expanding. </p><p>Two-thirds (66%) of respondents said data engineers are influencing decisions about what tools to invest in and from which vendor. Meanwhile, half said engineers now have an impact on overall data strategy and how AI is used in the business. </p><p>"<a href="https://www.itpro.com/strategy/28181/what-is-ai">AI </a>is pushing leaders to reconsider data processes as a result of a <a href="https://www.itpro.com/strategy/29899/three-reasons-why-digital-transformation-is-essential-for-business-growth">digital transformation</a>," said Child. </p><p>"As <a href="https://www.itpro.com/technology/artificial-intelligence/businesses-are-being-taken-for-fools-with-ai-agents">AI agents</a> take on more work, data engineers will spend less time on extracting, transforming and loading work and more time on the data and AI strategizing that will help take the business forward." </p><p>Child advised data engineers to take advantage of the opportunities offered by the rise in <a href="https://www.itpro.com/technology/artificial-intelligence/workforce-upskilling-key-to-averting-ai-job-loss-apocalypse">AI by upskilling</a> in the subject, ensuring they have a strong understanding of key business objectives, and building strong communication skills to be able to expand their influence further. </p><h3 class="article-body__section" id="section-more-from-itpro"><span>MORE FROM ITPRO</span></h3><ul><li><a href="https://www.itpro.com/business/careers-and-training/databricks-wants-to-train-100-000-people-in-ai-across-the-uk-and-ireland-heres-how-to-get-involved">Databricks wants to train 100,000 people in AI across the UK and Ireland</a></li><li><a href="https://www.itpro.com/business/data-and-insights/data-storage-is-dead-long-live-data-management">Data storage is dead, long live data management</a></li><li><a href="https://www.itpro.com/business/business-strategy/engineering-firms-see-little-productivity-benefit-from-use-of-ai">Engineering firms see little productivity benefit from use of AI</a></li></ul>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ Dell Technologies announces major data platform overhaul ]]></title>
                                                                                                <dc:content><![CDATA[ <p><a href="https://www.itpro.com/hardware/everything-you-need-to-know-about-dell">Dell Technologies</a> has announced extensive updates to its AI Data Platform, aiming to help enterprises enhance the performance and scalability of AI workloads. </p><p>The advancements include enhanced partnerships with <a href="https://www.itpro.com/business/business-strategy/everything-you-need-to-know-about-nvidia">Nvidia</a>, Elastic, and Starburst that expand Dell’s data engineering capabilities. </p><p>Dell’s AI Data Platform enables organizations to convert fragmented data into actionable insights, and the new features focus on enhancing storage and data engines across the tech giant’s services. </p><p>The changes are about catering to the growing demand for scalable <a href="https://www.itpro.com/infrastructure/ai-infrastructure-global-divide">AI infrastructure</a>.</p><p>For storage, Dell’s <a href="https://www.itpro.com/nas/27920/best-nas-drives">network-attached storage (NAS)</a> component, <a href="https://www.itpro.com/infrastructure/server-storage/356092/dell-technologies-heads-for-the-edge-with-powerscale">PowerScale</a>, now integrates with Nvidia GB200 and GB300 NVL71 – much of this update is about reduction as it will use up to five times less rack space, 88% fewer network switches, and up to 72% lower power consumption when compared to rival services. </p><p>According to Dell, the integration will also deliver 16,000-plus GPU-scale.    </p><p>Meanwhile, ObjectScale, Dell’s object storage platform, is now available as both an appliance and a software-defined option on Dell PowerEdge servers. This will offer speeds up to eight times faster than previous generations of all-flash storage. </p><p>It will also include <a href="https://www.itpro.com/cloud/amazon-s3/367664/what-is-amazon-s3">Amazon S3</a> over RDMA support as a technical preview starting from December.</p><h2 id="dell-technologies-eyes-data-engine-boost">Dell Technologies eyes data engine boost</h2><p>The announcements also included a roll-out of new and improved data engines, in partnership with <a href="https://www.itpro.com/strategy/28181/what-is-ai">AI </a>specialist <a href="https://www.itpro.com/software/open-source/elastic-returns-to-open-source-but-can-it-regain-the-communitys-trust-some-industry-players-arent-holding-their-breath">Elastic</a>. These are for Dell’s Data Search Engine, which integrates with MetadataIQ data discovery software to search billions of files on PowerScale and ObjectScale using granular metadata. </p><p>For developers, it means they can build smarter RAG applications in tools such as LangChain with the engine. What’s more, they save compute time and keep vector databases current by ingesting only updated files. </p><p>Meanwhile, a collaboration with Starburst will deliver new features in Dell’s Data Analytics Engine, such as an Agentic Layer, which uses LLMs to turn raw data into business assets in a matter of seconds. </p><p>This is described as ‘enterprise-level AI model monitoring and governance’ as it gives teams control over both access and use.</p><p><strong>“</strong>Access to all of your data is the foundation for enterprise AI success,” said Justin Borgman, the CEO of Starburst. </p><p>“Our expanded collaboration with Dell Technologies unites Starburst’s data federation with Dell’s AI Data Platform, giving organizations the ability to unlock insights from anywhere and accelerate their path to real-world AI outcomes.” </p><p>All <a href="https://www.itpro.com/infrastructure/servers-and-storage/jensen-huang-takes-the-stage-at-dell-technologies-world-to-talk-servers-and-ai-factories">ObjectScale </a>features will be available as a preview in December, while the Data Analytics Engine’s Agentic layer will be released in February 2026. Dell’s PowerScale services with Nvidia, however, are already available. </p><h3 class="article-body__section" id="section-more-from-itpro"><span>MORE FROM ITPRO</span></h3><ul><li><a href="https://www.itpro.com/hardware/its-almost-mind-boggling-dell-is-betting-big-on-ai-pcs-but-customers-are-less-enthusiastic">Dell is betting big on AI PCs, but customers are less enthusiastic</a></li><li><a href="https://www.itpro.com/technology/artificial-intelligence/dell-technologies-world-2025-all-in-on-ai">Dell Technologies World 2025: All in on AI</a></li><li><a href="https://www.itpro.com/infrastructure/dell-technologies-wants-to-cut-infrastructure-costs-heres-how-it-plans-to-do-it">Dell Technologies wants to cut infrastructure costs – here's how it plans to do it</a></li></ul> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/infrastructure/dell-technologies-touts-major-data-platform-overhaul-with-nvidia-elastic-and-starburst-collaborations</link>
                                                                            <description>
                            <![CDATA[ Dell has unveiled extensive updates and new features in storage and data engines in a bid cater to the growing demand for scalable AI infrastructure ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">rf7URYszAHTcHMRfx6jqkM</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/dKtasuhXfSvXnywV8vYJ2d-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Thu, 23 Oct 2025 09:29:24 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:17:04 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Platforms]]></category>
                                                    <category><![CDATA[Infrastructure]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                                                                <author><![CDATA[ itpro@futurenet.com (Bobby Hellard) ]]></author>                    <dc:creator><![CDATA[ Bobby Hellard ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/bsR2tHSyVKUoyXZF5pNsDA-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Bobby Hellard&amp;nbsp;is&amp;nbsp;ITPro&#039;s Reviews Editor and has worked on&amp;nbsp;CloudPro and ChannelPro since 2018. In his time at ITPro, Bobby has covered stories for all the major technology companies, such as Apple, Microsoft, Amazon and Facebook, and regularly attends industry-leading events such as AWS Re:Invent and Google Cloud Next.&lt;/p&gt;
&lt;p&gt;Bobby mainly covers hardware reviews, but you will also recognize him as the face of many of our video reviews of laptops and smartphones.&lt;/p&gt;
&lt;p&gt;He has been a journalist for ten years, originally covering sports, before moving into business technology with ITPro. He has bylines in The Independent, Vice and The Business Briefing. Contact him at &lt;a href=&quot;mailto:bobby.hellard@futurenet.com&quot;&gt;bobby.hellard@futurenet.com&lt;/a&gt; or find him on Twitter: &lt;a href=&quot;https://twitter.com/bobbyhellard&quot;&gt;@bobbyhellard&lt;/a&gt;&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/dKtasuhXfSvXnywV8vYJ2d-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Dell Technologies logo pictured at the company&#039;s vendor stall at Mobile World Congress (MWC) in Barcelona, Spain.]]></media:description>                                                            <media:text><![CDATA[Dell Technologies logo pictured at the company&#039;s vendor stall at Mobile World Congress (MWC) in Barcelona, Spain.]]></media:text>
                                <media:title type="plain"><![CDATA[Dell Technologies logo pictured at the company&#039;s vendor stall at Mobile World Congress (MWC) in Barcelona, Spain.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/dKtasuhXfSvXnywV8vYJ2d-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p><a href="https://www.itpro.com/hardware/everything-you-need-to-know-about-dell">Dell Technologies</a> has announced extensive updates to its AI Data Platform, aiming to help enterprises enhance the performance and scalability of AI workloads. </p><p>The advancements include enhanced partnerships with <a href="https://www.itpro.com/business/business-strategy/everything-you-need-to-know-about-nvidia">Nvidia</a>, Elastic, and Starburst that expand Dell’s data engineering capabilities. </p><p>Dell’s AI Data Platform enables organizations to convert fragmented data into actionable insights, and the new features focus on enhancing storage and data engines across the tech giant’s services. </p><p>The changes are about catering to the growing demand for scalable <a href="https://www.itpro.com/infrastructure/ai-infrastructure-global-divide">AI infrastructure</a>.</p><p>For storage, Dell’s <a href="https://www.itpro.com/nas/27920/best-nas-drives">network-attached storage (NAS)</a> component, <a href="https://www.itpro.com/infrastructure/server-storage/356092/dell-technologies-heads-for-the-edge-with-powerscale">PowerScale</a>, now integrates with Nvidia GB200 and GB300 NVL71 – much of this update is about reduction as it will use up to five times less rack space, 88% fewer network switches, and up to 72% lower power consumption when compared to rival services. </p><p>According to Dell, the integration will also deliver 16,000-plus GPU-scale.    </p><p>Meanwhile, ObjectScale, Dell’s object storage platform, is now available as both an appliance and a software-defined option on Dell PowerEdge servers. This will offer speeds up to eight times faster than previous generations of all-flash storage. </p><p>It will also include <a href="https://www.itpro.com/cloud/amazon-s3/367664/what-is-amazon-s3">Amazon S3</a> over RDMA support as a technical preview starting from December.</p><h2 id="dell-technologies-eyes-data-engine-boost">Dell Technologies eyes data engine boost</h2><p>The announcements also included a roll-out of new and improved data engines, in partnership with <a href="https://www.itpro.com/strategy/28181/what-is-ai">AI </a>specialist <a href="https://www.itpro.com/software/open-source/elastic-returns-to-open-source-but-can-it-regain-the-communitys-trust-some-industry-players-arent-holding-their-breath">Elastic</a>. These are for Dell’s Data Search Engine, which integrates with MetadataIQ data discovery software to search billions of files on PowerScale and ObjectScale using granular metadata. </p><p>For developers, it means they can build smarter RAG applications in tools such as LangChain with the engine. What’s more, they save compute time and keep vector databases current by ingesting only updated files. </p><p>Meanwhile, a collaboration with Starburst will deliver new features in Dell’s Data Analytics Engine, such as an Agentic Layer, which uses LLMs to turn raw data into business assets in a matter of seconds. </p><p>This is described as ‘enterprise-level AI model monitoring and governance’ as it gives teams control over both access and use.</p><p><strong>“</strong>Access to all of your data is the foundation for enterprise AI success,” said Justin Borgman, the CEO of Starburst. </p><p>“Our expanded collaboration with Dell Technologies unites Starburst’s data federation with Dell’s AI Data Platform, giving organizations the ability to unlock insights from anywhere and accelerate their path to real-world AI outcomes.” </p><p>All <a href="https://www.itpro.com/infrastructure/servers-and-storage/jensen-huang-takes-the-stage-at-dell-technologies-world-to-talk-servers-and-ai-factories">ObjectScale </a>features will be available as a preview in December, while the Data Analytics Engine’s Agentic layer will be released in February 2026. Dell’s PowerScale services with Nvidia, however, are already available. </p><h3 class="article-body__section" id="section-more-from-itpro"><span>MORE FROM ITPRO</span></h3><ul><li><a href="https://www.itpro.com/hardware/its-almost-mind-boggling-dell-is-betting-big-on-ai-pcs-but-customers-are-less-enthusiastic">Dell is betting big on AI PCs, but customers are less enthusiastic</a></li><li><a href="https://www.itpro.com/technology/artificial-intelligence/dell-technologies-world-2025-all-in-on-ai">Dell Technologies World 2025: All in on AI</a></li><li><a href="https://www.itpro.com/infrastructure/dell-technologies-wants-to-cut-infrastructure-costs-heres-how-it-plans-to-do-it">Dell Technologies wants to cut infrastructure costs – here's how it plans to do it</a></li></ul>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ How EDF empowered its decision-makers with a consolidated data strategy ]]></title>
                                                                                                <dc:content><![CDATA[ <p>EDF is one of Europe’s largest energy companies, with an extensive operational footprint across the region, including power stations and energy infrastructure.</p><p>Over time, this growth piled <a href="https://www.itpro.com/business/digital-transformation/paying-down-technical-problem-for-businesses">legacy systems</a> and disparate data sources together in an increasingly inefficient manner, putting pressure on operations teams to put in work to understand data on a daily basis.</p><p>It became clear that the firm needed a new, single pane of glass for its data.</p><p><em>ITPro</em> spoke to Kenny Scott, data governance consultant at 8 Governed Gates (8GG), to learn more about how its data transformation had assisted the power company to accelerate clean energy deployment.</p><p>Scott describes how in June 2023, EDF decided on a new digital strategy, with a target of achieving strategic growth, getting the right data to its decision-makers, improving colleague engagement, and ensuring its operations are sustainable.</p><p>In response it has created DataVolt, powered by <a href="https://www.itpro.com/business/business-strategy/salesforce-informatica-acquisition-mulesoft-data-integration">Informatica</a> solutions along with <a href="https://www.itpro.com/business/business-strategy/snowflake-revamps-channel-program-to-meet-rising-data-and-ai-demand">Snowflake</a> and <a href="https://www.itpro.com/software/development/rolls-royce-is-empowering-citizen-developers-through-power-bi">Power BI</a>.</p><p>“We want insights on demand, not putting you into a queue, not going into a ticket system that’s going to take us three to four weeks to even get a response,” Scott said, in a talk on the new system.</p><p>Scott used the analogy of an ‘engine room’ to describe how the three offerings work in tandem under the hood of DataVolt to ensure employees at EDF can access the data they need.</p><p>“Informatica is the foundation of what we do, it’s the entry point, it is the cohesive glue for everything that’s there,” he says, adding that Informatica has become the “tool of choice” for data governance, particularly for handling metadata.</p><p>“Snowflake, it’s got the power, power is the key word for us. It's scalable, it's available, there's resources in the marketplace – if we need it, we can train people up to do what we need with it. Then Power BI, we talked about single pane of glass, that's our single pane of glass. It's the one place that we will go from the organization to find out those questions.”</p><h2 id="sustainable-generation-as-a-north-star">Sustainable generation as a north star</h2><p>As one might expect, the power generation side of the business is critical for EDF, which has a “north star” to generate 10GW of energy in the UK by 2035.</p><p>This necessitates a strong focus on onshore and <a href="https://www.itpro.com/infrastructure/data-centres/microsoft-just-signed-the-biggest-corporate-renewable-energy-deal-ever-and-its-all-to-keep-up-with-soaring-ai-data-center-power-demands">offshore wind</a> to meet this target – and won’t be met unless EDF can keep its wind turbines operational. </p><p>Scott explains that this means engineers need to be assigned to them in a “timely fashion” and with the right equipment for the job. Without all the relevant oils, tubes, and other kit, turbines could be out of operation for another day or more.</p><p>“[T]he main driver for this piece of work was it's taking too long to analyze disparate sources and come to a decision that we need in the organization, whereas now because we've got the Power BI and the consolidated data, and we know what it is and equality and who owns it, you can get to that decision point more swiftly.”</p><p>With access to historical data and data driven decisions powered by Informatica’s tools, EDF can also use DataVolt to predict its upcoming wind generation figures and to decide on new wind farm sites.</p><p>Scott says EDF has started DataVolt operations with its wind and battery teams, as a chance to make targeted changes that bring huge operational benefits to the larger business.</p><p>He tells <em>ITPro</em> that some of the initial hurdles for his team included overcoming outdated company cultures regarding data and IT.</p><p>“When I first came into EDF, we were faced with stories of ‘we don't have any data’, because it was in spreadsheets or it was on SharePoint.</p><p>“There was no cognizance of <a href="https://www.itpro.com/business/business-strategy/what-does-data-driven-mean-in-business"><u>data being an entity that was of value</u></a> in the organization. Now, we helped change that conversation. And then, as people say, ‘Ah, but we've got these pain points’. Well, that's because you don't have the data in the right place, in the right format. Then they start to realize, then you start to get the buy-in.”</p><p>EDF has spent the past 18 months labelling its legacy data and it into Snowflake, with Informatica then used to explore and effectively use this data.</p><p>“A lot of this is hearts and minds, about getting the organization to want to do it,” Scott tells <em>ITPro</em>.</p><p>“So if you show them success little and often, and you keep repeating that, then you're going to have a bit of buy-in. And then you're going to have new stakeholders who are going to be interested because people buy from people, but they also buy from the stories of their peers.”</p><h2 id="building-on-the-foundation">Building on the foundation</h2><p>Going forward, EDF will continue to work on its data consolidation, with a view to embedding more AI in its platform.</p><p>Scott picked out Informatica’s CLAIRE GPT data management assistant as a potential boon for the business, particularly with its ability to pull out data insights for users based on <a href="https://www.itpro.com/machine-learning/33308/what-is-natural-language-processing"><u>natural language</u></a> prompts. He expressed hope that its work on labelling and metadata to date will help make future AI adoption easier.</p><p>“I think we’re in a fortunate position because we’ve laid down the foundation.”</p><p>Any leader looking to engage in a similar project, Scott said, must ensure everyone on their team is informed and onboard from the beginning of a project and that any concerns are raised as early as possible. </p><p>“Too many conversations can be submissive, because people either just want to get out of a meeting or they’re not that interested,” he says.</p><p>“But then again, you can get some contentious ones – but for me, the contentious ones are where you will solve problems, because the biggest advocates in any organization are the ones that you've turned around from being a detractor from what you're trying to do.”</p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/digital-transformation/edf-consolidated-data-strategy-informatica</link>
                                                                            <description>
                            <![CDATA[ Using Informatica solutions as the foundation for its new data platform, EDF has achieved hugely streamlined operations ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">xxYKyE6kWhtoDpkN8peM4P</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/zzbDfrPdr2gZWjZhGVn7p7-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Wed, 08 Oct 2025 12:45:14 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:17:01 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Management]]></category>
                                                    <category><![CDATA[Digital Transformation]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[IT Leadership]]></category>
                                                                                                <author><![CDATA[ rory.bathgate@futurenet.com (Rory Bathgate) ]]></author>                    <dc:creator><![CDATA[ Rory Bathgate ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/Vep5JogbPhduK7R6CUWAm6-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Rory Bathgate was the Features and Multimedia Editor at ITPro until 2026, overseeing all in-depth content and case studies. Throughout his time at ITPro, Rory  charted the rise in popularity of generative AI and specifically companies such as Microsoft, OpenAI, and Google. &lt;/p&gt;&lt;p&gt;Alongside this, he delved into increasing calls for ethical and responsible AI as global legislators circle the technology, as well as the latest in mobile networking technology, from 5G mmWave to the 3G sunset and how it will affect businesses.&lt;/p&gt;&lt;p&gt;He  provided coverage from high-profile tech conferences such as Dell Technologies World, SuiteWorld, and VMware Explore Europe. His on-the-ground coverage  included live blogs, extensive daily coverage of the most significant announcements, analysis pieces, and podcast.&lt;/p&gt;&lt;p&gt;Rory was the co-host of the ITPro Podcast alongside Jane McCallion, where he swapped a keyboard for a microphone to discuss the latest learnings in tech.&lt;/p&gt;&lt;p&gt;Rory has an MA in Eighteenth-Century Studies from King’s College London, as well as a BA in English and American Literature from the University of Kent. He joined ITPro in 2022 as a graduate, after four years in student journalism.&lt;/p&gt;&lt;p&gt;In his free time, Rory enjoys photography and video editing, and can often be found at the cinema or reading a good science fiction paperback.&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/zzbDfrPdr2gZWjZhGVn7p7-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[An Electricite de France SA (EDF) engineer wearing a high-vis jacket checks a smartphone at the Gravelines nuclear power station, operated by EDF.]]></media:description>                                                            <media:text><![CDATA[An Electricite de France SA (EDF) engineer wearing a high-vis jacket checks a smartphone at the Gravelines nuclear power station, operated by EDF.]]></media:text>
                                <media:title type="plain"><![CDATA[An Electricite de France SA (EDF) engineer wearing a high-vis jacket checks a smartphone at the Gravelines nuclear power station, operated by EDF.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/zzbDfrPdr2gZWjZhGVn7p7-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>EDF is one of Europe’s largest energy companies, with an extensive operational footprint across the region, including power stations and energy infrastructure.</p><p>Over time, this growth piled <a href="https://www.itpro.com/business/digital-transformation/paying-down-technical-problem-for-businesses">legacy systems</a> and disparate data sources together in an increasingly inefficient manner, putting pressure on operations teams to put in work to understand data on a daily basis.</p><p>It became clear that the firm needed a new, single pane of glass for its data.</p><p><em>ITPro</em> spoke to Kenny Scott, data governance consultant at 8 Governed Gates (8GG), to learn more about how its data transformation had assisted the power company to accelerate clean energy deployment.</p><p>Scott describes how in June 2023, EDF decided on a new digital strategy, with a target of achieving strategic growth, getting the right data to its decision-makers, improving colleague engagement, and ensuring its operations are sustainable.</p><p>In response it has created DataVolt, powered by <a href="https://www.itpro.com/business/business-strategy/salesforce-informatica-acquisition-mulesoft-data-integration">Informatica</a> solutions along with <a href="https://www.itpro.com/business/business-strategy/snowflake-revamps-channel-program-to-meet-rising-data-and-ai-demand">Snowflake</a> and <a href="https://www.itpro.com/software/development/rolls-royce-is-empowering-citizen-developers-through-power-bi">Power BI</a>.</p><p>“We want insights on demand, not putting you into a queue, not going into a ticket system that’s going to take us three to four weeks to even get a response,” Scott said, in a talk on the new system.</p><p>Scott used the analogy of an ‘engine room’ to describe how the three offerings work in tandem under the hood of DataVolt to ensure employees at EDF can access the data they need.</p><p>“Informatica is the foundation of what we do, it’s the entry point, it is the cohesive glue for everything that’s there,” he says, adding that Informatica has become the “tool of choice” for data governance, particularly for handling metadata.</p><p>“Snowflake, it’s got the power, power is the key word for us. It's scalable, it's available, there's resources in the marketplace – if we need it, we can train people up to do what we need with it. Then Power BI, we talked about single pane of glass, that's our single pane of glass. It's the one place that we will go from the organization to find out those questions.”</p><h2 id="sustainable-generation-as-a-north-star">Sustainable generation as a north star</h2><p>As one might expect, the power generation side of the business is critical for EDF, which has a “north star” to generate 10GW of energy in the UK by 2035.</p><p>This necessitates a strong focus on onshore and <a href="https://www.itpro.com/infrastructure/data-centres/microsoft-just-signed-the-biggest-corporate-renewable-energy-deal-ever-and-its-all-to-keep-up-with-soaring-ai-data-center-power-demands">offshore wind</a> to meet this target – and won’t be met unless EDF can keep its wind turbines operational. </p><p>Scott explains that this means engineers need to be assigned to them in a “timely fashion” and with the right equipment for the job. Without all the relevant oils, tubes, and other kit, turbines could be out of operation for another day or more.</p><p>“[T]he main driver for this piece of work was it's taking too long to analyze disparate sources and come to a decision that we need in the organization, whereas now because we've got the Power BI and the consolidated data, and we know what it is and equality and who owns it, you can get to that decision point more swiftly.”</p><p>With access to historical data and data driven decisions powered by Informatica’s tools, EDF can also use DataVolt to predict its upcoming wind generation figures and to decide on new wind farm sites.</p><p>Scott says EDF has started DataVolt operations with its wind and battery teams, as a chance to make targeted changes that bring huge operational benefits to the larger business.</p><p>He tells <em>ITPro</em> that some of the initial hurdles for his team included overcoming outdated company cultures regarding data and IT.</p><p>“When I first came into EDF, we were faced with stories of ‘we don't have any data’, because it was in spreadsheets or it was on SharePoint.</p><p>“There was no cognizance of <a href="https://www.itpro.com/business/business-strategy/what-does-data-driven-mean-in-business"><u>data being an entity that was of value</u></a> in the organization. Now, we helped change that conversation. And then, as people say, ‘Ah, but we've got these pain points’. Well, that's because you don't have the data in the right place, in the right format. Then they start to realize, then you start to get the buy-in.”</p><p>EDF has spent the past 18 months labelling its legacy data and it into Snowflake, with Informatica then used to explore and effectively use this data.</p><p>“A lot of this is hearts and minds, about getting the organization to want to do it,” Scott tells <em>ITPro</em>.</p><p>“So if you show them success little and often, and you keep repeating that, then you're going to have a bit of buy-in. And then you're going to have new stakeholders who are going to be interested because people buy from people, but they also buy from the stories of their peers.”</p><h2 id="building-on-the-foundation">Building on the foundation</h2><p>Going forward, EDF will continue to work on its data consolidation, with a view to embedding more AI in its platform.</p><p>Scott picked out Informatica’s CLAIRE GPT data management assistant as a potential boon for the business, particularly with its ability to pull out data insights for users based on <a href="https://www.itpro.com/machine-learning/33308/what-is-natural-language-processing"><u>natural language</u></a> prompts. He expressed hope that its work on labelling and metadata to date will help make future AI adoption easier.</p><p>“I think we’re in a fortunate position because we’ve laid down the foundation.”</p><p>Any leader looking to engage in a similar project, Scott said, must ensure everyone on their team is informed and onboard from the beginning of a project and that any concerns are raised as early as possible. </p><p>“Too many conversations can be submissive, because people either just want to get out of a meeting or they’re not that interested,” he says.</p><p>“But then again, you can get some contentious ones – but for me, the contentious ones are where you will solve problems, because the biggest advocates in any organization are the ones that you've turned around from being a detractor from what you're trying to do.”</p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ From real-time to reasoning: Why NoSQL is core to agentic AI ]]></title>
                                                                                                <dc:content><![CDATA[ <p>AI agents are steadily becoming embedded in enterprise workflows: automating customer interactions, coordinating operations, and reasoning across complex datasets. </p><p>However, if you take a closer look beneath the surface, many organizations are struggling with the technical challenge of supporting them in real time. Legacy data architectures aren’t built for this. To make agents performant, scalable, and accountable, IT leaders are turning to something familiar, but more flexible: NoSQL.</p><h2 id="what-does-agentic-ai-demand-from-data">What does agentic AI demand from data?</h2><p>AI agents differ from traditional AI systems in that they don’t just generate outputs; they reason, plan, act, and often collaborate. This means drawing on real-time data from multiple sources, executing tasks, and maintaining context across sessions.</p><p>The problem is that traditional analytics databases are optimized for batch processing, not the continuous, low-latency reads and writes that agents require. In contrast, operational databases must support constant state changes, contextual awareness, and rapid feedback loops with near-instant performance.</p><p>Almost half (44%) of UK IT leaders struggle to access and manage the data needed to power AI initiatives, according to our research. It’s a sign that infrastructure isn’t keeping pace with the demands of AI agents.</p><h2 id="why-flexibility-and-schema-agility-matter">Why flexibility and schema agility matter</h2><p>NoSQL databases, particularly document-based ones, provide the flexible data models needed for modern AI. Agents need to work with a variety of data types from JSON records and user profiles to embeddings and API responses. NoSQL enables this without rigid schemas, supporting rapid iteration and adaptation.</p><p>Many modern NoSQL platforms also offer features traditionally associated with relational systems like ACID transactions and SQL-like querying, bringing together flexibility and familiarity.</p><h2 id="memory-is-the-new-application-state">Memory is the new application state</h2><p>AI agents that operate over time need memory in addition to processing power. That includes:</p><ul><li>Short-term memory: to track recent interactions and maintain conversational continuity.</li><li>Long-term memory: to store past experiences for learning and recall.</li><li>Procedural memory: to remember how to complete tasks and use tools.</li><li>Shared memory: to coordinate actions with other agents.</li></ul><p>NoSQL platforms that combine in-memory access with persistent storage simplify memory management and reduce the risk of context loss, which helps to deliver intelligent, consistent outputs. For example, a logistics agent managing deliveries must recall past delays (long-term), respond to live traffic updates (short-term), coordinate with dispatch (shared), and execute new routing strategies (procedural). This requires seamless memory transitions instead of fragmented storage systems.</p><p>This matters more than ever. Indeed, our research found that just 32% of UK IT leaders feel prepared to deploy agentic AI. The gap isn’t about ambition - as 52% believe it can uncover new business trends - it’s about infrastructure readiness.</p><h2 id="the-governance-test-can-you-trust-your-agent-s-outputs">The governance test: can you trust your agent’s outputs?</h2><p>Governance must be at the heart of AI agent production now that we’re at the inception point. Organizations must be able to explain how decisions were made, what data was used, and what outcomes were generated.</p><p>Well-architected NoSQL platforms support this through audit logs, data lineage tracking, and fine-grained access controls. These capabilities shift those platforms to being compliance tools in addition to debugging behavior and improving transparency.</p><p>Without traceability, AI risks becoming a black box: vulnerable to biased decisions, erratic behaviour, and regulatory breaches. With 43% of UK organizations concerned about the security risks of third-party AI tools, internal observability and governance are becoming strategic imperatives.</p><h2 id="the-pitfalls-of-patchwork-architectures">The pitfalls of patchwork architectures</h2><p>One of the biggest obstacles to effective agent deployment is architectural complexity. Many teams have stitched together disparate tools, creating brittle, fragmented systems that are difficult to scale or maintain. </p><p>This approach introduces latency, duplicates logic, and limits the agent’s ability to maintain coherent memory. It also complicates debugging and governance, making production rollouts riskier.</p><p>In contrast, a unified NoSQL developer data platform reduces complexity and improves reliability. It ensures consistent context, accelerates data access, and provides the performance foundation agents need to reason and act in real time.</p><h2 id="the-cost-of-complexity-why-point-solutions-break-at-scale">The cost of complexity: why point solutions break at scale</h2><p>Many enterprises adopted point solutions like caches, vector databases, or operational stores to support early AI experimentation. But as they move toward production, these stitched-together systems start to break down. They add latency, inflate costs, and create governance blind spots. </p><p>It’s no wonder, then, that 51% of UK IT leaders say the risk of AI project failure is too high to move forward, and 68% believe consolidating their data stack would make AI easier to manage and control.</p><p>A unified NoSQL platform simplifies the underlying data architecture, making it easier to scale, govern, and deliver reliable outputs. Without that foundation, even the best AI strategies risk stalling. In fact, 51% of UK companies believe delays in AI deployment could cost them up to 5% of their monthly revenue.</p><h2 id="the-future-of-ai-demands-simpler-smarter-architecture">The future of AI demands simpler, smarter architecture</h2><p>The rise of agentic AI marks a fundamental shift in how we think about software. These systems are persistent, collaborative, and increasingly autonomous. But to reach their potential, they need modern, fit-for-purpose infrastructure.</p><p>NoSQL is enabling the future of AI by combining flexibility, scalability, memory, and governance in a single platform and delivering the data foundation agents need to succeed.</p><p>As organizations move from experimentation to production, those foundations will separate the innovators from the sheep. Because agents can only be as intelligent and as trustworthy as the systems they’re built on.</p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/technology/artificial-intelligence/from-real-time-to-reasoning-why-nosql-is-core-to-agentic-ai</link>
                                                                            <description>
                            <![CDATA[ As businesses race to integrate AI into their operations, many are hitting the same stumbling block: their data infrastructure wasn’t built for it ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">WWUMNfgQHCFmFut8ufdXSU</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/QbsvdRbKT2GyT6QFDzjYDV-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Tue, 30 Sep 2025 07:00:00 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:17:06 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Platforms]]></category>
                                                    <category><![CDATA[Artificial Intelligence]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                                                                                    <dc:creator><![CDATA[ Tim Rottach ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/3zKFfJXxurLvtA9pzZaEDZ-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ null ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/QbsvdRbKT2GyT6QFDzjYDV-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[A visual representation of an AI agent moving through a task iteratively, shown as a glowing blue node sending a beam of energy through three floating planes formed from points of light. The background of the image is black.]]></media:description>                                                            <media:text><![CDATA[A visual representation of an AI agent moving through a task iteratively, shown as a glowing blue node sending a beam of energy through three floating planes formed from points of light. The background of the image is black.]]></media:text>
                                <media:title type="plain"><![CDATA[A visual representation of an AI agent moving through a task iteratively, shown as a glowing blue node sending a beam of energy through three floating planes formed from points of light. The background of the image is black.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/QbsvdRbKT2GyT6QFDzjYDV-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>AI agents are steadily becoming embedded in enterprise workflows: automating customer interactions, coordinating operations, and reasoning across complex datasets. </p><p>However, if you take a closer look beneath the surface, many organizations are struggling with the technical challenge of supporting them in real time. Legacy data architectures aren’t built for this. To make agents performant, scalable, and accountable, IT leaders are turning to something familiar, but more flexible: NoSQL.</p><h2 id="what-does-agentic-ai-demand-from-data">What does agentic AI demand from data?</h2><p>AI agents differ from traditional AI systems in that they don’t just generate outputs; they reason, plan, act, and often collaborate. This means drawing on real-time data from multiple sources, executing tasks, and maintaining context across sessions.</p><p>The problem is that traditional analytics databases are optimized for batch processing, not the continuous, low-latency reads and writes that agents require. In contrast, operational databases must support constant state changes, contextual awareness, and rapid feedback loops with near-instant performance.</p><p>Almost half (44%) of UK IT leaders struggle to access and manage the data needed to power AI initiatives, according to our research. It’s a sign that infrastructure isn’t keeping pace with the demands of AI agents.</p><h2 id="why-flexibility-and-schema-agility-matter">Why flexibility and schema agility matter</h2><p>NoSQL databases, particularly document-based ones, provide the flexible data models needed for modern AI. Agents need to work with a variety of data types from JSON records and user profiles to embeddings and API responses. NoSQL enables this without rigid schemas, supporting rapid iteration and adaptation.</p><p>Many modern NoSQL platforms also offer features traditionally associated with relational systems like ACID transactions and SQL-like querying, bringing together flexibility and familiarity.</p><h2 id="memory-is-the-new-application-state">Memory is the new application state</h2><p>AI agents that operate over time need memory in addition to processing power. That includes:</p><ul><li>Short-term memory: to track recent interactions and maintain conversational continuity.</li><li>Long-term memory: to store past experiences for learning and recall.</li><li>Procedural memory: to remember how to complete tasks and use tools.</li><li>Shared memory: to coordinate actions with other agents.</li></ul><p>NoSQL platforms that combine in-memory access with persistent storage simplify memory management and reduce the risk of context loss, which helps to deliver intelligent, consistent outputs. For example, a logistics agent managing deliveries must recall past delays (long-term), respond to live traffic updates (short-term), coordinate with dispatch (shared), and execute new routing strategies (procedural). This requires seamless memory transitions instead of fragmented storage systems.</p><p>This matters more than ever. Indeed, our research found that just 32% of UK IT leaders feel prepared to deploy agentic AI. The gap isn’t about ambition - as 52% believe it can uncover new business trends - it’s about infrastructure readiness.</p><h2 id="the-governance-test-can-you-trust-your-agent-s-outputs">The governance test: can you trust your agent’s outputs?</h2><p>Governance must be at the heart of AI agent production now that we’re at the inception point. Organizations must be able to explain how decisions were made, what data was used, and what outcomes were generated.</p><p>Well-architected NoSQL platforms support this through audit logs, data lineage tracking, and fine-grained access controls. These capabilities shift those platforms to being compliance tools in addition to debugging behavior and improving transparency.</p><p>Without traceability, AI risks becoming a black box: vulnerable to biased decisions, erratic behaviour, and regulatory breaches. With 43% of UK organizations concerned about the security risks of third-party AI tools, internal observability and governance are becoming strategic imperatives.</p><h2 id="the-pitfalls-of-patchwork-architectures">The pitfalls of patchwork architectures</h2><p>One of the biggest obstacles to effective agent deployment is architectural complexity. Many teams have stitched together disparate tools, creating brittle, fragmented systems that are difficult to scale or maintain. </p><p>This approach introduces latency, duplicates logic, and limits the agent’s ability to maintain coherent memory. It also complicates debugging and governance, making production rollouts riskier.</p><p>In contrast, a unified NoSQL developer data platform reduces complexity and improves reliability. It ensures consistent context, accelerates data access, and provides the performance foundation agents need to reason and act in real time.</p><h2 id="the-cost-of-complexity-why-point-solutions-break-at-scale">The cost of complexity: why point solutions break at scale</h2><p>Many enterprises adopted point solutions like caches, vector databases, or operational stores to support early AI experimentation. But as they move toward production, these stitched-together systems start to break down. They add latency, inflate costs, and create governance blind spots. </p><p>It’s no wonder, then, that 51% of UK IT leaders say the risk of AI project failure is too high to move forward, and 68% believe consolidating their data stack would make AI easier to manage and control.</p><p>A unified NoSQL platform simplifies the underlying data architecture, making it easier to scale, govern, and deliver reliable outputs. Without that foundation, even the best AI strategies risk stalling. In fact, 51% of UK companies believe delays in AI deployment could cost them up to 5% of their monthly revenue.</p><h2 id="the-future-of-ai-demands-simpler-smarter-architecture">The future of AI demands simpler, smarter architecture</h2><p>The rise of agentic AI marks a fundamental shift in how we think about software. These systems are persistent, collaborative, and increasingly autonomous. But to reach their potential, they need modern, fit-for-purpose infrastructure.</p><p>NoSQL is enabling the future of AI by combining flexibility, scalability, memory, and governance in a single platform and delivering the data foundation agents need to succeed.</p><p>As organizations move from experimentation to production, those foundations will separate the innovators from the sheep. Because agents can only be as intelligent and as trustworthy as the systems they’re built on.</p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ The Data Foundation for the Age of AI ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Your AI strategy is only as good as your data strategy. Check out this white paper to explore how Data Cloud is helping businesses:</p><p>- Connect customer data at scale</p><p>- Build unified customer profiles</p><p>- Power generative AI with relevant context</p><p>- Connect to other data lakes with zero ETL</p><p>- Train custom, predictive AI models activated across your CRM</p><p>- Realise the combined value of AWS and Salesforce</p><iframe allow="" height="1000" width="100%" id="" style="" class="position-center" data-lazy-priority="low" data-lazy-src="https://dennistrk.cvtr.io/click?lid=178995&amp;sid=&amp;pid=3" src="https://dennistrk.cvtr.io/click?lid=178995&amp;sid=&amp;pid=3"></iframe> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/the-future-of-business/the-data-foundation-for-the-age-of-ai</link>
                                                                            <description>
                            <![CDATA[ See how you can build a data strategy for the age of AI.How Data Cloud unifies data for use in personalisation and grounded AI. ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">uFshjkqv45sbZtKRnP45zf</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/C4nishd3uppBgREXSPUvQm-1920-80.png" type="image/png" length="0"></enclosure>
                                                                        <pubDate>Mon, 18 Aug 2025 15:52:36 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:15:41 +0000</updated>
                                                                                                                                            <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[The Future of Business]]></category>
                                                    <category><![CDATA[Business]]></category>
                                                                                                <author><![CDATA[ dale.walker@futurenet.com (ITPro) ]]></author>                    <dc:creator><![CDATA[ ITPro ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/JpDGYSnD7yNNModq5jFThm-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ null ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/png" url="https://cdn.mos.cms.futurecdn.net/C4nishd3uppBgREXSPUvQm-1920-80.png">
                                                            <media:credit><![CDATA[Salesforce]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[The Data Foundation for the Age of AI]]></media:description>                                                            <media:text><![CDATA[The Data Foundation for the Age of AI]]></media:text>
                                <media:title type="plain"><![CDATA[The Data Foundation for the Age of AI]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/C4nishd3uppBgREXSPUvQm-1920-80.png" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Your AI strategy is only as good as your data strategy. Check out this white paper to explore how Data Cloud is helping businesses:</p><p>- Connect customer data at scale</p><p>- Build unified customer profiles</p><p>- Power generative AI with relevant context</p><p>- Connect to other data lakes with zero ETL</p><p>- Train custom, predictive AI models activated across your CRM</p><p>- Realise the combined value of AWS and Salesforce</p><iframe allow="" height="1000" width="100%" id="" style="" class="position-center" data-lazy-priority="low" data-lazy-src="https://dennistrk.cvtr.io/click?lid=178995&amp;sid=&amp;pid=3" src="https://dennistrk.cvtr.io/click?lid=178995&amp;sid=&amp;pid=3"></iframe>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ The State of Data and Analytics Report ]]></title>
                                                                                                <dc:content><![CDATA[ <p>We surveyed over 10,000 analytics, IT, and business leaders for insights on data management and decision-making in the age of artificial intelligence.</p><p>Download now!</p><iframe allow="" height="1000" width="100%" id="" style="" class="position-center" data-lazy-priority="low" data-lazy-src="https://dennistrk.cvtr.io/click?lid=178996&amp;sid=&amp;pid=3" src="https://dennistrk.cvtr.io/click?lid=178996&amp;sid=&amp;pid=3"></iframe> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/the-future-of-business/the-state-of-data-and-analytics-report</link>
                                                                            <description>
                            <![CDATA[ The State of Data and Analytics Report ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">MCLLYYaquJWPwHGB7HaQaC</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/qFJ7kTZnPpNZcKEKwKD2EB-1920-80.png" type="image/png" length="0"></enclosure>
                                                                        <pubDate>Mon, 18 Aug 2025 15:52:30 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:16:24 +0000</updated>
                                                                                                                                            <category><![CDATA[Business Intelligence]]></category>
                                                    <category><![CDATA[The Future of Business]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Business]]></category>
                                                                                                <author><![CDATA[ dale.walker@futurenet.com (ITPro) ]]></author>                    <dc:creator><![CDATA[ ITPro ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/JpDGYSnD7yNNModq5jFThm-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ null ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/png" url="https://cdn.mos.cms.futurecdn.net/qFJ7kTZnPpNZcKEKwKD2EB-1920-80.png">
                                                            <media:credit><![CDATA[Salesforce]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[The State of Data and Analytics Report]]></media:description>                                                            <media:text><![CDATA[The State of Data and Analytics Report]]></media:text>
                                <media:title type="plain"><![CDATA[The State of Data and Analytics Report]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/qFJ7kTZnPpNZcKEKwKD2EB-1920-80.png" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>We surveyed over 10,000 analytics, IT, and business leaders for insights on data management and decision-making in the age of artificial intelligence.</p><p>Download now!</p><iframe allow="" height="1000" width="100%" id="" style="" class="position-center" data-lazy-priority="low" data-lazy-src="https://dennistrk.cvtr.io/click?lid=178996&amp;sid=&amp;pid=3" src="https://dennistrk.cvtr.io/click?lid=178996&amp;sid=&amp;pid=3"></iframe>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ How can businesses handle data sprawl?  ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Data sprawl is the uncontrolled – and often undocumented – spread of data across an organization’s systems, platforms, locations and formats. This includes on premises infrastructure, user devices, SaaS applications and cloud providers. </p><p>But we’re probably doing data an injustice describing the issue as such, says Tim Nelms, senior director analyst at Gartner, as the principal challenge is with content sprawl. “Content – <a href="https://www.itpro.com/big-data-analytics/34532/structured-vs-unstructured-data-management"><u>unstructured data</u></a> – represents 80% of corporate information,” he points out. </p><p>Whether coined as content or data, this sprawl issue most commonly arises when organizations <a href="https://www.itpro.com/cloud/cloud-computing/cloud-spending-2025-canalys"><u>rapidly adopt cloud services</u></a> that enable different teams or departments to generate, store and use data independently, and don’t have a process of filtering out duplicate and unneeded data effectively.</p><p>“In an effort to be agile and make use of modern technologies as fast as possible, this often happens without central oversight or data governance,” explains Tom van Aardt, <a href="https://www.itpro.com/business-strategy/chief-data-officer-cdo/370082/role-of-the-chief-data-officer-cdo-evolve"><u>chief data officer (CDO)</u></a> advisor at consultancy firm BML. “The result is a <a href="https://www.itpro.com/software/software-sprawl-is-getting-out-of-control-86-percent-of-it-leaders-say-disparate-tools-are-creating-financial-strain-and-security-risks-but-consolidation-is-now-a-high-priority"><u>fragmented data landscape</u></a> that increases risks related to security, compliance and inefficiency, and makes it difficult to discover, trust or leverage data effectively.”</p><p>This is in addition to a steady buildup of data in recent years due to the widespread adoption of multiple cloud platforms, decentralized procurement of tools, <a href="https://www.itpro.com/cloud/cloud-computing/overcoming-shadow-it-why-it-happens-and-how-to-prevent-it"><u>shadow IT</u></a> and the rapid growth of unstructured data across collaboration platforms. Throw into the mix the race to use AI and advanced <a href="https://www.itpro.com/business-intelligence/28220/what-is-data-analytics"><u>analytics</u></a> and you’re left with duplicated, fragmented and poorly catalogued data, he notes. </p><p>The pandemic must take some of the responsibility for the exponential growth in data, as this was a key reason for the rapid roll-out of digital workplace technologies that in some cases overlooked recommended governance and lifecycle controls in favor of speedy implementation. </p><p>“<a href="https://www.itpro.com/desktop-software/19337/office-365-review">Microsoft 365</a> alone has gone from 13 million active monthly users to over 330 million today. Most of those deployments happened quickly,” Nelms notes. </p><h2 id="the-more-data-the-better-no">The more data the better, no? </h2><p>In an era when data is one of the world’s most valuable commodities, it’s fair to ask what’s the harm in having so much of it? Well, the real issue isn’t the volume of data, but the lack of visibility and <a href="https://www.itpro.com/cloud/cloud-computing/enterprises-are-ramping-up-it-observability-investment-heres-why"><u>observability</u></a> around it.</p><p>This opens up the organization to <a href="https://www.itpro.com/security/these-three-critical-sectors-are-riddled-with-high-risk-vulnerabilities"><u>security vulnerabilities</u></a>, as potentially sensitive data could be sitting in places it shouldn’t. “This could be on end-user devices, in a cloud storage bucket that has misconfigured security, in poorly protected transactional systems,” says Brent Ellis, principal analyst at Forrester. “While traditional <a href="https://www.itpro.com/security/28084/what-is-ransomware">ransomware</a> encryption is still a threat, exfiltration and the movement of data outside of the perimeter that a business can control means it is threatened by risks to compliance, IP theft or loss of customer confidence.” </p><p>While businesses can use programs specifically designed to detect data sprawl, it’s most common for them to discover they have an issue when a security incident occurs. According to security firm Rubrik, <a href="https://www.itpro.com/cloud/cloud-security/enterprises-are-facing-a-cloud-security-crisis"><u>enterprises are facing a cloud security crisis</u></a> fueled by data sprawl, with consequences of breaches including reputational damage, compliance-related fines and forced leadership changes. </p><p>It can also significantly hamper <a href="https://www.itpro.com/security/building-an-incident-response-strategy"><u>incident response</u></a> and recovery when the worst occurs, by obscuring where sensitive and critical data resides, delaying breach detection, complicating forensic investigations and slowing containment efforts, notes van Aardt. </p><p>Data sprawl just magnifies the overall burden of recovery, Ellis agrees, adding that more generally, in terms of operations, data sprawl means longer back-ups and higher storage costs – essentially eating up time and money that could be better used elsewhere. </p><h2 id="how-can-businesses-handle-data-sprawl">How can businesses handle data sprawl? </h2><p>In today’s complex hybrid and multi-cloud environments, full control over all data is rarely achievable. It’s more realistic therefore, to focus on effective mitigation rather than complete elimination of data sprawl. </p><p>“One might have a goal of complete control, but companies must be <a href="https://www.itpro.com/business/business-strategy/how-embracing-agile-principles-can-boost-your-it-career"><u>agile</u></a> and the environments where data must be used will change over time. The big thing to establish is a culture that respects data and understands that the business has to manage it responsibly,” Ellis advises. </p><p>An area of focus should be on improving observability of your data, which can be achieved through a mix of tools and practices. Start with implementing a data strategy, setting up <a href="https://www.itpro.com/technology/artificial-intelligence/public-trust-has-become-the-new-currency-for-ai-innovation-why-sas-is-ringing-the-alarm-bell-on-ai-governance-for-enterprises"><u>data governance</u></a> and then implementing tools to support these, advises van Aardt. </p><p>“Following on from having a solid strategy and governance framework, businesses can then improve observability of data across hybrid or multi-cloud ecosystems by implementing centralized data inventory tools, standardizing <a href="https://www.itpro.com/development/web-development/368248/what-is-metadata"><u>metadata</u></a> and tagging practices and using <a href="https://www.itpro.com/cloud/cloud-computing/what-is-cloud-native-and-how-can-it-generate-business-value"><u>cloud native</u></a> monitoring and logging services integrated into a unified data catalogue or governance platform.”</p><p>Building standardized ways of deploying infrastructure across cloud and on prem is an important step so that you can use consistent tooling to understand where data is and what policies are applied to it, continues Ellis. “Exceptions occur, but those should be controlled and clear practices for making sure data in a new SaaS vendor, for instance, is kept in compliance to internal data controls. This may mean negotiating with vendors to get data visibility that’s not currently available as part of the service.”</p><p>“Enhancing observability also requires automated data discovery, classification and lineage tracking alongside clear ownership models and policy enforcement to ensure visibility, compliance and control over all data assets – regardless of where they reside,” adds van Aardt. </p><h2 id="the-human-factor">The human factor</h2><p>While automation and AI can also help support the management of data sprawl, it’s important not to overlook the human side of the equation. Strong leadership and ownership from the top are required to build a successful culture of <a href="https://www.itpro.com/uk/tag/data-management"><u>data management</u></a> and it’s important to break down silos and foster communication and collaboration across IT, security and business teams. </p><p>Control over data sprawl looks set to become even more important as near-future regulations are likely to demand greater transparency on where data resides, how it’s processed and who has access. </p><p>“Ultimately, evolving regulations will force businesses to embed privacy-by-design and security-by-default principles into their data strategies, turning regulatory compliance from a checkbox exercise into a core operational discipline,” van Aardt concludes. </p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/data-and-insights/how-can-businesses-handle-data-sprawl</link>
                                                                            <description>
                            <![CDATA[ Poor data observability opens the door to security vulnerabilities ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">TQu9V8kg5Jk3jFtyMKmrcT</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/B7abvurJvaMY7ybvcoZThh-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Tue, 01 Jul 2025 07:45:00 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:16:45 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Management]]></category>
                                                    <category><![CDATA[Data and Insights]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Business]]></category>
                                                                                                                    <dc:creator><![CDATA[ Keri Allan ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/oJZkdPii464j27ff4GCcoT-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ null ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/B7abvurJvaMY7ybvcoZThh-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Tool sprawl concept, multiple terminals showing lines of code stacked in front of one another with a reflective blue gradient background]]></media:description>                                                            <media:text><![CDATA[Tool sprawl concept, multiple terminals showing lines of code stacked in front of one another with a reflective blue gradient background]]></media:text>
                                <media:title type="plain"><![CDATA[Tool sprawl concept, multiple terminals showing lines of code stacked in front of one another with a reflective blue gradient background]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/B7abvurJvaMY7ybvcoZThh-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Data sprawl is the uncontrolled – and often undocumented – spread of data across an organization’s systems, platforms, locations and formats. This includes on premises infrastructure, user devices, SaaS applications and cloud providers. </p><p>But we’re probably doing data an injustice describing the issue as such, says Tim Nelms, senior director analyst at Gartner, as the principal challenge is with content sprawl. “Content – <a href="https://www.itpro.com/big-data-analytics/34532/structured-vs-unstructured-data-management"><u>unstructured data</u></a> – represents 80% of corporate information,” he points out. </p><p>Whether coined as content or data, this sprawl issue most commonly arises when organizations <a href="https://www.itpro.com/cloud/cloud-computing/cloud-spending-2025-canalys"><u>rapidly adopt cloud services</u></a> that enable different teams or departments to generate, store and use data independently, and don’t have a process of filtering out duplicate and unneeded data effectively.</p><p>“In an effort to be agile and make use of modern technologies as fast as possible, this often happens without central oversight or data governance,” explains Tom van Aardt, <a href="https://www.itpro.com/business-strategy/chief-data-officer-cdo/370082/role-of-the-chief-data-officer-cdo-evolve"><u>chief data officer (CDO)</u></a> advisor at consultancy firm BML. “The result is a <a href="https://www.itpro.com/software/software-sprawl-is-getting-out-of-control-86-percent-of-it-leaders-say-disparate-tools-are-creating-financial-strain-and-security-risks-but-consolidation-is-now-a-high-priority"><u>fragmented data landscape</u></a> that increases risks related to security, compliance and inefficiency, and makes it difficult to discover, trust or leverage data effectively.”</p><p>This is in addition to a steady buildup of data in recent years due to the widespread adoption of multiple cloud platforms, decentralized procurement of tools, <a href="https://www.itpro.com/cloud/cloud-computing/overcoming-shadow-it-why-it-happens-and-how-to-prevent-it"><u>shadow IT</u></a> and the rapid growth of unstructured data across collaboration platforms. Throw into the mix the race to use AI and advanced <a href="https://www.itpro.com/business-intelligence/28220/what-is-data-analytics"><u>analytics</u></a> and you’re left with duplicated, fragmented and poorly catalogued data, he notes. </p><p>The pandemic must take some of the responsibility for the exponential growth in data, as this was a key reason for the rapid roll-out of digital workplace technologies that in some cases overlooked recommended governance and lifecycle controls in favor of speedy implementation. </p><p>“<a href="https://www.itpro.com/desktop-software/19337/office-365-review">Microsoft 365</a> alone has gone from 13 million active monthly users to over 330 million today. Most of those deployments happened quickly,” Nelms notes. </p><h2 id="the-more-data-the-better-no">The more data the better, no? </h2><p>In an era when data is one of the world’s most valuable commodities, it’s fair to ask what’s the harm in having so much of it? Well, the real issue isn’t the volume of data, but the lack of visibility and <a href="https://www.itpro.com/cloud/cloud-computing/enterprises-are-ramping-up-it-observability-investment-heres-why"><u>observability</u></a> around it.</p><p>This opens up the organization to <a href="https://www.itpro.com/security/these-three-critical-sectors-are-riddled-with-high-risk-vulnerabilities"><u>security vulnerabilities</u></a>, as potentially sensitive data could be sitting in places it shouldn’t. “This could be on end-user devices, in a cloud storage bucket that has misconfigured security, in poorly protected transactional systems,” says Brent Ellis, principal analyst at Forrester. “While traditional <a href="https://www.itpro.com/security/28084/what-is-ransomware">ransomware</a> encryption is still a threat, exfiltration and the movement of data outside of the perimeter that a business can control means it is threatened by risks to compliance, IP theft or loss of customer confidence.” </p><p>While businesses can use programs specifically designed to detect data sprawl, it’s most common for them to discover they have an issue when a security incident occurs. According to security firm Rubrik, <a href="https://www.itpro.com/cloud/cloud-security/enterprises-are-facing-a-cloud-security-crisis"><u>enterprises are facing a cloud security crisis</u></a> fueled by data sprawl, with consequences of breaches including reputational damage, compliance-related fines and forced leadership changes. </p><p>It can also significantly hamper <a href="https://www.itpro.com/security/building-an-incident-response-strategy"><u>incident response</u></a> and recovery when the worst occurs, by obscuring where sensitive and critical data resides, delaying breach detection, complicating forensic investigations and slowing containment efforts, notes van Aardt. </p><p>Data sprawl just magnifies the overall burden of recovery, Ellis agrees, adding that more generally, in terms of operations, data sprawl means longer back-ups and higher storage costs – essentially eating up time and money that could be better used elsewhere. </p><h2 id="how-can-businesses-handle-data-sprawl">How can businesses handle data sprawl? </h2><p>In today’s complex hybrid and multi-cloud environments, full control over all data is rarely achievable. It’s more realistic therefore, to focus on effective mitigation rather than complete elimination of data sprawl. </p><p>“One might have a goal of complete control, but companies must be <a href="https://www.itpro.com/business/business-strategy/how-embracing-agile-principles-can-boost-your-it-career"><u>agile</u></a> and the environments where data must be used will change over time. The big thing to establish is a culture that respects data and understands that the business has to manage it responsibly,” Ellis advises. </p><p>An area of focus should be on improving observability of your data, which can be achieved through a mix of tools and practices. Start with implementing a data strategy, setting up <a href="https://www.itpro.com/technology/artificial-intelligence/public-trust-has-become-the-new-currency-for-ai-innovation-why-sas-is-ringing-the-alarm-bell-on-ai-governance-for-enterprises"><u>data governance</u></a> and then implementing tools to support these, advises van Aardt. </p><p>“Following on from having a solid strategy and governance framework, businesses can then improve observability of data across hybrid or multi-cloud ecosystems by implementing centralized data inventory tools, standardizing <a href="https://www.itpro.com/development/web-development/368248/what-is-metadata"><u>metadata</u></a> and tagging practices and using <a href="https://www.itpro.com/cloud/cloud-computing/what-is-cloud-native-and-how-can-it-generate-business-value"><u>cloud native</u></a> monitoring and logging services integrated into a unified data catalogue or governance platform.”</p><p>Building standardized ways of deploying infrastructure across cloud and on prem is an important step so that you can use consistent tooling to understand where data is and what policies are applied to it, continues Ellis. “Exceptions occur, but those should be controlled and clear practices for making sure data in a new SaaS vendor, for instance, is kept in compliance to internal data controls. This may mean negotiating with vendors to get data visibility that’s not currently available as part of the service.”</p><p>“Enhancing observability also requires automated data discovery, classification and lineage tracking alongside clear ownership models and policy enforcement to ensure visibility, compliance and control over all data assets – regardless of where they reside,” adds van Aardt. </p><h2 id="the-human-factor">The human factor</h2><p>While automation and AI can also help support the management of data sprawl, it’s important not to overlook the human side of the equation. Strong leadership and ownership from the top are required to build a successful culture of <a href="https://www.itpro.com/uk/tag/data-management"><u>data management</u></a> and it’s important to break down silos and foster communication and collaboration across IT, security and business teams. </p><p>Control over data sprawl looks set to become even more important as near-future regulations are likely to demand greater transparency on where data resides, how it’s processed and who has access. </p><p>“Ultimately, evolving regulations will force businesses to embed privacy-by-design and security-by-default principles into their data strategies, turning regulatory compliance from a checkbox exercise into a core operational discipline,” van Aardt concludes. </p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ Data storage is dead, long live data management ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Simplicity was the war cry ahead of Pure Accelerate 2025, and by all means it appears Pure Storage has come away from the conference with a huge win. </p><p>The storage vendor has made significant headway in recent years in its quest to build an all-encompassing ecosystem for customers, combining high-performance flash hardware with a broad software stack to manage and optimize infrastructure. </p><p>Notably, in recent months its <a href="https://www.itpro.com/infrastructure/servers-and-storage/storage-as-a-service-a-win-win-for-the-channel-and-modern-businesses">storage as a service (STaaS)</a> model has begun paying dividends, as I noted ahead of the conference, but the announcements last week highlight its razor sharp focus on even more simplicity - with a dash of automation, of course. </p><p>The flagship update from Pure Storage centered around the launch of its Enterprise Data Cloud, the firm’s new combined approach to data storage and management. </p><p>Underpinning this is the company’s Purity operating system, providing enterprises with a unified software platform, alongside Pure1 and Pure Fusion - the latter two now make up the ‘management’ layer, so to speak, within the Pure estate. </p><p>Pure Fusion was a point of particular focus for the storage vendor last week and forms a critical part of the Enterprise Data Cloud. The company has taken its time fleshing this out, having first announced this in 2021, and new updates mean that customers can now view their storage assets in a single pool.</p><p>No more disjointed environments and disparate datasets: it’s all there in front of you, visible and easily accessible. </p><p>Combined with Pure1, this is the ‘intelligent control plane’ of the EDC, and brings a level of automation to data storage that Pure has been striving for over the last few years. </p><p>During two extensive hands-on keynote sessions, attendees were shown how workflows and configurations can now be easily automated at the click of a few buttons. </p><p>It’s more than just simple automation, however. The company repeatedly emphasized that the automation features span an array of areas, with compliance and security of particular note. </p><h2 id="pure-storage-is-playing-the-long-game">Pure Storage is playing the long game</h2><p>The EDC represents the fruits of more than a decade’s labor to consolidate the Pure Storage ecosystem, <a href="https://www.itpro.com/hardware/storage/its-a-hard-problem-you-can-never-solve-unless-you-know-the-future-pure-storage-founder-talks-all-flash-the-death-of-disks-and-the-future-of-data-storage">founder John ‘Coz’ Colgrove told <em>ITPro</em></a><em> </em>at the conference. CEO <a href="https://www.itpro.com/cloud/cloud-storage/this-was-a-very-purposeful-strategy-pure-storage-unveils-enterprise-data-cloud-in-bid-to-unify-data-storage-management">Charlie Giancarlo waxed lyrical</a> about the fact that this represented a “paradigm shift” in the data storage industry. </p><p>In pulling together a comprehensive, finely curated architecture, the company will no doubt make it easier for enterprise customers to optimize infrastructure, but more importantly, manage the data which now represents the lifeblood of their business. </p><p>Patrick Smith, Field CTO for EMEA at Pure Storage told <em>ITPro </em>ahead of the conference the company wants customers to essentially sit back and let Pure handle the drudge work with storage optimization while focusing on <a href="https://www.itpro.com/big-data-analytics/34532/structured-vs-unstructured-data-management">data management</a>. </p><p><a href="https://www.itpro.com/business/business-strategy/pure-storage-wants-to-simplify-storage-for-the-ai-era-pure-accelerate">“Don’t manage the storage, manage the data,”</a> he quipped in a call ahead of the annual event. Pure’s EDC launch certainly appears to hit the nail on the head on this front, but is it truly unique? Not exactly. </p><p>Prakash Darji, general manager at Pure Storage's digital experience business, told <em>ITPro </em>on the ground <a href="https://www.itpro.com/infrastructure/pure-storage-pulls-no-punches-with-competitors-amid-enterprise-data-cloud-launch">that the EDC is “evolutionary, not revolutionary”</a> having previously hit out at a question from the press on the novelty of the approach. </p><p>It does bear some similarities to other options on the market - <em>just don’t mention that to them</em> - albeit with a more fleshed out portfolio that’s been made possible by Pure’s late-entrant status within the broader storage industry. </p><p>Simply put, it hasn’t had to contend with decades’ worth of legacy solutions, infrastructure, or most importantly, customers like competitors have. </p><p>That’s the advantage the company now has in the broader marketplace. With the EDC, the final building blocks are in place, all that’s required from here on out is to let customers tinker and experiment. </p><p>Pure Storage will take care of the hardware, whether enterprises can use the service to get their data in order will be the real test. </p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/data-and-insights/data-storage-is-dead-long-live-data-management</link>
                                                                            <description>
                            <![CDATA[ Pure Storage's flagship announcement at its annual conference was the Enterprise Data Cloud, but what makes it a "paradigm shifting" new approach to data storage and management? ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">Wm8mDeGJ9tEbfZXSx9VtLh</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/RDaB3X4SDH96h7PR7HvYyX-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Mon, 23 Jun 2025 11:14:30 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:16:52 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Management]]></category>
                                                    <category><![CDATA[Data and Insights]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Business]]></category>
                                                                                                <author><![CDATA[ ross.kelly@futurenet.com (Ross Kelly) ]]></author>                    <dc:creator><![CDATA[ Ross Kelly ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/Y5vrV2V98Np6jHAGmAtCd3-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Ross Kelly is ITPro&#039;s News &amp;amp; Analysis Editor, with a keen interest in cyber security, business leadership and emerging technologies.&lt;/p&gt;
&lt;p&gt;He graduated from Edinburgh Napier University in 2016 with a BA (Hons) in Journalism, and joined ITPro in 2022 after four years working in technology conference research.&amp;nbsp;&lt;/p&gt;
&lt;p&gt;In his spare time, Ross enjoys cycling, walking and is an avid reader of history and non-fiction.&lt;/p&gt;
&lt;p&gt;You can contact Ross at ross.kelly@futurenet.com or on &lt;a href=&quot;https://twitter.com/rosswritesetc&quot;&gt;Twitter&lt;/a&gt; and &lt;a href=&quot;https://www.linkedin.com/in/ross-kelly-18a54411a/&quot;&gt;LinkedIn&lt;/a&gt;.&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/RDaB3X4SDH96h7PR7HvYyX-1920-80.jpg">
                                                            <media:credit><![CDATA[ITPro/Ross Kelly]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Pure Storage logo and branding pictured at the company&#039;s annual Pure//Accelerate conference at the Resorts World Hotel and Casino in Las Vegas, Nevada. ]]></media:description>                                                            <media:text><![CDATA[Pure Storage logo and branding pictured at the company&#039;s annual Pure//Accelerate conference at the Resorts World Hotel and Casino in Las Vegas, Nevada. ]]></media:text>
                                <media:title type="plain"><![CDATA[Pure Storage logo and branding pictured at the company&#039;s annual Pure//Accelerate conference at the Resorts World Hotel and Casino in Las Vegas, Nevada. ]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/RDaB3X4SDH96h7PR7HvYyX-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Simplicity was the war cry ahead of Pure Accelerate 2025, and by all means it appears Pure Storage has come away from the conference with a huge win. </p><p>The storage vendor has made significant headway in recent years in its quest to build an all-encompassing ecosystem for customers, combining high-performance flash hardware with a broad software stack to manage and optimize infrastructure. </p><p>Notably, in recent months its <a href="https://www.itpro.com/infrastructure/servers-and-storage/storage-as-a-service-a-win-win-for-the-channel-and-modern-businesses">storage as a service (STaaS)</a> model has begun paying dividends, as I noted ahead of the conference, but the announcements last week highlight its razor sharp focus on even more simplicity - with a dash of automation, of course. </p><p>The flagship update from Pure Storage centered around the launch of its Enterprise Data Cloud, the firm’s new combined approach to data storage and management. </p><p>Underpinning this is the company’s Purity operating system, providing enterprises with a unified software platform, alongside Pure1 and Pure Fusion - the latter two now make up the ‘management’ layer, so to speak, within the Pure estate. </p><p>Pure Fusion was a point of particular focus for the storage vendor last week and forms a critical part of the Enterprise Data Cloud. The company has taken its time fleshing this out, having first announced this in 2021, and new updates mean that customers can now view their storage assets in a single pool.</p><p>No more disjointed environments and disparate datasets: it’s all there in front of you, visible and easily accessible. </p><p>Combined with Pure1, this is the ‘intelligent control plane’ of the EDC, and brings a level of automation to data storage that Pure has been striving for over the last few years. </p><p>During two extensive hands-on keynote sessions, attendees were shown how workflows and configurations can now be easily automated at the click of a few buttons. </p><p>It’s more than just simple automation, however. The company repeatedly emphasized that the automation features span an array of areas, with compliance and security of particular note. </p><h2 id="pure-storage-is-playing-the-long-game">Pure Storage is playing the long game</h2><p>The EDC represents the fruits of more than a decade’s labor to consolidate the Pure Storage ecosystem, <a href="https://www.itpro.com/hardware/storage/its-a-hard-problem-you-can-never-solve-unless-you-know-the-future-pure-storage-founder-talks-all-flash-the-death-of-disks-and-the-future-of-data-storage">founder John ‘Coz’ Colgrove told <em>ITPro</em></a><em> </em>at the conference. CEO <a href="https://www.itpro.com/cloud/cloud-storage/this-was-a-very-purposeful-strategy-pure-storage-unveils-enterprise-data-cloud-in-bid-to-unify-data-storage-management">Charlie Giancarlo waxed lyrical</a> about the fact that this represented a “paradigm shift” in the data storage industry. </p><p>In pulling together a comprehensive, finely curated architecture, the company will no doubt make it easier for enterprise customers to optimize infrastructure, but more importantly, manage the data which now represents the lifeblood of their business. </p><p>Patrick Smith, Field CTO for EMEA at Pure Storage told <em>ITPro </em>ahead of the conference the company wants customers to essentially sit back and let Pure handle the drudge work with storage optimization while focusing on <a href="https://www.itpro.com/big-data-analytics/34532/structured-vs-unstructured-data-management">data management</a>. </p><p><a href="https://www.itpro.com/business/business-strategy/pure-storage-wants-to-simplify-storage-for-the-ai-era-pure-accelerate">“Don’t manage the storage, manage the data,”</a> he quipped in a call ahead of the annual event. Pure’s EDC launch certainly appears to hit the nail on the head on this front, but is it truly unique? Not exactly. </p><p>Prakash Darji, general manager at Pure Storage's digital experience business, told <em>ITPro </em>on the ground <a href="https://www.itpro.com/infrastructure/pure-storage-pulls-no-punches-with-competitors-amid-enterprise-data-cloud-launch">that the EDC is “evolutionary, not revolutionary”</a> having previously hit out at a question from the press on the novelty of the approach. </p><p>It does bear some similarities to other options on the market - <em>just don’t mention that to them</em> - albeit with a more fleshed out portfolio that’s been made possible by Pure’s late-entrant status within the broader storage industry. </p><p>Simply put, it hasn’t had to contend with decades’ worth of legacy solutions, infrastructure, or most importantly, customers like competitors have. </p><p>That’s the advantage the company now has in the broader marketplace. With the EDC, the final building blocks are in place, all that’s required from here on out is to let customers tinker and experiment. </p><p>Pure Storage will take care of the hardware, whether enterprises can use the service to get their data in order will be the real test. </p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ SAS rejects generative AI hype in favor of data fundamentals at Innovate 2025 ]]></title>
                                                                                                <dc:content><![CDATA[ <p>SAS Innovate 2025 is over and with it, three days of keynotes, hands-on sessions, and roundtable discussions focused primarily on data and AI have come to an end. </p><p>Mood on the ground throughout the conference was high, with customers and partners alike paying testament to the analytics veteran’s nuts-and-bolts announcements and realistic outlook on how businesses can benefit from technology such as AI.</p><p>Throughout this year’s event, SAS has repeatedly taken the opportunity to pour cold water on generative AI hype, stressing that while the technology is great for certain tasks it isn’t a replacement for proper <a href="https://www.itpro.com/business-intelligence/28220/what-is-data-analytics"><u>data analytics</u></a>, nor ‘traditional AI’ such as <a href="https://www.itpro.com/strategy/28071/what-is-machine-learning"><u>machine learning (ML)</u></a> or <a href="https://www.itpro.com/network-internet/29791/what-is-an-artificial-neural-network"><u>neural networks</u></a>.</p><p>At the <a href="https://www.itpro.com/business/live/sas-innovate-2025-live-all-the-latest-news-and-updates">opening keynote</a> Bryan Harris, CTO at SAS, made the sarcastic claim that generative AI could make enterprise problems “magically disappear”, before reminding attendees that LLMs come with limitations such as <a href="https://www.itpro.com/technology/artificial-intelligence/ai-hallucinations-what-are-they"><u>hallucinations</u></a> and a tendency toward <a href="https://www.itpro.com/technology/artificial-intelligence-ai/354824/how-to-spot-if-not-fix-algorithmic-bias"><u>bias</u></a>.</p><p>Announcements on <a href="https://www.itpro.com/technology/artificial-intelligence/sas-wants-its-ai-agents-to-supercharge-workers-not-replace-them"><u>domain-specific AI and collaborative agents</u></a> show SAS is invested in making AI easier to adopt and more effective off-the-shelf for organizations in specific sectors. </p><p>The company is also not shying away from the agentic AI trend, with SAS Viya Intelligent Decisioning allowing customers to build and deploy custom AI agents.</p><p>But in its send-ups of AI hype and <a href="https://www.itpro.com/technology/artificial-intelligence/public-trust-has-become-the-new-currency-for-ai-innovation-why-sas-is-ringing-the-alarm-bell-on-ai-governance-for-enterprises"><u>repeated calls for strong AI governance</u></a>, SAS also spent a good portion of its annual event tackling the assertion that generative AI is the best technology for every problem.</p><p>Jim Goodnight, co-founder and CEO at SAS, gave a scathing assessment of generative AI in conversation with <em>ITPro</em>.</p><p>"There's a lot of money being spent on generative AI and there's a lot of money being wasted,” he said. “The results end up pretty negative because so many companies are just trying to take their current staff and say, ‘Okay, go do this generative AI stuff and they do that and they spend a lot of money.</p><p>This wasn’t limited to Goodnight alone. Gavin Day, the newly-appointed COO at SAS, told <em>ITPro</em> some enterprises could be facing a “summer of disappointment” as far as AI ROI is concerned.</p><p>Of course, SAS is itself using generative AI, with Goodnight quick to point out the value for customers in using LLMs to turn <a href="https://www.itpro.com/machine-learning/33308/what-is-natural-language-processing"><u>natural language</u></a> prompts into code outputs written in the custom SAS programming language. He described the <a href="https://www.itpro.com/technology/artificial-intelligence/ai-generated-code-risks-what-cisos-need-to-know"><u>AI-generated code</u></a> as “actually pretty good”, comparing it to the work of a novice.</p><p>“It's like your first program that you ever wrote, this is sort of the level of the code that's generated, so it's not super professional but it's maybe 80-90% correct.”</p><p>All of this adds up to a defiant approach, in which SAS provides customers with tools to prepare for, build, and deploy AI without falling into the ‘AI for everything’ pit or losing sight of the value that data governance and analytics bring.</p><p>It’s a canny strategy, particularly given how many of SAS’ customers are in heavily regulated industries and continue to approach AI with a degree of skepticism.</p><h2 id="preparing-for-ipo">Preparing for IPO</h2><p>In our <a href="https://www.itpro.com/business/business-strategy/what-to-watch-out-for-at-sas-innovate-2025"><u>preview piece for the conference</u></a>, we speculated that SAS could provide an update on its long-held IPO ambitions, first announced in 2021 with a goal of going public in 2024. While the keynotes and press releases were absent of any further news on this, Goodnight gave <em>ITPro</em> some insight into SAS’ timeline and what being IPO-ready means for the firm.</p><p>“We had 14 financial systems around the world, we’ve now consolidated to one and it has taken us about three to four years to get that in place,” Goodnight said, explaining that this process was finalized in January 2025.</p><p>He added that SAS has also been getting lead to cash (L2C) systems, which encompass the entire process of acquiring customer leads to securing sales, in place as this is something public companies are expected to have.</p><p>“That went into operation on the first of the month,” he said. “So everything's in place but now we have to learn to use this new system that no one's familiar with, so they're working overtime right now trying to feed quotes and stuff into the system. So we’ll need to run on that for at least a year before we’re ready.”</p><p>With this in mind, Goodnight said 2027 was the likeliest year for SAS’ IPO. Day has been heavily involved in the IPO preparation process, told <em>ITPro</em> that external economic factors were also at play here.</p><p>“A little bit over half of our revenue comes from outside of the United States, so we’ve had to pay attention to the global economy for a long time,” he said, adding SAS will continue to closely monitor the situation for the governments it works with.</p><p>“My job is to make sure we can operate as a public company, we can report as a public company, we have sustainable revenue growth, we have sustainable profit. When I do that, I give Dr Goodnight options, he can choose when to go.”</p><p>When it does finally happen, the SAS IPO will be an all-important milestone for the company, especially given the tight control Goodnight has maintained in his near 50-year reign as CEO.</p><p>Goodnight’s faith in the potential and longevity of SAS is evident in fact he’s turned down several acquisition offers in the past.</p><p>“I didn’t like the price,” Goodnight said of the offers he’s received in the past, adding that he was reluctant to see SAS absorbed into another firm.</p><p>In 2021, the Wall Street Journal <a href="https://www.wsj.com/business/deals/broadcom-no-longer-in-talks-to-buy-sas-institute-sources-say-11626212065?mod=hp_lead_pos1" target="_blank"><u>reported</u></a> that alleged Broadcom plans to acquire SAS for $15-20 billion had fallen through after Goodnight and co-founder John Sall changed their minds.</p><h2 id="quantum-is-here-with-a-catch">Quantum is here – with a catch</h2><p>For some years, quantum computing has largely been discussed in terms of the potential risks it poses to common encryption algorithms like RCS. Cybersecurity experts have warned of <a href="https://www.itpro.com/security/cyber-security/370298/what-is-steal-now-crack-later-quantum-computing"><u>‘steal now, crack later’</u></a> attacks in which hackers exfiltrate evergreen encrypted data with the long-term goal of decrypting it when they eventually obtain a quantum computer.</p><p>At SAS Innovate 2025, the firm made something of a splash by claiming quantum is already here – and delivering results for its customers. Using <a href="https://www.itpro.com/technology/sas-thinks-quantum-ai-has-huge-enterprise-potential-heres-why"><u>what it calls quantum AI</u></a>, SAS helped P&amp;G to solve complex combinatorial problems, preventing ingredients from cross-contaminating products its manufacturing process.</p><p>As explained in the <em>ITPro Podcast</em> episode on the conference embedded below, this is not the same thing as the quantum computing often discussed in the industry. It was in fact the result of a process known as ‘quantum annealing’. This is essentially a very advanced, quantum-based optimization <a href="https://www.itpro.com/data-insights/30212/what-is-an-algorithm">algorithm</a>. </p><iframe allow="" height="200px" width="100%" class="position-center" data-lazy-priority="low" data-lazy-src="https://player.captivate.fm/episode/ba3ef117-c09c-4142-bf04-3a8eabf84aec/" src="https://player.captivate.fm/episode/ba3ef117-c09c-4142-bf04-3a8eabf84aec/"></iframe><p>The term quantum AI seems to be doing some work for SAS here, blurring the line between bona-fide quantum calculations and the existing solver algorithms with which SAS is well-acquainted. Even Goodnight questioned the name, telling <em>ITPro</em>: </p><p>“I don’t know why they call it AI, it’s not really AI, but everything’s got to have AI on the end of it.”</p><p>Regardless of the semantics, SAS is investing in quantum solutions now to be ready for the significant future demand it’s predicting in the market. With SAS staying private for the time being and Goodnight telling <em>ITPro </em>that R&amp;D has always been an important area of focus for the firm, it has room to expand its spending on quantum ahead of these projected returns.</p><p>Perhaps unsurprisingly, data underpins all the announcements and claims made at SAS Innovate 2025. As it nears a half-century in the analytics space, SAS appears more confident than ever that whatever the current technological trend, it has the systems and approaches to help any enterprise transform its data into tangible value.</p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/technology/artificial-intelligence/sas-rejects-generative-ai-hype-data-fundamentals-at-innovate-2025</link>
                                                                            <description>
                            <![CDATA[ Across SAS Innovate 2025, the data and analytics firm committed to AI governance, domain-specific models, and continued investment to stay ahead of the market ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">J2fvv8jEQEnprhBEUTXLid</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/AfsiZ3wmkhBBqtgsMwn9sZ-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Fri, 09 May 2025 12:22:02 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:15:42 +0000</updated>
                                                                                                                                            <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Artificial Intelligence]]></category>
                                                                                                <author><![CDATA[ rory.bathgate@futurenet.com (Rory Bathgate) ]]></author>                    <dc:creator><![CDATA[ Rory Bathgate ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/Vep5JogbPhduK7R6CUWAm6-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Rory Bathgate was the Features and Multimedia Editor at ITPro until 2026, overseeing all in-depth content and case studies. Throughout his time at ITPro, Rory  charted the rise in popularity of generative AI and specifically companies such as Microsoft, OpenAI, and Google. &lt;/p&gt;&lt;p&gt;Alongside this, he delved into increasing calls for ethical and responsible AI as global legislators circle the technology, as well as the latest in mobile networking technology, from 5G mmWave to the 3G sunset and how it will affect businesses.&lt;/p&gt;&lt;p&gt;He  provided coverage from high-profile tech conferences such as Dell Technologies World, SuiteWorld, and VMware Explore Europe. His on-the-ground coverage  included live blogs, extensive daily coverage of the most significant announcements, analysis pieces, and podcast.&lt;/p&gt;&lt;p&gt;Rory was the co-host of the ITPro Podcast alongside Jane McCallion, where he swapped a keyboard for a microphone to discuss the latest learnings in tech.&lt;/p&gt;&lt;p&gt;Rory has an MA in Eighteenth-Century Studies from King’s College London, as well as a BA in English and American Literature from the University of Kent. He joined ITPro in 2022 as a graduate, after four years in student journalism.&lt;/p&gt;&lt;p&gt;In his free time, Rory enjoys photography and video editing, and can often be found at the cinema or reading a good science fiction paperback.&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/AfsiZ3wmkhBBqtgsMwn9sZ-1920-80.jpg">
                                                            <media:credit><![CDATA[Future]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[A photo of the SAS logo on a 3D standee at SAS Innovate 2025 held at the Hilton Orlando. The white text is set against a stylized blue background with a pink stripe to the right.]]></media:description>                                                            <media:text><![CDATA[A photo of the SAS logo on a 3D standee at SAS Innovate 2025 held at the Hilton Orlando. The white text is set against a stylized blue background with a pink stripe to the right.]]></media:text>
                                <media:title type="plain"><![CDATA[A photo of the SAS logo on a 3D standee at SAS Innovate 2025 held at the Hilton Orlando. The white text is set against a stylized blue background with a pink stripe to the right.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/AfsiZ3wmkhBBqtgsMwn9sZ-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>SAS Innovate 2025 is over and with it, three days of keynotes, hands-on sessions, and roundtable discussions focused primarily on data and AI have come to an end. </p><p>Mood on the ground throughout the conference was high, with customers and partners alike paying testament to the analytics veteran’s nuts-and-bolts announcements and realistic outlook on how businesses can benefit from technology such as AI.</p><p>Throughout this year’s event, SAS has repeatedly taken the opportunity to pour cold water on generative AI hype, stressing that while the technology is great for certain tasks it isn’t a replacement for proper <a href="https://www.itpro.com/business-intelligence/28220/what-is-data-analytics"><u>data analytics</u></a>, nor ‘traditional AI’ such as <a href="https://www.itpro.com/strategy/28071/what-is-machine-learning"><u>machine learning (ML)</u></a> or <a href="https://www.itpro.com/network-internet/29791/what-is-an-artificial-neural-network"><u>neural networks</u></a>.</p><p>At the <a href="https://www.itpro.com/business/live/sas-innovate-2025-live-all-the-latest-news-and-updates">opening keynote</a> Bryan Harris, CTO at SAS, made the sarcastic claim that generative AI could make enterprise problems “magically disappear”, before reminding attendees that LLMs come with limitations such as <a href="https://www.itpro.com/technology/artificial-intelligence/ai-hallucinations-what-are-they"><u>hallucinations</u></a> and a tendency toward <a href="https://www.itpro.com/technology/artificial-intelligence-ai/354824/how-to-spot-if-not-fix-algorithmic-bias"><u>bias</u></a>.</p><p>Announcements on <a href="https://www.itpro.com/technology/artificial-intelligence/sas-wants-its-ai-agents-to-supercharge-workers-not-replace-them"><u>domain-specific AI and collaborative agents</u></a> show SAS is invested in making AI easier to adopt and more effective off-the-shelf for organizations in specific sectors. </p><p>The company is also not shying away from the agentic AI trend, with SAS Viya Intelligent Decisioning allowing customers to build and deploy custom AI agents.</p><p>But in its send-ups of AI hype and <a href="https://www.itpro.com/technology/artificial-intelligence/public-trust-has-become-the-new-currency-for-ai-innovation-why-sas-is-ringing-the-alarm-bell-on-ai-governance-for-enterprises"><u>repeated calls for strong AI governance</u></a>, SAS also spent a good portion of its annual event tackling the assertion that generative AI is the best technology for every problem.</p><p>Jim Goodnight, co-founder and CEO at SAS, gave a scathing assessment of generative AI in conversation with <em>ITPro</em>.</p><p>"There's a lot of money being spent on generative AI and there's a lot of money being wasted,” he said. “The results end up pretty negative because so many companies are just trying to take their current staff and say, ‘Okay, go do this generative AI stuff and they do that and they spend a lot of money.</p><p>This wasn’t limited to Goodnight alone. Gavin Day, the newly-appointed COO at SAS, told <em>ITPro</em> some enterprises could be facing a “summer of disappointment” as far as AI ROI is concerned.</p><p>Of course, SAS is itself using generative AI, with Goodnight quick to point out the value for customers in using LLMs to turn <a href="https://www.itpro.com/machine-learning/33308/what-is-natural-language-processing"><u>natural language</u></a> prompts into code outputs written in the custom SAS programming language. He described the <a href="https://www.itpro.com/technology/artificial-intelligence/ai-generated-code-risks-what-cisos-need-to-know"><u>AI-generated code</u></a> as “actually pretty good”, comparing it to the work of a novice.</p><p>“It's like your first program that you ever wrote, this is sort of the level of the code that's generated, so it's not super professional but it's maybe 80-90% correct.”</p><p>All of this adds up to a defiant approach, in which SAS provides customers with tools to prepare for, build, and deploy AI without falling into the ‘AI for everything’ pit or losing sight of the value that data governance and analytics bring.</p><p>It’s a canny strategy, particularly given how many of SAS’ customers are in heavily regulated industries and continue to approach AI with a degree of skepticism.</p><h2 id="preparing-for-ipo">Preparing for IPO</h2><p>In our <a href="https://www.itpro.com/business/business-strategy/what-to-watch-out-for-at-sas-innovate-2025"><u>preview piece for the conference</u></a>, we speculated that SAS could provide an update on its long-held IPO ambitions, first announced in 2021 with a goal of going public in 2024. While the keynotes and press releases were absent of any further news on this, Goodnight gave <em>ITPro</em> some insight into SAS’ timeline and what being IPO-ready means for the firm.</p><p>“We had 14 financial systems around the world, we’ve now consolidated to one and it has taken us about three to four years to get that in place,” Goodnight said, explaining that this process was finalized in January 2025.</p><p>He added that SAS has also been getting lead to cash (L2C) systems, which encompass the entire process of acquiring customer leads to securing sales, in place as this is something public companies are expected to have.</p><p>“That went into operation on the first of the month,” he said. “So everything's in place but now we have to learn to use this new system that no one's familiar with, so they're working overtime right now trying to feed quotes and stuff into the system. So we’ll need to run on that for at least a year before we’re ready.”</p><p>With this in mind, Goodnight said 2027 was the likeliest year for SAS’ IPO. Day has been heavily involved in the IPO preparation process, told <em>ITPro</em> that external economic factors were also at play here.</p><p>“A little bit over half of our revenue comes from outside of the United States, so we’ve had to pay attention to the global economy for a long time,” he said, adding SAS will continue to closely monitor the situation for the governments it works with.</p><p>“My job is to make sure we can operate as a public company, we can report as a public company, we have sustainable revenue growth, we have sustainable profit. When I do that, I give Dr Goodnight options, he can choose when to go.”</p><p>When it does finally happen, the SAS IPO will be an all-important milestone for the company, especially given the tight control Goodnight has maintained in his near 50-year reign as CEO.</p><p>Goodnight’s faith in the potential and longevity of SAS is evident in fact he’s turned down several acquisition offers in the past.</p><p>“I didn’t like the price,” Goodnight said of the offers he’s received in the past, adding that he was reluctant to see SAS absorbed into another firm.</p><p>In 2021, the Wall Street Journal <a href="https://www.wsj.com/business/deals/broadcom-no-longer-in-talks-to-buy-sas-institute-sources-say-11626212065?mod=hp_lead_pos1" target="_blank"><u>reported</u></a> that alleged Broadcom plans to acquire SAS for $15-20 billion had fallen through after Goodnight and co-founder John Sall changed their minds.</p><h2 id="quantum-is-here-with-a-catch">Quantum is here – with a catch</h2><p>For some years, quantum computing has largely been discussed in terms of the potential risks it poses to common encryption algorithms like RCS. Cybersecurity experts have warned of <a href="https://www.itpro.com/security/cyber-security/370298/what-is-steal-now-crack-later-quantum-computing"><u>‘steal now, crack later’</u></a> attacks in which hackers exfiltrate evergreen encrypted data with the long-term goal of decrypting it when they eventually obtain a quantum computer.</p><p>At SAS Innovate 2025, the firm made something of a splash by claiming quantum is already here – and delivering results for its customers. Using <a href="https://www.itpro.com/technology/sas-thinks-quantum-ai-has-huge-enterprise-potential-heres-why"><u>what it calls quantum AI</u></a>, SAS helped P&amp;G to solve complex combinatorial problems, preventing ingredients from cross-contaminating products its manufacturing process.</p><p>As explained in the <em>ITPro Podcast</em> episode on the conference embedded below, this is not the same thing as the quantum computing often discussed in the industry. It was in fact the result of a process known as ‘quantum annealing’. This is essentially a very advanced, quantum-based optimization <a href="https://www.itpro.com/data-insights/30212/what-is-an-algorithm">algorithm</a>. </p><iframe allow="" height="200px" width="100%" class="position-center" data-lazy-priority="low" data-lazy-src="https://player.captivate.fm/episode/ba3ef117-c09c-4142-bf04-3a8eabf84aec/" src="https://player.captivate.fm/episode/ba3ef117-c09c-4142-bf04-3a8eabf84aec/"></iframe><p>The term quantum AI seems to be doing some work for SAS here, blurring the line between bona-fide quantum calculations and the existing solver algorithms with which SAS is well-acquainted. Even Goodnight questioned the name, telling <em>ITPro</em>: </p><p>“I don’t know why they call it AI, it’s not really AI, but everything’s got to have AI on the end of it.”</p><p>Regardless of the semantics, SAS is investing in quantum solutions now to be ready for the significant future demand it’s predicting in the market. With SAS staying private for the time being and Goodnight telling <em>ITPro </em>that R&amp;D has always been an important area of focus for the firm, it has room to expand its spending on quantum ahead of these projected returns.</p><p>Perhaps unsurprisingly, data underpins all the announcements and claims made at SAS Innovate 2025. As it nears a half-century in the analytics space, SAS appears more confident than ever that whatever the current technological trend, it has the systems and approaches to help any enterprise transform its data into tangible value.</p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ SAS leans on synthetic data and digital twins to support business data demand  ]]></title>
                                                                                                <dc:content><![CDATA[ <p>SAS has announced new <a href="https://www.itpro.com/technology/artificial-intelligence/what-is-synthetic-data"><u>synthetic data</u></a> capabilities and support for digital twins in a push to equip enterprises with concrete platforms for <a href="https://www.itpro.com/business/business-strategy/what-does-data-driven-mean-in-business"><u>data-driven</u></a> decision making.</p><p>Synthetic data is artificial data generated to resemble real datasets in every way that’s meaningful. These datasets are typically used to train AI and <a href="https://www.itpro.com/strategy/28071/what-is-machine-learning">machine learning</a> models without exposing sensitive data.</p><p>While generating synthetic data has benefits, obtaining it can be difficult, research shows. Organizations need access to the right algorithms to generate quality data, particularly if they’re looking to train a <a href="https://www.itpro.com/technology/artificial-intelligence/googles-new-gemma-ai-models-show-that-bigger-isnt-always-better">domain-specific AI model</a> for very targeted use cases.</p><p>This is where SAS Data Maker is intended to come in. The service is a <a href="https://www.itpro.com/software/development/367576/low-code-vs-no-code">low-code/no-code</a> platform that can quickly generate synthetic data in the quantities needed and to a high standard that’s auditable.</p><p>SAS first announced Data Maker in 2024 as an in-preview product with an unspecified release date, and has since acquired the UK synthetic data startup Hazy to improve its data generation software. It has now announced a targeted general release of Q3 2025.</p><p>The announcement was made at <a href="https://www.itpro.com/business/live/sas-innovate-2025-live-all-the-latest-news-and-updates"><em>SAS Innovate 2025</em></a>, the company’s annual conference held in Orlando, Florida. At the same event, SAS elaborated on work it’s doing at the other end of the data pipeline to make better use of existing business data for advanced data simulations, such as <a href="https://www.itpro.com/technology/artificial-intelligence/are-ai-digital-twins-a-match-made-in-heaven"><u>digital twins</u></a>.</p><p>It gave the example of a recent project it has undertaken with the paper and wood-based product manufacturer Georgia-Pacific (GP), in collaboration with Epic Games. </p><p>The trio have leveraged Epic Games’ 3D Unreal Engine, originally developed for video games, combined with GP's enterprise information and SAS data technology, to simulate an entire factory at Savannah River Mill in Georgia.</p><p>Using the factory’s digital twin, GP could analyze the efficiency of its on-site <a href="https://www.itpro.com/business/digital-transformation/not-if-but-when-where-are-the-autonomous-robots"><u>automated guided vehicles (AGVs)</u></a>, as well as lower the barrier to entry for workers seeking analytics data on the factory.</p><p>SAS said its cloud-native Viya platform was integral in getting the project up and running, with GP having used tit to translate <a href="https://www.itpro.com/big-data-analytics/34532/structured-vs-unstructured-data-management"><u>unstructured</u></a> factory data into informations systems that formed the backbone of the digital twin. </p><p>“With the help of SAS and Unreal Engine, we can create realistic simulations of factory operations,” said Roshan Shah, GP’s vice president of AI &amp; Products.</p><p>“Imagine watching AGVs navigate through a bustling factory floor, reacting to proximity alerts, obstacles and rare adverse events in real time," Shah added. </p><p>"The powerful analysis and photorealistic simulations delivered by SAS’ enhanced digital twins can enable decision making and boost output at Savannah River Mill. And they hold great promise for improving productivity, safety and efficiency at other GP facilities.”</p><h3 class="article-body__section" id="section-more-from-itpro"><span>MORE FROM ITPRO</span></h3><ul><li><a href="https://www.itpro.com/business/business-strategy/what-to-watch-out-for-at-sas-innovate-2025">What to watch out for at SAS Innovate 2025</a></li><li><a href="https://www.itpro.com/technology/artificial-intelligence/why-ai-researchers-are-turning-to-nature-for-inspiration">Why AI researchers are turning to nature for inspiration</a></li><li><a href="https://www.itpro.com/technology/artificial-intelligence/are-ai-digital-twins-a-match-made-in-heaven">Are AI digital twins a match made in heaven?</a></li></ul> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/data-and-insights/sas-leans-on-synthetic-data-and-digital-twins-to-support-business-data-demand</link>
                                                                            <description>
                            <![CDATA[ SAS has announced new synthetic data capabilities and support for digital twins in a bid to equip enterprises with concrete platforms for data-driven decision making. ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">Z4DQCCbnk2giHeDNkGTBCc</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/cABnC4VxBx2E2VvEW9MGi3-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Wed, 07 May 2025 14:30:00 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:16:40 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Management]]></category>
                                                    <category><![CDATA[Data and Insights]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Business]]></category>
                                                                                                <author><![CDATA[ rory.bathgate@futurenet.com (Rory Bathgate) ]]></author>                    <dc:creator><![CDATA[ Rory Bathgate ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/Vep5JogbPhduK7R6CUWAm6-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Rory Bathgate was the Features and Multimedia Editor at ITPro until 2026, overseeing all in-depth content and case studies. Throughout his time at ITPro, Rory  charted the rise in popularity of generative AI and specifically companies such as Microsoft, OpenAI, and Google. &lt;/p&gt;&lt;p&gt;Alongside this, he delved into increasing calls for ethical and responsible AI as global legislators circle the technology, as well as the latest in mobile networking technology, from 5G mmWave to the 3G sunset and how it will affect businesses.&lt;/p&gt;&lt;p&gt;He  provided coverage from high-profile tech conferences such as Dell Technologies World, SuiteWorld, and VMware Explore Europe. His on-the-ground coverage  included live blogs, extensive daily coverage of the most significant announcements, analysis pieces, and podcast.&lt;/p&gt;&lt;p&gt;Rory was the co-host of the ITPro Podcast alongside Jane McCallion, where he swapped a keyboard for a microphone to discuss the latest learnings in tech.&lt;/p&gt;&lt;p&gt;Rory has an MA in Eighteenth-Century Studies from King’s College London, as well as a BA in English and American Literature from the University of Kent. He joined ITPro in 2022 as a graduate, after four years in student journalism.&lt;/p&gt;&lt;p&gt;In his free time, Rory enjoys photography and video editing, and can often be found at the cinema or reading a good science fiction paperback.&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/cABnC4VxBx2E2VvEW9MGi3-1920-80.jpg">
                                                            <media:credit><![CDATA[Future]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[A live demonstration of the SAS and Epic collaboration on using the Unreal Engine for digital twins at SAS Innovate 2025.]]></media:description>                                                            <media:text><![CDATA[A live demonstration of the SAS and Epic collaboration on using the Unreal Engine for digital twins at SAS Innovate 2025.]]></media:text>
                                <media:title type="plain"><![CDATA[A live demonstration of the SAS and Epic collaboration on using the Unreal Engine for digital twins at SAS Innovate 2025.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/cABnC4VxBx2E2VvEW9MGi3-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>SAS has announced new <a href="https://www.itpro.com/technology/artificial-intelligence/what-is-synthetic-data"><u>synthetic data</u></a> capabilities and support for digital twins in a push to equip enterprises with concrete platforms for <a href="https://www.itpro.com/business/business-strategy/what-does-data-driven-mean-in-business"><u>data-driven</u></a> decision making.</p><p>Synthetic data is artificial data generated to resemble real datasets in every way that’s meaningful. These datasets are typically used to train AI and <a href="https://www.itpro.com/strategy/28071/what-is-machine-learning">machine learning</a> models without exposing sensitive data.</p><p>While generating synthetic data has benefits, obtaining it can be difficult, research shows. Organizations need access to the right algorithms to generate quality data, particularly if they’re looking to train a <a href="https://www.itpro.com/technology/artificial-intelligence/googles-new-gemma-ai-models-show-that-bigger-isnt-always-better">domain-specific AI model</a> for very targeted use cases.</p><p>This is where SAS Data Maker is intended to come in. The service is a <a href="https://www.itpro.com/software/development/367576/low-code-vs-no-code">low-code/no-code</a> platform that can quickly generate synthetic data in the quantities needed and to a high standard that’s auditable.</p><p>SAS first announced Data Maker in 2024 as an in-preview product with an unspecified release date, and has since acquired the UK synthetic data startup Hazy to improve its data generation software. It has now announced a targeted general release of Q3 2025.</p><p>The announcement was made at <a href="https://www.itpro.com/business/live/sas-innovate-2025-live-all-the-latest-news-and-updates"><em>SAS Innovate 2025</em></a>, the company’s annual conference held in Orlando, Florida. At the same event, SAS elaborated on work it’s doing at the other end of the data pipeline to make better use of existing business data for advanced data simulations, such as <a href="https://www.itpro.com/technology/artificial-intelligence/are-ai-digital-twins-a-match-made-in-heaven"><u>digital twins</u></a>.</p><p>It gave the example of a recent project it has undertaken with the paper and wood-based product manufacturer Georgia-Pacific (GP), in collaboration with Epic Games. </p><p>The trio have leveraged Epic Games’ 3D Unreal Engine, originally developed for video games, combined with GP's enterprise information and SAS data technology, to simulate an entire factory at Savannah River Mill in Georgia.</p><p>Using the factory’s digital twin, GP could analyze the efficiency of its on-site <a href="https://www.itpro.com/business/digital-transformation/not-if-but-when-where-are-the-autonomous-robots"><u>automated guided vehicles (AGVs)</u></a>, as well as lower the barrier to entry for workers seeking analytics data on the factory.</p><p>SAS said its cloud-native Viya platform was integral in getting the project up and running, with GP having used tit to translate <a href="https://www.itpro.com/big-data-analytics/34532/structured-vs-unstructured-data-management"><u>unstructured</u></a> factory data into informations systems that formed the backbone of the digital twin. </p><p>“With the help of SAS and Unreal Engine, we can create realistic simulations of factory operations,” said Roshan Shah, GP’s vice president of AI &amp; Products.</p><p>“Imagine watching AGVs navigate through a bustling factory floor, reacting to proximity alerts, obstacles and rare adverse events in real time," Shah added. </p><p>"The powerful analysis and photorealistic simulations delivered by SAS’ enhanced digital twins can enable decision making and boost output at Savannah River Mill. And they hold great promise for improving productivity, safety and efficiency at other GP facilities.”</p><h3 class="article-body__section" id="section-more-from-itpro"><span>MORE FROM ITPRO</span></h3><ul><li><a href="https://www.itpro.com/business/business-strategy/what-to-watch-out-for-at-sas-innovate-2025">What to watch out for at SAS Innovate 2025</a></li><li><a href="https://www.itpro.com/technology/artificial-intelligence/why-ai-researchers-are-turning-to-nature-for-inspiration">Why AI researchers are turning to nature for inspiration</a></li><li><a href="https://www.itpro.com/technology/artificial-intelligence/are-ai-digital-twins-a-match-made-in-heaven">Are AI digital twins a match made in heaven?</a></li></ul>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ Business leaders are having a crisis of confidence over data literacy ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Business leaders are under immense pressure to back up their decisions with data, but data skills and literacy issues are creating a crisis of confidence.</p><p><a href="https://www.salesforce.com/news/stories/trust-in-business-data-leaders-survey/" target="_blank"><u>Research</u></a> from Salesforce, released as part of a new product launch, found that more than three-quarters of business leaders think the growth in <a href="https://www.itpro.com/strategy/28181/what-is-ai">AI </a>increases their need to be data-driven.</p><p>Unfortunately, though, many are struggling. More than seven-in-ten said they were under pressure to use data to demonstrate business value. Indeed, they said their career depended on their ability to use facts, metrics, and data to drive decisions.</p><p>86% went a step further, saying their careers are reliant on how data literate they are in terms of using methods and tools to extract actionable insights from data. This drive for data literacy was felt by nine-in-ten leaders in sales and marketing.</p><p>"There is an increasing amount of pressure on business leaders to use data in today’s hyper-competitive environment," said Southard Jones, chief product Officer of Tableau, Salesforce's analytics platform. </p><p>"Yet fragmented enterprise data and complex analytics tools are common obstacles leaders face that can significantly hinder confident decision-making." </p><h2 id="confidence-in-data-quality-is-dipping">Confidence in data quality is dipping</h2><p>Meanwhile, business leaders don't trust the data itself. Confidence in data’s relevance to business objectives is down by 18% since 2023 while confidence in its accuracy down 27%. </p><p>Fewer than half said their <a href="https://www.itpro.com/policy-legislation/data-governance/369834/building-a-data-governance-strategy">data strategies</a> fully align with their business priorities - another big drop since 2023. The answer, said Salesforce, is agentic analytics.</p><p>"Agentic analytics offers a solution by unifying data and empowering AI agents to proactively deliver trusted, real-time insights to everyone, enabling data-driven decisions for everyone – even those who don’t consider themselves ‘data people," said Jones.</p><p>These claims come amidst the launch of new features for its Tableau Next product, including three <a href="https://www.itpro.com/software/development/maybe-we-arent-going-to-hire-anybody-this-year-marc-benioff-says-salesforce-might-not-hire-any-software-engineers-in-2025-as-the-firm-reaps-the-benefits-of-ai-agents">AI agents</a>. Data Pro helps convert raw data into business language, automating extract, transform, load (ETL) processes.</p><p>Concierge is a natural language interface allowing users to ask questions in everyday terms and receive visualizations and recommendations - "What are my best sales opportunities?", for example.</p><p>Similarly, the firm said its Inspector tool continuously monitors data for key changes, identifies patterns and trends, and surfaces insights that humans might never think to look for.</p><p>"We’re shifting from basic reports to a world where AI is a collaborative decision-making partner," said said Ryan Aytay, CEO of Tableau. </p><p>"By combining AI agents with trusted data and easy-to-use tools, we’re making data accessible to everyone and transforming the data-to-action process into an automated, proactive, and insight-driven cycle. This empowers users to improve decision-making, boost efficiency, and manage risk more effectively."</p><h3 class="article-body__section" id="section-more-from-itpro"><span>MORE FROM ITPRO</span></h3><ul><li><a href="https://www.itpro.com/business/careers-and-training/generational-decline-in-digital-literacy">Are we facing a generational decline in digital literacy?</a></li><li><a href="https://www.itpro.com/technology/artificial-intelligence/data-strategy-ai-adoption-failures">A quarter of firms still don’t have a formal data strategy – and it’s hampering AI adoption</a></li><li><a href="https://www.itpro.com/business/data-and-insights/what-is-data-democratization">What is data democratization and how will embracing it benefit your business?</a></li></ul> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/data-and-insights/business-leaders-are-having-a-crisis-of-confidence-over-data-literacy</link>
                                                                            <description>
                            <![CDATA[ A Salesforce survey reveals business leaders don't trust their data, or their ability to make the most of it ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">ZVptR2zRVbxVtgbct8sbVb</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/UjeY3QYbwKw2aE2aWn7byL-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Wed, 16 Apr 2025 11:12:59 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:15:43 +0000</updated>
                                                                                                                                            <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Data and Insights]]></category>
                                                    <category><![CDATA[Business]]></category>
                                                                                                                    <dc:creator><![CDATA[ Emma Woollacott ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/aWfskavxoVSMDy6cDWtYmJ-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ null ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/UjeY3QYbwKw2aE2aWn7byL-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Software developer burnout concept image showing female programmer sitting at a desk looking stressed.]]></media:description>                                                            <media:text><![CDATA[Software developer burnout concept image showing female programmer sitting at a desk looking stressed.]]></media:text>
                                <media:title type="plain"><![CDATA[Software developer burnout concept image showing female programmer sitting at a desk looking stressed.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/UjeY3QYbwKw2aE2aWn7byL-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Business leaders are under immense pressure to back up their decisions with data, but data skills and literacy issues are creating a crisis of confidence.</p><p><a href="https://www.salesforce.com/news/stories/trust-in-business-data-leaders-survey/" target="_blank"><u>Research</u></a> from Salesforce, released as part of a new product launch, found that more than three-quarters of business leaders think the growth in <a href="https://www.itpro.com/strategy/28181/what-is-ai">AI </a>increases their need to be data-driven.</p><p>Unfortunately, though, many are struggling. More than seven-in-ten said they were under pressure to use data to demonstrate business value. Indeed, they said their career depended on their ability to use facts, metrics, and data to drive decisions.</p><p>86% went a step further, saying their careers are reliant on how data literate they are in terms of using methods and tools to extract actionable insights from data. This drive for data literacy was felt by nine-in-ten leaders in sales and marketing.</p><p>"There is an increasing amount of pressure on business leaders to use data in today’s hyper-competitive environment," said Southard Jones, chief product Officer of Tableau, Salesforce's analytics platform. </p><p>"Yet fragmented enterprise data and complex analytics tools are common obstacles leaders face that can significantly hinder confident decision-making." </p><h2 id="confidence-in-data-quality-is-dipping">Confidence in data quality is dipping</h2><p>Meanwhile, business leaders don't trust the data itself. Confidence in data’s relevance to business objectives is down by 18% since 2023 while confidence in its accuracy down 27%. </p><p>Fewer than half said their <a href="https://www.itpro.com/policy-legislation/data-governance/369834/building-a-data-governance-strategy">data strategies</a> fully align with their business priorities - another big drop since 2023. The answer, said Salesforce, is agentic analytics.</p><p>"Agentic analytics offers a solution by unifying data and empowering AI agents to proactively deliver trusted, real-time insights to everyone, enabling data-driven decisions for everyone – even those who don’t consider themselves ‘data people," said Jones.</p><p>These claims come amidst the launch of new features for its Tableau Next product, including three <a href="https://www.itpro.com/software/development/maybe-we-arent-going-to-hire-anybody-this-year-marc-benioff-says-salesforce-might-not-hire-any-software-engineers-in-2025-as-the-firm-reaps-the-benefits-of-ai-agents">AI agents</a>. Data Pro helps convert raw data into business language, automating extract, transform, load (ETL) processes.</p><p>Concierge is a natural language interface allowing users to ask questions in everyday terms and receive visualizations and recommendations - "What are my best sales opportunities?", for example.</p><p>Similarly, the firm said its Inspector tool continuously monitors data for key changes, identifies patterns and trends, and surfaces insights that humans might never think to look for.</p><p>"We’re shifting from basic reports to a world where AI is a collaborative decision-making partner," said said Ryan Aytay, CEO of Tableau. </p><p>"By combining AI agents with trusted data and easy-to-use tools, we’re making data accessible to everyone and transforming the data-to-action process into an automated, proactive, and insight-driven cycle. This empowers users to improve decision-making, boost efficiency, and manage risk more effectively."</p><h3 class="article-body__section" id="section-more-from-itpro"><span>MORE FROM ITPRO</span></h3><ul><li><a href="https://www.itpro.com/business/careers-and-training/generational-decline-in-digital-literacy">Are we facing a generational decline in digital literacy?</a></li><li><a href="https://www.itpro.com/technology/artificial-intelligence/data-strategy-ai-adoption-failures">A quarter of firms still don’t have a formal data strategy – and it’s hampering AI adoption</a></li><li><a href="https://www.itpro.com/business/data-and-insights/what-is-data-democratization">What is data democratization and how will embracing it benefit your business?</a></li></ul>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ Redis unveils new tools for developers working on AI applications ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Redis has announced new tools aimed at making it easier for <a href="https://www.itpro.com/strategy/28181/what-is-ai">AI </a>developers to build applications and optimize <a href="https://www.itpro.com/technology/artificial-intelligence/generative-ai-vs-large-language-models">large language model (LLM)</a> outputs. </p><p>The new tools include LangCache, a fully-managed semantic caching service for applications and AI Agents that Redis said will help improve accuracy and speed. </p><p>Vector sets, meanwhile, are a new native data type that allows developers to more easily work with and scale vectors. </p><p>"Both give developers a simpler way to work with the complex data needed to build agentic apps," said Redis CEO Rowan Trollope in a <a href="https://redis.io/blog/spring-release-2025/"><u>blog post</u></a>. </p><p>LangCache looks to help developers integrate large language model (LLM) response caching into applications, with a REST API interface for easy implementation and optimizations included for accurate caching performance, the company said. </p><p>"Semantic caching is essential for GenAI applications, as it significantly reduces response latency and improves cost efficiency while maintaining high-quality user interactions," said Trollope in the blog post. </p><p>LangCache lets developers take a user query that's been asked before and return a relevant response that was cached, helping to save on costly calls to LLMs while also speeding up apps. </p><p>Redis said the tool will also help improve the accuracy of LLM cache retrieval using custom models and configurable search criteria, allow developers to choose a model provider of choice, and govern responses so apps bring back the right data approved for the current user. </p><p>"LangCache and vector sets give developers a simple way to handle the complex data needs that come with building agent-based AI apps," said Trollope in a statement. </p><p>“Just as traditional apps need a cache that stores frequently accessed data, agents need fast access to the data that helps them make decisions to complete their tasks. LangCache speeds up responses and provides more accurate answers, while vector sets give them a simple, elegant way to store and retrieve the data."</p><h2 id="vector-sets">Vector sets</h2><p>The other new announcement from Redis is vector sets: a new native data type that lets developers more easily work with vectors. Vector sets allow the storage and querying of high dimensional vector embeddings — crucial for AI and machine learning, the company said. </p><p>Vector sets were initially developed by Redis creator Salvatore Sanfilippo.</p><p>"They take inspiration from sorted sets, and extend this concept to store and query vector embeddings to search data semantically," Trollope wrote. </p><p>"Like a sorted set, a vector set has string elements, but now they’re associated with a vector instead of a score. The fundamental goal of vector sets is to make it possible to add items, and later get a subset of the added items that are the most similar to a specified vector."</p><p>They come with "exciting additional capabilities," the company said, including quantization, dimensionality reduction, filtering, and multi-threading. </p><p>Vector sets are currently <a href="https://redis.io/blog/announcing-vector-sets-a-new-redis-data-type-for-vector-similarity/"><u>available in beta</u></a> with Redis 8, which is itself available as a release candidate ahead of general availability in the next few weeks.</p><p>Last year Redis <a href="https://www.itpro.com/software/open-source/why-redis-license-changes-arent-the-end-of-the-world-for-open-source"><u>announced changes to its licensing</u></a> that would shift it to a more restrictive software distribution approach that would see cloud providers required to enter into commercial agreements with the company. The move sparked the Linux Foundation to create rival <a href="https://www.itpro.com/software/open-source/linux-foundation-unveils-redis-alternative-valkey-with-backing-from-aws-google-cloud-and-oracle"><u>Valkey</u></a>. </p><h3 class="article-body__section" id="section-more-from-itpro"><span>MORE FROM ITPRO</span></h3><ul><li><a href="https://www.itpro.com/software/development/red-teaming-comes-to-the-fore-as-devs-tackle-ai-application-flaws">Red teaming comes to the fore as devs tackle AI application flaws</a></li><li><a href="https://www.itpro.com/hardware/storage/ai-is-causing-a-data-storage-crisis-for-enterprises">AI is causing a data storage crisis for enterprises</a></li><li><a href="https://www.itpro.com/software/development/developers-are-struggling-to-build-generative-ai-applications-heres-why">Developers are at their wits end trying to build generative AI applications</a></li></ul> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/software/redis-unveils-new-tools-for-developers-working-on-ai-applications</link>
                                                                            <description>
                            <![CDATA[ Redis has announced new tools aimed at making it easier for AI developers to build applications and optimize large language model (LLM) outputs. ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">9UcNngoq7iTAMvyWAAgQeJ</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/rRhHjEWyHMzoLBHV9Q5zu8-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Fri, 11 Apr 2025 11:46:03 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:17:14 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Platforms]]></category>
                                                    <category><![CDATA[Software]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Workplace Technology]]></category>
                                                                                                <author><![CDATA[ ross.kelly@futurenet.com (Ross Kelly) ]]></author>                    <dc:creator><![CDATA[ Ross Kelly ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/Y5vrV2V98Np6jHAGmAtCd3-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Ross Kelly is ITPro&#039;s News &amp;amp; Analysis Editor, with a keen interest in cyber security, business leadership and emerging technologies.&lt;/p&gt;
&lt;p&gt;He graduated from Edinburgh Napier University in 2016 with a BA (Hons) in Journalism, and joined ITPro in 2022 after four years working in technology conference research.&amp;nbsp;&lt;/p&gt;
&lt;p&gt;In his spare time, Ross enjoys cycling, walking and is an avid reader of history and non-fiction.&lt;/p&gt;
&lt;p&gt;You can contact Ross at ross.kelly@futurenet.com or on &lt;a href=&quot;https://twitter.com/rosswritesetc&quot;&gt;Twitter&lt;/a&gt; and &lt;a href=&quot;https://www.linkedin.com/in/ross-kelly-18a54411a/&quot;&gt;LinkedIn&lt;/a&gt;.&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/rRhHjEWyHMzoLBHV9Q5zu8-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Open source AI concept image showing digitized human brain contained within a lightbulb, placed on top of a circuit board with binary code in background.]]></media:description>                                                            <media:text><![CDATA[Open source AI concept image showing digitized human brain contained within a lightbulb, placed on top of a circuit board with binary code in background.]]></media:text>
                                <media:title type="plain"><![CDATA[Open source AI concept image showing digitized human brain contained within a lightbulb, placed on top of a circuit board with binary code in background.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/rRhHjEWyHMzoLBHV9Q5zu8-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Redis has announced new tools aimed at making it easier for <a href="https://www.itpro.com/strategy/28181/what-is-ai">AI </a>developers to build applications and optimize <a href="https://www.itpro.com/technology/artificial-intelligence/generative-ai-vs-large-language-models">large language model (LLM)</a> outputs. </p><p>The new tools include LangCache, a fully-managed semantic caching service for applications and AI Agents that Redis said will help improve accuracy and speed. </p><p>Vector sets, meanwhile, are a new native data type that allows developers to more easily work with and scale vectors. </p><p>"Both give developers a simpler way to work with the complex data needed to build agentic apps," said Redis CEO Rowan Trollope in a <a href="https://redis.io/blog/spring-release-2025/"><u>blog post</u></a>. </p><p>LangCache looks to help developers integrate large language model (LLM) response caching into applications, with a REST API interface for easy implementation and optimizations included for accurate caching performance, the company said. </p><p>"Semantic caching is essential for GenAI applications, as it significantly reduces response latency and improves cost efficiency while maintaining high-quality user interactions," said Trollope in the blog post. </p><p>LangCache lets developers take a user query that's been asked before and return a relevant response that was cached, helping to save on costly calls to LLMs while also speeding up apps. </p><p>Redis said the tool will also help improve the accuracy of LLM cache retrieval using custom models and configurable search criteria, allow developers to choose a model provider of choice, and govern responses so apps bring back the right data approved for the current user. </p><p>"LangCache and vector sets give developers a simple way to handle the complex data needs that come with building agent-based AI apps," said Trollope in a statement. </p><p>“Just as traditional apps need a cache that stores frequently accessed data, agents need fast access to the data that helps them make decisions to complete their tasks. LangCache speeds up responses and provides more accurate answers, while vector sets give them a simple, elegant way to store and retrieve the data."</p><h2 id="vector-sets">Vector sets</h2><p>The other new announcement from Redis is vector sets: a new native data type that lets developers more easily work with vectors. Vector sets allow the storage and querying of high dimensional vector embeddings — crucial for AI and machine learning, the company said. </p><p>Vector sets were initially developed by Redis creator Salvatore Sanfilippo.</p><p>"They take inspiration from sorted sets, and extend this concept to store and query vector embeddings to search data semantically," Trollope wrote. </p><p>"Like a sorted set, a vector set has string elements, but now they’re associated with a vector instead of a score. The fundamental goal of vector sets is to make it possible to add items, and later get a subset of the added items that are the most similar to a specified vector."</p><p>They come with "exciting additional capabilities," the company said, including quantization, dimensionality reduction, filtering, and multi-threading. </p><p>Vector sets are currently <a href="https://redis.io/blog/announcing-vector-sets-a-new-redis-data-type-for-vector-similarity/"><u>available in beta</u></a> with Redis 8, which is itself available as a release candidate ahead of general availability in the next few weeks.</p><p>Last year Redis <a href="https://www.itpro.com/software/open-source/why-redis-license-changes-arent-the-end-of-the-world-for-open-source"><u>announced changes to its licensing</u></a> that would shift it to a more restrictive software distribution approach that would see cloud providers required to enter into commercial agreements with the company. The move sparked the Linux Foundation to create rival <a href="https://www.itpro.com/software/open-source/linux-foundation-unveils-redis-alternative-valkey-with-backing-from-aws-google-cloud-and-oracle"><u>Valkey</u></a>. </p><h3 class="article-body__section" id="section-more-from-itpro"><span>MORE FROM ITPRO</span></h3><ul><li><a href="https://www.itpro.com/software/development/red-teaming-comes-to-the-fore-as-devs-tackle-ai-application-flaws">Red teaming comes to the fore as devs tackle AI application flaws</a></li><li><a href="https://www.itpro.com/hardware/storage/ai-is-causing-a-data-storage-crisis-for-enterprises">AI is causing a data storage crisis for enterprises</a></li><li><a href="https://www.itpro.com/software/development/developers-are-struggling-to-build-generative-ai-applications-heres-why">Developers are at their wits end trying to build generative AI applications</a></li></ul>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ What is synthetic data? ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Over the last few months, the term ‘synthetic data’ has found itself being used more frequently by tech leaders across the world, heralded as a possible solution to the looming data shortage crisis. </p><p>Synthetic data has been around far longer than the current explosion in AI adoption, used as a technique by businesses to alter or synthesize data sets to mask information, achieve particular outcomes, or fill in knowledge gaps. </p><p>In short, it’s artificial data generated by algorithms to mimic organically created data, per a definition of synthetic data from the <a href="https://www.edps.europa.eu/press-publications/publications/techsonar/synthetic-data_en#:~:text=Synthetic%20data%20is%20artificial%20data,undergoing%20the%20same%20statistical%20analysis."><u>European Data Protection Supervisor (EDPS)</u></a>. </p><p>This means synthetic data and original data should deliver similar results when used for tasks such as statistical analysis and <a href="https://www.itpro.com/business-intelligence/28220/what-is-data-analytics">data analytics</a>. The potential? Businesses can utilize the characteristics of user-generated data without having to harvest and use the data itself, or leverage the benefits of <a href="https://www.itpro.com/business-intelligence/28173/what-is-big-data">big data</a> for <a href="https://www.itpro.com/business/business-strategy/what-does-data-driven-mean-in-business">data-driven</a> decision making even if their organic datasets are too small.</p><h2 id="how-is-synthetic-data-made">How is synthetic data made? </h2><p>Historically, synthetic data has been created using Generative Adversarial Networks (GANs), a process in which a machine learning (ML) model uses a combination of neural networks to create new data.</p><p><a href="https://developers.google.com/machine-learning/gan/gan_structure#:~:text=A%20generative%20adversarial%20network%20(GAN,fake%20data%20from%20real%20data." target="_blank"><u>As described by Google Cloud</u></a>, GANs work by pitting a ‘generator’ and a ‘discriminator’ against one another. The generator creates fake data and that discriminator has to spot the difference between this fake data and real data. </p><p>While the generator initially creates data that is easily identifiable as fake, it gradually begins to learn how to mimic real data more effectively. This process can be used to generate valuable synthetic data. </p><p>Now, however, <a href="https://www.itpro.com/technology/artificial-intelligence/generative-ai-vs-large-language-models">large language models (LLMs)</a> can be used to create synthetic data generatively. Users can prompt models to create synthetic versions of existing data that possess the same characteristics. This method of creating synthetic data has its advantages and can be a useful way of creating such data without undergoing the process of GAN use. </p><h2 id="how-can-businesses-deploy-synthetic-data">How can businesses deploy synthetic data? </h2><p>Utilizing just the characteristics of data has many applications in a business context, from software development to ensuring <a href="https://www.itpro.com/data-protection/28177/data-protection-policies-and-procedures">data privacy compliance</a>. For the latter, synthetic data is a useful tool that allows businesses to get value out of their data without breaching any data privacy regulation.</p><p>Synthetic data can be used to strengthen datasets from a privacy perspective in three main ways: businesses can create entirely synthetic data, they can create partially synthetic data that has had the sensitive information redacted, or they can tokenize or encrypt the data. </p><p>Synthetic data can be used to generate useful data for industry-specific models according to Chris Royles, EMEA Field CTO at Cloudera. This is partly based on existing data an enterprise may have such as customer purchases, phone call data in telecommunications, or transaction stats in financial services.</p><p>“What's interesting is, as a business, that data becomes proprietary to you. It's unique to you and therefore it might not represent the full spectrum of scenarios. You might not have all customers of every age range, say. You might not have every customer who lives in the same geographic region,” Royles told <em>ITPro</em>.</p><div  class="fancy-box"><div class="fancy_box-title">RELATED WEBINAR</div><div class="fancy_box_body"><figure class="van-image-figure "  ><div class='image-full-width-wrapper'><div class='image-widthsetter' ><p class="vanilla-image-block" style="padding-top:56.25%;"><img id="8ZYfqjTyH38voEfveFN8V3" name="Strategies for improving security team efficiency.jpg" caption="" alt="Strategies for improving security team efficiency" src="https://cdn.mos.cms.futurecdn.net/8ZYfqjTyH38voEfveFN8V3-1920-80.jpg" mos="" link="" align="" fullscreen="" width="" height="" attribution="" endorsement="" class="pinterest-pin-exclude" /></p></div></div><figcaption itemprop="caption description" class=""><span class="credit" itemprop="copyrightHolder">(Image credit: Cloudflare)</span></figcaption></figure><p class="fancy-box__body-text"><a data-analytics-id="inline-link" href="https://www.itpro.com/cloud/cloud-computing/strategies-for-improving-security-team-efficiency"><em>Research findings on how to improve security efficiency</em></a></p></div></div><p>“So what synthetic data enables you to do in the first stage is take the data that you do have and supplement it with the data you don't have. Think about the white space you might need to fill in order to create a better representation of the data you're going to use to train the model.”</p><p>Andreas Kollegger, <a href="https://www.itpro.com/technology/artificial-intelligence-ai/369959/what-is-generative-ai">generative AI</a> lead at Neo4j, tells <em>ITPro</em> that synthetic data also has a long history of use for software development, particularly when it comes to testing software.</p><p>“From the first moment somebody commits some code, almost the second thing they do – sometimes the first – is they write some tests,” Kollegger says. “In order to test if the code works, you need some kind of input to run your software and figure out if it's doing the thing.”</p><p>Synthetic data works well in these situations, as developers can use it to test if their piece of code or software is operating correctly without having to source real data or put the software live before it’s finished in order for it to interact with realistic inputs.</p><h2 id="why-is-synthetic-data-useful-for-ai">Why is synthetic data useful for AI?</h2><p>Synthetic data has several applications in the context of AI. First, it can be used in its traditional sense, as a way of generating large amounts of sanitized data for training AI models. As Kollegger reminds <em>ITPro</em>, businesses can’t expect information they enter into an AI system to be forgotten and this can be troubling if it contains sensitive aspects. </p><p>“It's made to remember the details. That's the entire function of it. And so it becomes incredibly important, in the context of doing training, to do the data masking that you're talking about,” Kollegger said. </p><p>“The personally identifying information (PII), all of that, has got to be stripped out before you feed it to an LLM, for sure, because the LLM will remember those things and then you will compromise people's privacy,” he added. </p><p>As mentioned above, organizations can also use AI to create synthetic data. Dael Williamson, EMEA CTO at Databricks, discusses this in more detail to <em>ITPro, </em>explaining that using AI to create data that is not entirely synthetic, but rather “synthesized real data". This can in turn be used to train or fine tune larger AI models that require enormous datasets. </p><p>“You create this life cycle, so it's not as simple as old, deterministic systems, where you write an algorithm, put it in production, and leave it for the next four decades,” he adds.  </p><h2 id="synthetic-data-vs-organic-data-in-ai-training">Synthetic data vs organic data in AI training </h2><p>While AI was initially fuelled by organic data, trained on the wealth of human-made information scraped from across the web, Williamson notes that there are increasing suggestions that AI developers have run out of data. </p><p>“I think it was Ilya Sutskever said this, that we've exhausted the fossil fuels of data. So there's only X amount of data on the planet that's been produced by humans, and we've used it all,” he tells <em>ITPro</em>.</p><p>While Williamson explains he doesn’t agree with the assertion that we’ve used all the available data, he acknowledges that the tech industry will ultimately hit these limits. Synthetic data could play a role in solving this issue and assist in large model development.</p><p>But how will synthetic data stack up to organic data? Asked whether the integrity of synthetic data is viable over time, Williamson suggests that there will continue to be a need for some organic data.</p><p>“The copy of a copy is fine,” he says. “The copy of a copy of a copy of a copy eventually degrades the effectiveness of it. That's why, through this process, you have to collect actual traces from real world human interactions.”</p><p>Users can conduct monitoring to collect real-world traces that can be fed back into the creation of synthetic data. Because humans are interacting with the model or involved in creating synthetic data, elements of organic trace will end up in new synthetic data and stop the data from becoming less valuable. </p><p>“So what we do is we balance – we balance the real world with the synthetic and with the humans in the loop,” he added. “It's this harmony and equilibrium between real-world data, real-world expertise, and the synthetic data generation to fill the gaps.”</p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/technology/artificial-intelligence/what-is-synthetic-data</link>
                                                                            <description>
                            <![CDATA[ Long used for advanced statistics and training algorithms, synthetic data is experiencing a new lease of life driven by generative AI training demand ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">tT34hRJFtiNmewdBhansQb</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/5JGA52UuMcFPQMWDKmaiLa-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Thu, 13 Mar 2025 09:02:26 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:16:42 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Management]]></category>
                                                    <category><![CDATA[Artificial Intelligence]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                                                                <author><![CDATA[ george.fitzmaurice@futurenet.com (George Fitzmaurice) ]]></author>                    <dc:creator><![CDATA[ George Fitzmaurice ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/N4xHCjSAXKcijjt3oiQtfc-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ null ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/5JGA52UuMcFPQMWDKmaiLa-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[A macro image of overlayed blue numbers, yellow and red patterns, and code to represent synthetic data generation.]]></media:description>                                                            <media:text><![CDATA[A macro image of overlayed blue numbers, yellow and red patterns, and code to represent synthetic data generation.]]></media:text>
                                <media:title type="plain"><![CDATA[A macro image of overlayed blue numbers, yellow and red patterns, and code to represent synthetic data generation.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/5JGA52UuMcFPQMWDKmaiLa-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Over the last few months, the term ‘synthetic data’ has found itself being used more frequently by tech leaders across the world, heralded as a possible solution to the looming data shortage crisis. </p><p>Synthetic data has been around far longer than the current explosion in AI adoption, used as a technique by businesses to alter or synthesize data sets to mask information, achieve particular outcomes, or fill in knowledge gaps. </p><p>In short, it’s artificial data generated by algorithms to mimic organically created data, per a definition of synthetic data from the <a href="https://www.edps.europa.eu/press-publications/publications/techsonar/synthetic-data_en#:~:text=Synthetic%20data%20is%20artificial%20data,undergoing%20the%20same%20statistical%20analysis."><u>European Data Protection Supervisor (EDPS)</u></a>. </p><p>This means synthetic data and original data should deliver similar results when used for tasks such as statistical analysis and <a href="https://www.itpro.com/business-intelligence/28220/what-is-data-analytics">data analytics</a>. The potential? Businesses can utilize the characteristics of user-generated data without having to harvest and use the data itself, or leverage the benefits of <a href="https://www.itpro.com/business-intelligence/28173/what-is-big-data">big data</a> for <a href="https://www.itpro.com/business/business-strategy/what-does-data-driven-mean-in-business">data-driven</a> decision making even if their organic datasets are too small.</p><h2 id="how-is-synthetic-data-made">How is synthetic data made? </h2><p>Historically, synthetic data has been created using Generative Adversarial Networks (GANs), a process in which a machine learning (ML) model uses a combination of neural networks to create new data.</p><p><a href="https://developers.google.com/machine-learning/gan/gan_structure#:~:text=A%20generative%20adversarial%20network%20(GAN,fake%20data%20from%20real%20data." target="_blank"><u>As described by Google Cloud</u></a>, GANs work by pitting a ‘generator’ and a ‘discriminator’ against one another. The generator creates fake data and that discriminator has to spot the difference between this fake data and real data. </p><p>While the generator initially creates data that is easily identifiable as fake, it gradually begins to learn how to mimic real data more effectively. This process can be used to generate valuable synthetic data. </p><p>Now, however, <a href="https://www.itpro.com/technology/artificial-intelligence/generative-ai-vs-large-language-models">large language models (LLMs)</a> can be used to create synthetic data generatively. Users can prompt models to create synthetic versions of existing data that possess the same characteristics. This method of creating synthetic data has its advantages and can be a useful way of creating such data without undergoing the process of GAN use. </p><h2 id="how-can-businesses-deploy-synthetic-data">How can businesses deploy synthetic data? </h2><p>Utilizing just the characteristics of data has many applications in a business context, from software development to ensuring <a href="https://www.itpro.com/data-protection/28177/data-protection-policies-and-procedures">data privacy compliance</a>. For the latter, synthetic data is a useful tool that allows businesses to get value out of their data without breaching any data privacy regulation.</p><p>Synthetic data can be used to strengthen datasets from a privacy perspective in three main ways: businesses can create entirely synthetic data, they can create partially synthetic data that has had the sensitive information redacted, or they can tokenize or encrypt the data. </p><p>Synthetic data can be used to generate useful data for industry-specific models according to Chris Royles, EMEA Field CTO at Cloudera. This is partly based on existing data an enterprise may have such as customer purchases, phone call data in telecommunications, or transaction stats in financial services.</p><p>“What's interesting is, as a business, that data becomes proprietary to you. It's unique to you and therefore it might not represent the full spectrum of scenarios. You might not have all customers of every age range, say. You might not have every customer who lives in the same geographic region,” Royles told <em>ITPro</em>.</p><div  class="fancy-box"><div class="fancy_box-title">RELATED WEBINAR</div><div class="fancy_box_body"><figure class="van-image-figure "  ><div class='image-full-width-wrapper'><div class='image-widthsetter' ><p class="vanilla-image-block" style="padding-top:56.25%;"><img id="8ZYfqjTyH38voEfveFN8V3" name="Strategies for improving security team efficiency.jpg" caption="" alt="Strategies for improving security team efficiency" src="https://cdn.mos.cms.futurecdn.net/8ZYfqjTyH38voEfveFN8V3-1920-80.jpg" mos="" link="" align="" fullscreen="" width="" height="" attribution="" endorsement="" class="pinterest-pin-exclude" /></p></div></div><figcaption itemprop="caption description" class=""><span class="credit" itemprop="copyrightHolder">(Image credit: Cloudflare)</span></figcaption></figure><p class="fancy-box__body-text"><a data-analytics-id="inline-link" href="https://www.itpro.com/cloud/cloud-computing/strategies-for-improving-security-team-efficiency"><em>Research findings on how to improve security efficiency</em></a></p></div></div><p>“So what synthetic data enables you to do in the first stage is take the data that you do have and supplement it with the data you don't have. Think about the white space you might need to fill in order to create a better representation of the data you're going to use to train the model.”</p><p>Andreas Kollegger, <a href="https://www.itpro.com/technology/artificial-intelligence-ai/369959/what-is-generative-ai">generative AI</a> lead at Neo4j, tells <em>ITPro</em> that synthetic data also has a long history of use for software development, particularly when it comes to testing software.</p><p>“From the first moment somebody commits some code, almost the second thing they do – sometimes the first – is they write some tests,” Kollegger says. “In order to test if the code works, you need some kind of input to run your software and figure out if it's doing the thing.”</p><p>Synthetic data works well in these situations, as developers can use it to test if their piece of code or software is operating correctly without having to source real data or put the software live before it’s finished in order for it to interact with realistic inputs.</p><h2 id="why-is-synthetic-data-useful-for-ai">Why is synthetic data useful for AI?</h2><p>Synthetic data has several applications in the context of AI. First, it can be used in its traditional sense, as a way of generating large amounts of sanitized data for training AI models. As Kollegger reminds <em>ITPro</em>, businesses can’t expect information they enter into an AI system to be forgotten and this can be troubling if it contains sensitive aspects. </p><p>“It's made to remember the details. That's the entire function of it. And so it becomes incredibly important, in the context of doing training, to do the data masking that you're talking about,” Kollegger said. </p><p>“The personally identifying information (PII), all of that, has got to be stripped out before you feed it to an LLM, for sure, because the LLM will remember those things and then you will compromise people's privacy,” he added. </p><p>As mentioned above, organizations can also use AI to create synthetic data. Dael Williamson, EMEA CTO at Databricks, discusses this in more detail to <em>ITPro, </em>explaining that using AI to create data that is not entirely synthetic, but rather “synthesized real data". This can in turn be used to train or fine tune larger AI models that require enormous datasets. </p><p>“You create this life cycle, so it's not as simple as old, deterministic systems, where you write an algorithm, put it in production, and leave it for the next four decades,” he adds.  </p><h2 id="synthetic-data-vs-organic-data-in-ai-training">Synthetic data vs organic data in AI training </h2><p>While AI was initially fuelled by organic data, trained on the wealth of human-made information scraped from across the web, Williamson notes that there are increasing suggestions that AI developers have run out of data. </p><p>“I think it was Ilya Sutskever said this, that we've exhausted the fossil fuels of data. So there's only X amount of data on the planet that's been produced by humans, and we've used it all,” he tells <em>ITPro</em>.</p><p>While Williamson explains he doesn’t agree with the assertion that we’ve used all the available data, he acknowledges that the tech industry will ultimately hit these limits. Synthetic data could play a role in solving this issue and assist in large model development.</p><p>But how will synthetic data stack up to organic data? Asked whether the integrity of synthetic data is viable over time, Williamson suggests that there will continue to be a need for some organic data.</p><p>“The copy of a copy is fine,” he says. “The copy of a copy of a copy of a copy eventually degrades the effectiveness of it. That's why, through this process, you have to collect actual traces from real world human interactions.”</p><p>Users can conduct monitoring to collect real-world traces that can be fed back into the creation of synthetic data. Because humans are interacting with the model or involved in creating synthetic data, elements of organic trace will end up in new synthetic data and stop the data from becoming less valuable. </p><p>“So what we do is we balance – we balance the real world with the synthetic and with the humans in the loop,” he added. “It's this harmony and equilibrium between real-world data, real-world expertise, and the synthetic data generation to fill the gaps.”</p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ Data quality worries are holding back AI adoption among manufacturers, despite optimismover its growth potential ]]></title>
                                                                                                <dc:content><![CDATA[ <p>While manufacturers are enthusiastic about AI, they're holding back because of concerns about poor data quality.</p><p>Research from Riverbed found more than nine-in-ten (92%) manufacturing leaders agree that AI will provide a competitive advantage and 65% expect it to be a driver of growth by 2027.</p><p>However, far fewer say they feel fully prepared to adopt and deploy the technology today, with under one third (32%) fully prepared to <a href="https://www.itpro.com/technology/artificial-intelligence/five-steps-for-implementing-predictive-ai-successfully"><u>implement AI</u></a>. Riverbed noted this is 5% lower than the average across industries.</p><p>One of the major factors holding manufacturers back is data quality, the report found. While 87% of manufacturing leaders agree that great data is critical for AI success, over two-thirds (69%) question how effective their firm currently is at using data for AI.</p><p>Under half of those surveyed (42%) classed their organization’s data as ‘excellent’, across measures such as accuracy and completeness, with the same figure identifying their low data quality as a barrier to further AI investment. This is in line with other recent reports that <a href="https://www.itpro.com/business-strategy/chief-data-officer-cdo/370082/role-of-the-chief-data-officer-cdo-evolve"><u>chief data officers (CDOs)</u></a> are <a href="https://www.itpro.com/business/data-and-insights/ai-projects-are-faltering-as-cdos-grapple-with-poor-data-quality"><u>blaming poor data quality on slow AI adoption</u></a>.</p><p>Meanwhile, with the manufacturing industry particularly reliant on <a href="https://www.itpro.com/security/the-risks-of-legacy-technology-for-your-business"><u>legacy systems</u></a>, 92% manufacturing leaders express fear that AI could expose proprietary data to the public domain.</p><p>"AI is transforming the manufacturing industry, offering significant benefits in terms of operational efficiencies, reducing costs, and the ability to innovate at a faster pace to maintain a competitive edge," said Jim Gargan, CMO at Riverbed.</p><p>"However, for manufacturers to deliver substantial performance improvements and improve their AI Ops initiatives, they must focus on the quality of their data."</p><p>A majority manufacturers have at least moved beyond the stages of assessing and experimenting with AI, according to Riverbed. The study found that more than half (56%) are accelerating their AI strategies by investing in infrastructure and talent, while 29% are approaching the final stage of full AI integration within daily operations. </p><p>Riverbed’s data comes from the newly-released, manufacturing sector specific results of its wider <a href="https://www.riverbed.com/global-ai-survey/" target="_blank"><u><em>Riverbed Global AI &amp; Digital Experience Survey</em></u></a>. The larger survey took in responses from 1,200 IT, business, and public sector decision makers across the US, UK, Australia, France, Germany, Spain, and Saudi Arabia in June 2024.</p><h2 id="interest-and-concerns-over-ai-transformation">Interest and concerns over AI transformation </h2><p>Manufacturers can benefit from AI in terms of increased efficiency and productivity, improvements in product quality, optimizing inventory levels and production processes, and applying proactive <a href="https://www.itpro.com/business/business-strategy/what-does-data-driven-mean-in-business">data-driven decision making</a>. </p><p>Riverbed found that over the next three years, 80% expect to introduce workflow automation, with 69% moving to automated remediation and 63% implementing 24/7 support availability such as <a href="https://www.itpro.com/technology/artificial-intelligence/the-pros-and-cons-of-chatbots-for-customer-service">chatbots</a>. </p><p>To get in gear for AI, more than half (57%) of manufacturers have formed dedicated AI teams, and 42% have created observability and/or user experience teams.</p><iframe allow="" height="200px" width="100%" class="position-center" data-lazy-priority="low" data-lazy-src="https://player.captivate.fm/episode/e72e3adf-5bdc-4be4-bfe8-51510b6b9843/" src="https://player.captivate.fm/episode/e72e3adf-5bdc-4be4-bfe8-51510b6b9843/"></iframe><p>While manufacturers are wary of potential security risks, many are working to address these issues, the Riverbed study noted. More than eight-in-ten respondents agreed that observability across all elements of IT will be critical to ensuring AI Ops success. </p><p>A similar number noted they are working to tackle network blindspots, including public cloud, enterprise mobile devices, and remote work environments. To counter this, many are focusing on zero trust architecture projects. </p><p>However, the report found, there's something of a reality gap amongst manufacturers, with three-quarters claiming to be ahead of their peers, including 25% who say they are significantly ahead. Only 7% say they are behind. </p><p>"This gap between perception and reality indicates many leaders are overconfident about where their IT function is on their AI journey in relation to their industry peers," Riverbed wrote.</p><h3 class="article-body__section" id="section-more-from-itpro"><span>MORE FROM ITPRO</span></h3><ul><li><a href="https://www.itpro.com/business/business-strategy/microsoft-says-theres-an-ai-divide-brewing-heres-how-enterprises-can-get-on-the-right-side">Microsoft says there’s an AI divide brewing – here’s how enterprises can get on the right side</a></li><li><a href="https://www.itpro.com/technology/artificial-intelligence/conversational-ai-spending-is-going-to-skyrocket-this-year-heres-why">Conversational AI spending is going to skyrocket this year – here’s why</a></li><li><a href="https://www.itpro.com/business/quantexa-series-f-funding-round">Quantexa, one of the UK’s leading AI stars, just raised $175 million</a></li></ul> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/technology/artificial-intelligence/data-quality-worries-holding-back-manufacturer-ai</link>
                                                                            <description>
                            <![CDATA[ Less than half of manufacturing leaders describe their data as "excellent" while  two-thirds question how they're using data for AI ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">AmxCFQ8wiidSTAQmchTMuV</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/ACUdnTJ3moNCqh9HeJ92xF-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Fri, 07 Mar 2025 12:12:24 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:16:41 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Management]]></category>
                                                    <category><![CDATA[Artificial Intelligence]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                                                                                    <dc:creator><![CDATA[ Emma Woollacott ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/aWfskavxoVSMDy6cDWtYmJ-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ null ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/ACUdnTJ3moNCqh9HeJ92xF-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[A CGI image of purple and red cubes exploding apart against a yellow background and set on a pale pink reflective surface, to represent poor quality data.]]></media:description>                                                            <media:text><![CDATA[A CGI image of purple and red cubes exploding apart against a yellow background and set on a pale pink reflective surface, to represent poor quality data.]]></media:text>
                                <media:title type="plain"><![CDATA[A CGI image of purple and red cubes exploding apart against a yellow background and set on a pale pink reflective surface, to represent poor quality data.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/ACUdnTJ3moNCqh9HeJ92xF-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>While manufacturers are enthusiastic about AI, they're holding back because of concerns about poor data quality.</p><p>Research from Riverbed found more than nine-in-ten (92%) manufacturing leaders agree that AI will provide a competitive advantage and 65% expect it to be a driver of growth by 2027.</p><p>However, far fewer say they feel fully prepared to adopt and deploy the technology today, with under one third (32%) fully prepared to <a href="https://www.itpro.com/technology/artificial-intelligence/five-steps-for-implementing-predictive-ai-successfully"><u>implement AI</u></a>. Riverbed noted this is 5% lower than the average across industries.</p><p>One of the major factors holding manufacturers back is data quality, the report found. While 87% of manufacturing leaders agree that great data is critical for AI success, over two-thirds (69%) question how effective their firm currently is at using data for AI.</p><p>Under half of those surveyed (42%) classed their organization’s data as ‘excellent’, across measures such as accuracy and completeness, with the same figure identifying their low data quality as a barrier to further AI investment. This is in line with other recent reports that <a href="https://www.itpro.com/business-strategy/chief-data-officer-cdo/370082/role-of-the-chief-data-officer-cdo-evolve"><u>chief data officers (CDOs)</u></a> are <a href="https://www.itpro.com/business/data-and-insights/ai-projects-are-faltering-as-cdos-grapple-with-poor-data-quality"><u>blaming poor data quality on slow AI adoption</u></a>.</p><p>Meanwhile, with the manufacturing industry particularly reliant on <a href="https://www.itpro.com/security/the-risks-of-legacy-technology-for-your-business"><u>legacy systems</u></a>, 92% manufacturing leaders express fear that AI could expose proprietary data to the public domain.</p><p>"AI is transforming the manufacturing industry, offering significant benefits in terms of operational efficiencies, reducing costs, and the ability to innovate at a faster pace to maintain a competitive edge," said Jim Gargan, CMO at Riverbed.</p><p>"However, for manufacturers to deliver substantial performance improvements and improve their AI Ops initiatives, they must focus on the quality of their data."</p><p>A majority manufacturers have at least moved beyond the stages of assessing and experimenting with AI, according to Riverbed. The study found that more than half (56%) are accelerating their AI strategies by investing in infrastructure and talent, while 29% are approaching the final stage of full AI integration within daily operations. </p><p>Riverbed’s data comes from the newly-released, manufacturing sector specific results of its wider <a href="https://www.riverbed.com/global-ai-survey/" target="_blank"><u><em>Riverbed Global AI &amp; Digital Experience Survey</em></u></a>. The larger survey took in responses from 1,200 IT, business, and public sector decision makers across the US, UK, Australia, France, Germany, Spain, and Saudi Arabia in June 2024.</p><h2 id="interest-and-concerns-over-ai-transformation">Interest and concerns over AI transformation </h2><p>Manufacturers can benefit from AI in terms of increased efficiency and productivity, improvements in product quality, optimizing inventory levels and production processes, and applying proactive <a href="https://www.itpro.com/business/business-strategy/what-does-data-driven-mean-in-business">data-driven decision making</a>. </p><p>Riverbed found that over the next three years, 80% expect to introduce workflow automation, with 69% moving to automated remediation and 63% implementing 24/7 support availability such as <a href="https://www.itpro.com/technology/artificial-intelligence/the-pros-and-cons-of-chatbots-for-customer-service">chatbots</a>. </p><p>To get in gear for AI, more than half (57%) of manufacturers have formed dedicated AI teams, and 42% have created observability and/or user experience teams.</p><iframe allow="" height="200px" width="100%" class="position-center" data-lazy-priority="low" data-lazy-src="https://player.captivate.fm/episode/e72e3adf-5bdc-4be4-bfe8-51510b6b9843/" src="https://player.captivate.fm/episode/e72e3adf-5bdc-4be4-bfe8-51510b6b9843/"></iframe><p>While manufacturers are wary of potential security risks, many are working to address these issues, the Riverbed study noted. More than eight-in-ten respondents agreed that observability across all elements of IT will be critical to ensuring AI Ops success. </p><p>A similar number noted they are working to tackle network blindspots, including public cloud, enterprise mobile devices, and remote work environments. To counter this, many are focusing on zero trust architecture projects. </p><p>However, the report found, there's something of a reality gap amongst manufacturers, with three-quarters claiming to be ahead of their peers, including 25% who say they are significantly ahead. Only 7% say they are behind. </p><p>"This gap between perception and reality indicates many leaders are overconfident about where their IT function is on their AI journey in relation to their industry peers," Riverbed wrote.</p><h3 class="article-body__section" id="section-more-from-itpro"><span>MORE FROM ITPRO</span></h3><ul><li><a href="https://www.itpro.com/business/business-strategy/microsoft-says-theres-an-ai-divide-brewing-heres-how-enterprises-can-get-on-the-right-side">Microsoft says there’s an AI divide brewing – here’s how enterprises can get on the right side</a></li><li><a href="https://www.itpro.com/technology/artificial-intelligence/conversational-ai-spending-is-going-to-skyrocket-this-year-heres-why">Conversational AI spending is going to skyrocket this year – here’s why</a></li><li><a href="https://www.itpro.com/business/quantexa-series-f-funding-round">Quantexa, one of the UK’s leading AI stars, just raised $175 million</a></li></ul>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ Three-quarters of data analysts are still reliant on spreadsheets and manual preparation ]]></title>
                                                                                                <dc:content><![CDATA[ <p><a href="https://www.itpro.com/business-strategy/data-insights/369275/data-science-vs-data-analytics-which-field-is-right-for-you">Data analysts</a> around the world remain dependent on spreadsheets for preparation tasks that take up a significant portion of their day, according to new research.</p><p>A <a href="https://www.alteryx.com/resources/report/2025-state-of-the-data-analyst" target="_blank">survey</a> commissioned by <a href="https://www.itpro.com/business/leadership/alteryx-names-andy-macmillan-as-new-ceo">Alteryx</a>, spoke to global data, IT, and operations analysts across five industries to determine how the role is changing in the face of new technologies and <a href="https://www.itpro.com/technology/artificial-intelligence-ai/358279/why-it-professionals-are-concerned-about-the-rise-of">rising automation</a>.</p><p>Three-quarters (76%) of respondents said they still used <a href="https://www.itpro.com/business-operations/productivity/363979/google-sheets-vs-microsoft-excel">spreadsheets</a> to clean and prepare data for analysis, with just over half (56%) stating they used dedicated data preparation tools.</p><p>The largest proportion of analysts (42%) said they typically spend between one-to-five hours per week preparing and <a href="https://www.itpro.com/business-intelligence-bi/29773/how-to-measure-data-quality">cleaning data</a>, whereas with 40% this takes roughly up to 10 hours a week.</p><p>One-in-twenty analysts revealed they spend more than 10 hours every week on data preparation and cleaning, however.</p><p>When combined with <a href="https://www.itpro.com/network-internet/32363/what-web-30-means-for-data-collection-and-security">data collection</a>, the global average time spent on preparation was 10.57 hours, this was the second most time-consuming activity in the analysts’ day just behind the actual analysis of the data, which came in at 11.23 hours.</p><p>Half of the respondents said the complexity of data was the greatest challenge bogging them down, whereas data quality, security, and privacy were also cited as hurdles they frequently face when preparing it for analysis.</p><h2 id="ai-and-automation-will-drastically-change-the-data-analyst-role">AI and automation will drastically change the data analyst role</h2><p>AI tools have seen widespread uptake in the analyst profession, with 97% of respondents stating that they have integrated <a href="https://www.itpro.com/technology/artificial-intelligence/ai-tools-critical-thinking-reliance">AI tools</a> into some aspects of their workflow.</p><p>Tools for <a href="https://www.itpro.com/software/business-plan/368302/kpmg-adds-automated-analytics-with-alteryx-partnership">analytics automation</a> are not far behind, with 87% of analysts adding they have also integrated these solutions into their daily activities.</p><p>More than half (59%) said <a href="https://www.itpro.com/strategy/28181/what-is-ai">AI</a> tools increased their efficiency and productivity while 46% said it had reduced their workload and stress, citing an improved job satisfaction as a result.</p><p>On a weekly basis, the analysts said that utilizing AI tools saved them 8.6 hours on average.</p><p>The <a href="https://www.itpro.com/software/development/ai-coding-tools-are-finally-delivering-results-for-enterprises-developers-are-saving-so-much-time-theyre-able-to-collaborate-more-focus-on-system-design-and-learn-new-languages">time saved</a> using these tools looks to be shaping the analyst in new ways, with strategy becoming more heavily emphasized as AI removes some of the more repetitive tasks from the analysts’ daily workflow.</p><p>The vast majority (94%) of analysts agreed that their role impacts <a href="https://www.itpro.com/business/business-strategy/how-data-driven-decision-making-can-inform-the-channel">strategic decision-making</a>, with 87% stating that their influence on business decisions has increased in the last year.</p><p>When asked how their role has changed in the last year, 85% of respondents agreed that their ability to respond to changes in the scope or direction of a project has improved.</p><p>Nearly four-fifths (79%) also said their ability to combine multiple sources of data compared to a year ago had improved since the previous year.</p><div  class="fancy-box"><div class="fancy_box-title">RELATED WHITEPAPER</div><div class="fancy_box_body"><figure class="van-image-figure "  ><div class='image-full-width-wrapper'><div class='image-widthsetter' ><p class="vanilla-image-block" style="padding-top:56.25%;"><img id="84892qDZefKbnxBU3cakAC" name="Six steps to a stronger security posture through automation_email.jpg" caption="" alt="A whitepaper from ServiceNow on steps to a stronger security posture through automation, with image of businessman" src="https://cdn.mos.cms.futurecdn.net/84892qDZefKbnxBU3cakAC-1920-80.jpg" mos="" link="" align="" fullscreen="" width="" height="" attribution="" endorsement="" class="pinterest-pin-exclude" /></p></div></div><figcaption itemprop="caption description" class=""><span class="credit" itemprop="copyrightHolder">(Image credit: ServiceNow)</span></figcaption></figure><p class="fancy-box__body-text"><a data-analytics-id="inline-link" href="https://www.itpro.com/security/six-steps-to-a-stronger-security-posture-through-automation"><em>Build a stronger security posture</em></a></p></div></div><p>Overall, 86% agreed that <a href="https://www.itpro.com/business-strategy/chief-information-officer-cio/368912/cio-role-has-drastically-changed-over-last-24-months-lenovo">AI had changed their role</a> at least to some degree, with half of these going further to say it has reshaped their role “to a great extent” over the last 12 months.</p><p>This has improved slightly over recent years, with just 34% of respondents saying the same about the last 3 – 5 years, and 16% adding that they didn’t think AI had changed their role and had been affected by AI at all during this period.</p><h3 class="article-body__section" id="section-more-from-itpro"><span>MORE FROM ITPRO</span></h3><ul><li><a href="https://www.itpro.com/business/data-and-insights/the-data-analytics-market-is-booming-heres-why">The data analytics market is booming – here's why</a></li><li><a href="https://www.itpro.com/business/data-and-insights/ai-projects-are-faltering-as-cdos-grapple-with-poor-data-quality">AI projects are faltering as CDOs grapple with poor data quality</a></li><li><a href="https://www.itpro.com/business-strategy/careers-training/358100/best-data-science-boot-camps">Best data science bootcamps</a></li></ul> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/data-and-insights/data-analyst-manual-tasks-ai-automation</link>
                                                                            <description>
                            <![CDATA[ Data analysts are still largely reliant on spreadsheets and manual preparation techniques, but AI and automation are shaking things up. ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">RkjHskEhsc7WPThHobLmvP</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/QvmVaKoNRaF4jaxCVPmTjE-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Wed, 19 Feb 2025 11:51:14 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:16:24 +0000</updated>
                                                                                                                                            <category><![CDATA[Business Intelligence]]></category>
                                                    <category><![CDATA[Data and Insights]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Business]]></category>
                                                                                                <author><![CDATA[ solomon.klappholz@futurenet.com (Solomon Klappholz) ]]></author>                    <dc:creator><![CDATA[ Solomon Klappholz ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/pjZQRW2qWqQNjxubC6SUQ5-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Solomon Klappholz is a former Staff Writer at ITPro and ChannelPro. He has experience writing about the technologies that facilitate industrial manufacturing which led to him developing a particular interest in IT regulation, industrial infrastructure applications, and machine learning.&lt;/p&gt;&lt;p&gt;Before he joined ITPro, Solomon graduated from the University of Warwick in 2021 with a BA (Hons) in Philosophy, Politics, and Economics which included an intercalated year studying Philosophy at the Erasmus University, Rotterdam.&lt;/p&gt;&lt;p&gt;Outside of the office, Solomon enjoys reading, visiting new art exhibitions, and playing football.&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/QvmVaKoNRaF4jaxCVPmTjE-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Female data analyst using AI tools on a desktop computer in a dark office space, with light from screen reflecting on spectacles. ]]></media:description>                                                            <media:text><![CDATA[Female data analyst using AI tools on a desktop computer in a dark office space, with light from screen reflecting on spectacles. ]]></media:text>
                                <media:title type="plain"><![CDATA[Female data analyst using AI tools on a desktop computer in a dark office space, with light from screen reflecting on spectacles. ]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/QvmVaKoNRaF4jaxCVPmTjE-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p><a href="https://www.itpro.com/business-strategy/data-insights/369275/data-science-vs-data-analytics-which-field-is-right-for-you">Data analysts</a> around the world remain dependent on spreadsheets for preparation tasks that take up a significant portion of their day, according to new research.</p><p>A <a href="https://www.alteryx.com/resources/report/2025-state-of-the-data-analyst" target="_blank">survey</a> commissioned by <a href="https://www.itpro.com/business/leadership/alteryx-names-andy-macmillan-as-new-ceo">Alteryx</a>, spoke to global data, IT, and operations analysts across five industries to determine how the role is changing in the face of new technologies and <a href="https://www.itpro.com/technology/artificial-intelligence-ai/358279/why-it-professionals-are-concerned-about-the-rise-of">rising automation</a>.</p><p>Three-quarters (76%) of respondents said they still used <a href="https://www.itpro.com/business-operations/productivity/363979/google-sheets-vs-microsoft-excel">spreadsheets</a> to clean and prepare data for analysis, with just over half (56%) stating they used dedicated data preparation tools.</p><p>The largest proportion of analysts (42%) said they typically spend between one-to-five hours per week preparing and <a href="https://www.itpro.com/business-intelligence-bi/29773/how-to-measure-data-quality">cleaning data</a>, whereas with 40% this takes roughly up to 10 hours a week.</p><p>One-in-twenty analysts revealed they spend more than 10 hours every week on data preparation and cleaning, however.</p><p>When combined with <a href="https://www.itpro.com/network-internet/32363/what-web-30-means-for-data-collection-and-security">data collection</a>, the global average time spent on preparation was 10.57 hours, this was the second most time-consuming activity in the analysts’ day just behind the actual analysis of the data, which came in at 11.23 hours.</p><p>Half of the respondents said the complexity of data was the greatest challenge bogging them down, whereas data quality, security, and privacy were also cited as hurdles they frequently face when preparing it for analysis.</p><h2 id="ai-and-automation-will-drastically-change-the-data-analyst-role">AI and automation will drastically change the data analyst role</h2><p>AI tools have seen widespread uptake in the analyst profession, with 97% of respondents stating that they have integrated <a href="https://www.itpro.com/technology/artificial-intelligence/ai-tools-critical-thinking-reliance">AI tools</a> into some aspects of their workflow.</p><p>Tools for <a href="https://www.itpro.com/software/business-plan/368302/kpmg-adds-automated-analytics-with-alteryx-partnership">analytics automation</a> are not far behind, with 87% of analysts adding they have also integrated these solutions into their daily activities.</p><p>More than half (59%) said <a href="https://www.itpro.com/strategy/28181/what-is-ai">AI</a> tools increased their efficiency and productivity while 46% said it had reduced their workload and stress, citing an improved job satisfaction as a result.</p><p>On a weekly basis, the analysts said that utilizing AI tools saved them 8.6 hours on average.</p><p>The <a href="https://www.itpro.com/software/development/ai-coding-tools-are-finally-delivering-results-for-enterprises-developers-are-saving-so-much-time-theyre-able-to-collaborate-more-focus-on-system-design-and-learn-new-languages">time saved</a> using these tools looks to be shaping the analyst in new ways, with strategy becoming more heavily emphasized as AI removes some of the more repetitive tasks from the analysts’ daily workflow.</p><p>The vast majority (94%) of analysts agreed that their role impacts <a href="https://www.itpro.com/business/business-strategy/how-data-driven-decision-making-can-inform-the-channel">strategic decision-making</a>, with 87% stating that their influence on business decisions has increased in the last year.</p><p>When asked how their role has changed in the last year, 85% of respondents agreed that their ability to respond to changes in the scope or direction of a project has improved.</p><p>Nearly four-fifths (79%) also said their ability to combine multiple sources of data compared to a year ago had improved since the previous year.</p><div  class="fancy-box"><div class="fancy_box-title">RELATED WHITEPAPER</div><div class="fancy_box_body"><figure class="van-image-figure "  ><div class='image-full-width-wrapper'><div class='image-widthsetter' ><p class="vanilla-image-block" style="padding-top:56.25%;"><img id="84892qDZefKbnxBU3cakAC" name="Six steps to a stronger security posture through automation_email.jpg" caption="" alt="A whitepaper from ServiceNow on steps to a stronger security posture through automation, with image of businessman" src="https://cdn.mos.cms.futurecdn.net/84892qDZefKbnxBU3cakAC-1920-80.jpg" mos="" link="" align="" fullscreen="" width="" height="" attribution="" endorsement="" class="pinterest-pin-exclude" /></p></div></div><figcaption itemprop="caption description" class=""><span class="credit" itemprop="copyrightHolder">(Image credit: ServiceNow)</span></figcaption></figure><p class="fancy-box__body-text"><a data-analytics-id="inline-link" href="https://www.itpro.com/security/six-steps-to-a-stronger-security-posture-through-automation"><em>Build a stronger security posture</em></a></p></div></div><p>Overall, 86% agreed that <a href="https://www.itpro.com/business-strategy/chief-information-officer-cio/368912/cio-role-has-drastically-changed-over-last-24-months-lenovo">AI had changed their role</a> at least to some degree, with half of these going further to say it has reshaped their role “to a great extent” over the last 12 months.</p><p>This has improved slightly over recent years, with just 34% of respondents saying the same about the last 3 – 5 years, and 16% adding that they didn’t think AI had changed their role and had been affected by AI at all during this period.</p><h3 class="article-body__section" id="section-more-from-itpro"><span>MORE FROM ITPRO</span></h3><ul><li><a href="https://www.itpro.com/business/data-and-insights/the-data-analytics-market-is-booming-heres-why">The data analytics market is booming – here's why</a></li><li><a href="https://www.itpro.com/business/data-and-insights/ai-projects-are-faltering-as-cdos-grapple-with-poor-data-quality">AI projects are faltering as CDOs grapple with poor data quality</a></li><li><a href="https://www.itpro.com/business-strategy/careers-training/358100/best-data-science-boot-camps">Best data science bootcamps</a></li></ul>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ A quarter of firms still don’t have a formal data strategy – and it’s hampering AI adoption ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Many firms have no formal <a href="https://www.itpro.com/business-strategy/data-insights/367519/in-unpredictable-times-a-data-strategy-is-key">data strategy</a> despite increasing <a href="https://www.itpro.com/strategy/28181/what-is-ai">AI</a> usage, according to a new study from Carruthers and Jackson.</p><p>More than a quarter (26%) lack a data strategy, the study found, while 39% reported little to no data governance throughout their business.</p><p>These same firms are still pushing on AI and ramping up their adoption efforts, though. Just 7% of businesses now go without <a href="https://www.itpro.com/strategy/28181/what-is-ai">AI</a>, falling from 26% of businesses a year ago, while 53% reported an increase in the use of <a href="https://www.itpro.com/software/development/ai-coding-tools-are-finally-delivering-results-for-enterprises-developers-are-saving-so-much-time-theyre-able-to-collaborate-more-focus-on-system-design-and-learn-new-languages">AI tools</a>.  </p><p>There’s also a lack of data literacy among staff, with 57% reporting a deficiency in this understanding among employees. </p><p>Similarly, while 44% have seen an increase in conversations around <a href="https://www.itpro.com/technology/30736/what-is-ethical-ai">ethical AI</a>, only 13% have turned these conversations into structured policies around AI ethics.</p><p>The report revealed some positives, however, with 37% claiming their business adopts multiple governance frameworks around AI. This figure is up from 31% in 2023.</p><p>“An AI Paradox has been created, as the use of AI tools in organizations has surged in the last year, yet employees lack the data literacy to use them effectively, as their fundamental understanding of data remains largely unchanged from last year,” Caroline Carruthers, CEO of Carruthers and Jackson, said. </p><p>Richard Bovey, data chief at AND Digital, said that there is a worrying knowledge gap around the risks of rushed implementation and that businesses need solid <a href="https://www.itpro.com/policy-legislation/data-governance/369834/building-a-data-governance-strategy">data governance</a> structures to cover technology development.</p><p>“That’s especially true when it comes to AI, not only facilitating greater accuracy and reliability within AI outputs but helping to mitigate potential privacy and security concerns,” Bovey said.</p><p>“Weaving data governance principles across the development and integration process, supported by data skills, will greatly increase the likelihood of success for AI systems, providing a platform for them to be a business enabler rather than a costly mistake,” he added.</p><h2 id="good-ai-needs-good-data">Good AI needs good data</h2><p>It’s becoming increasingly clear to firms that data is of central importance to AI adoption projects, with studies pointing to the importance of data quality.</p><p><a href="https://www.itpro.com/business/data-and-insights/ai-projects-are-faltering-as-cdos-grapple-with-poor-data-quality"><u>In a recent report from Ataccama</u></a>, 68% of chief data officers claimed that data quality was their top challenge, while 40% said they struggle to maintain consistent data quality. This directly hinders outcomes, the report found.  </p><p>“At the heart of every successful AI deployment is a foundation of high-quality, well-managed, and readily accessible data, so it’s concerning to see businesses ramping up AI usage without the basics in place,” Stuart Harvey, CEO of Datactics, told <em>ITPro</em>.</p><div  class="fancy-box"><div class="fancy_box-title">RELATED WHITEPAPER</div><div class="fancy_box_body"><figure class="van-image-figure "  ><div class='image-full-width-wrapper'><div class='image-widthsetter' ><p class="vanilla-image-block" style="padding-top:56.25%;"><img id="jejbonnPY7UGDvayx8yMbh" name="Supercharge trust for operations_listing.jpg" caption="" alt="Whitepaper cover of female worker wearing a cap backwards, surrounded by pallets, pulling sticky labels" src="https://cdn.mos.cms.futurecdn.net/jejbonnPY7UGDvayx8yMbh-1920-80.jpg" mos="" link="" align="" fullscreen="" width="" height="" attribution="" endorsement="" class="pinterest-pin-exclude" /></p></div></div><figcaption itemprop="caption description" class=""><span class="credit" itemprop="copyrightHolder">(Image credit: ServiceNow)</span></figcaption></figure><p class="fancy-box__body-text"><a data-analytics-id="inline-link" href="https://www.itpro.com/security/supercharge-trust-for-operations"><em>Drive  operations performance across the enterprise</em></a></p></div></div><p>“The outputs of AI models are only as good as the data they are trained on and input, so disregarding a robust data strategy is only setting up for failure,” Harvey added.</p><p>Data storage may start to cause problems, as well. <a href="https://www.itpro.com/hardware/storage/ai-is-causing-a-data-storage-crisis-for-enterprises"><u>Research from Hitachi Vantara</u></a> at the start of last year found that data storage capacity requirements were set to surge by 150% over the next few years.</p><h3 class="article-body__section" id="section-more-from-itpro"><span>MORE FROM ITPRO</span></h3><ul><li><a href="https://www.itpro.com/security/data-protection/ai-and-data-protection-what-businesses-need-to-know"><strong>AI and data protection: What businesses need to know</strong></a></li><li><a href="https://www.itpro.com/business/data-and-insights/data-governance-in-the-spotlight-as-uk-firms-ramp-up-ai-adoption"><strong>Data governance in the spotlight as UK firms ramp up AI adoptio</strong></a><a href="https://www.itpro.com/business/data-and-insights/data-governance-in-the-spotlight-as-uk-firms-ramp-up-ai-adoption"><strong>n</strong></a></li><li><a href="https://www.itpro.com/cloud/cloud-storage/cloud-storage-growth-set-to-skyrocket-as-ai-drives-data-retention-needs"><strong>Cloud storage growth set to skyrocket as AI drives data retention needs</strong></a></li></ul> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/technology/artificial-intelligence/data-strategy-ai-adoption-failures</link>
                                                                            <description>
                            <![CDATA[ More than a quarter of firms have no formal data strategy, and it's hampering enterprise AI adoption efforts. ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">S6VUrKArTjJoWwEJkB4cGK</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/g5n9KRJ5P7npvfDD27hqaL-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Mon, 10 Feb 2025 11:22:33 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 15:05:21 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Management]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                                                                <author><![CDATA[ george.fitzmaurice@futurenet.com (George Fitzmaurice) ]]></author>                    <dc:creator><![CDATA[ George Fitzmaurice ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/N4xHCjSAXKcijjt3oiQtfc-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ null ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/g5n9KRJ5P7npvfDD27hqaL-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Data analytics concept image showing data analysis graph on a digitized screen against colorful blocks in background.]]></media:description>                                                            <media:text><![CDATA[Data analytics concept image showing data analysis graph on a digitized screen against colorful blocks in background.]]></media:text>
                                <media:title type="plain"><![CDATA[Data analytics concept image showing data analysis graph on a digitized screen against colorful blocks in background.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/g5n9KRJ5P7npvfDD27hqaL-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Many firms have no formal <a href="https://www.itpro.com/business-strategy/data-insights/367519/in-unpredictable-times-a-data-strategy-is-key">data strategy</a> despite increasing <a href="https://www.itpro.com/strategy/28181/what-is-ai">AI</a> usage, according to a new study from Carruthers and Jackson.</p><p>More than a quarter (26%) lack a data strategy, the study found, while 39% reported little to no data governance throughout their business.</p><p>These same firms are still pushing on AI and ramping up their adoption efforts, though. Just 7% of businesses now go without <a href="https://www.itpro.com/strategy/28181/what-is-ai">AI</a>, falling from 26% of businesses a year ago, while 53% reported an increase in the use of <a href="https://www.itpro.com/software/development/ai-coding-tools-are-finally-delivering-results-for-enterprises-developers-are-saving-so-much-time-theyre-able-to-collaborate-more-focus-on-system-design-and-learn-new-languages">AI tools</a>.  </p><p>There’s also a lack of data literacy among staff, with 57% reporting a deficiency in this understanding among employees. </p><p>Similarly, while 44% have seen an increase in conversations around <a href="https://www.itpro.com/technology/30736/what-is-ethical-ai">ethical AI</a>, only 13% have turned these conversations into structured policies around AI ethics.</p><p>The report revealed some positives, however, with 37% claiming their business adopts multiple governance frameworks around AI. This figure is up from 31% in 2023.</p><p>“An AI Paradox has been created, as the use of AI tools in organizations has surged in the last year, yet employees lack the data literacy to use them effectively, as their fundamental understanding of data remains largely unchanged from last year,” Caroline Carruthers, CEO of Carruthers and Jackson, said. </p><p>Richard Bovey, data chief at AND Digital, said that there is a worrying knowledge gap around the risks of rushed implementation and that businesses need solid <a href="https://www.itpro.com/policy-legislation/data-governance/369834/building-a-data-governance-strategy">data governance</a> structures to cover technology development.</p><p>“That’s especially true when it comes to AI, not only facilitating greater accuracy and reliability within AI outputs but helping to mitigate potential privacy and security concerns,” Bovey said.</p><p>“Weaving data governance principles across the development and integration process, supported by data skills, will greatly increase the likelihood of success for AI systems, providing a platform for them to be a business enabler rather than a costly mistake,” he added.</p><h2 id="good-ai-needs-good-data">Good AI needs good data</h2><p>It’s becoming increasingly clear to firms that data is of central importance to AI adoption projects, with studies pointing to the importance of data quality.</p><p><a href="https://www.itpro.com/business/data-and-insights/ai-projects-are-faltering-as-cdos-grapple-with-poor-data-quality"><u>In a recent report from Ataccama</u></a>, 68% of chief data officers claimed that data quality was their top challenge, while 40% said they struggle to maintain consistent data quality. This directly hinders outcomes, the report found.  </p><p>“At the heart of every successful AI deployment is a foundation of high-quality, well-managed, and readily accessible data, so it’s concerning to see businesses ramping up AI usage without the basics in place,” Stuart Harvey, CEO of Datactics, told <em>ITPro</em>.</p><div  class="fancy-box"><div class="fancy_box-title">RELATED WHITEPAPER</div><div class="fancy_box_body"><figure class="van-image-figure "  ><div class='image-full-width-wrapper'><div class='image-widthsetter' ><p class="vanilla-image-block" style="padding-top:56.25%;"><img id="jejbonnPY7UGDvayx8yMbh" name="Supercharge trust for operations_listing.jpg" caption="" alt="Whitepaper cover of female worker wearing a cap backwards, surrounded by pallets, pulling sticky labels" src="https://cdn.mos.cms.futurecdn.net/jejbonnPY7UGDvayx8yMbh-1920-80.jpg" mos="" link="" align="" fullscreen="" width="" height="" attribution="" endorsement="" class="pinterest-pin-exclude" /></p></div></div><figcaption itemprop="caption description" class=""><span class="credit" itemprop="copyrightHolder">(Image credit: ServiceNow)</span></figcaption></figure><p class="fancy-box__body-text"><a data-analytics-id="inline-link" href="https://www.itpro.com/security/supercharge-trust-for-operations"><em>Drive  operations performance across the enterprise</em></a></p></div></div><p>“The outputs of AI models are only as good as the data they are trained on and input, so disregarding a robust data strategy is only setting up for failure,” Harvey added.</p><p>Data storage may start to cause problems, as well. <a href="https://www.itpro.com/hardware/storage/ai-is-causing-a-data-storage-crisis-for-enterprises"><u>Research from Hitachi Vantara</u></a> at the start of last year found that data storage capacity requirements were set to surge by 150% over the next few years.</p><h3 class="article-body__section" id="section-more-from-itpro"><span>MORE FROM ITPRO</span></h3><ul><li><a href="https://www.itpro.com/security/data-protection/ai-and-data-protection-what-businesses-need-to-know"><strong>AI and data protection: What businesses need to know</strong></a></li><li><a href="https://www.itpro.com/business/data-and-insights/data-governance-in-the-spotlight-as-uk-firms-ramp-up-ai-adoption"><strong>Data governance in the spotlight as UK firms ramp up AI adoptio</strong></a><a href="https://www.itpro.com/business/data-and-insights/data-governance-in-the-spotlight-as-uk-firms-ramp-up-ai-adoption"><strong>n</strong></a></li><li><a href="https://www.itpro.com/cloud/cloud-storage/cloud-storage-growth-set-to-skyrocket-as-ai-drives-data-retention-needs"><strong>Cloud storage growth set to skyrocket as AI drives data retention needs</strong></a></li></ul>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ AI projects are faltering as CDOs grapple with poor data quality ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Only a third of businesses are making meaningful progress in <a href="https://www.itpro.com/strategy/28181/what-is-ai">AI</a> adoption, and <a href="https://www.itpro.com/strategy/28226/cdo-job-description-what-does-a-cdo-do">chief data officers (CDOs)</a> are pinning the blame on poor data quality. </p><p>More than two-thirds (68%) of <a href="https://www.itpro.com/business-strategy/chief-data-officer-cdo/370082/role-of-the-chief-data-officer-cdo-evolve">CDOs</a> said data quality was their top challenge, according to the Ataccama <a href="https://www.ataccama.com/ebook/data-trust-report" target="_blank"><em>Data Trust Report 2025</em></a>. Meanwhile, four-in-ten struggle to maintain consistent data quality, directly hindering AI outcomes. </p><p>The report noted that trust is a critical factor when leveraging data in daily operations. Without it, organizations face inefficiencies, poor decision-making, and the risk of compliance failures, ultimately limiting their ability to achieve business objectives.</p><p>However, the report found most organizations still struggle with <a href="https://www.itpro.com/business/digital-transformation/disparate-data-silos-are-still-blocking-the-path-to-digital-transformation-success">siloed systems</a>.</p><p>"Untrusted data erodes every decision it informs. Without real insights into data quality, businesses risk cascading failures, from unreliable AI outputs to stalled growth," said Krishna Cheriath, chief digital Officer at Thermo Fisher Scientific. </p><p>"Trust must permeate every layer — data, models, and decisions."</p><p>Bad data leads to bad insights, the report noted, affecting decision-making, slowing down operations, and wasting valuable resources. Similarly, it jeopardizes compliance, leaving organizations vulnerable to regulatory and financial risks, and diminishes ROI.</p><h2 id="knowledge-gaps-are-hampering-digital-progress">Knowledge gaps are hampering digital progress</h2><p>Knowledge gaps around data trust and governance are slowing progress, the report found, with a lack of unified standards leading to inconsistency. Without guidelines for data formats, definition, and validation, CDOs find it hard to establish a centralized system of control. </p><p>A third of organizations experience processing delays because there are too many barriers that stand in the way of integration.</p><p>"Fragmented systems bleed efficiency and inflate costs," said Andrew Foster, chief data officer at M&amp;T Bank.</p><p>The report also found <a href="https://www.itpro.com/security/the-risks-of-legacy-technology-for-your-business">legacy systems</a> are still a major barrier to innovation, with CDOs finding that outdated systems are ill-equipped to handle increasing data volumes. </p><div  class="fancy-box"><div class="fancy_box-title">RELATED WHITEPAPER</div><div class="fancy_box_body"><figure class="van-image-figure "  ><div class='image-full-width-wrapper'><div class='image-widthsetter' ><p class="vanilla-image-block" style="padding-top:56.25%;"><img id="LwJQUwZFb66w8TQNw3yMh7" name="2024 Cloud Security Report" caption="" alt="2024 Cloud Security Report" src="https://cdn.mos.cms.futurecdn.net/LwJQUwZFb66w8TQNw3yMh7-1920-80.jpg" mos="" link="" align="" fullscreen="" width="" height="" attribution="" endorsement="" class="pinterest-pin-exclude" /></p></div></div><figcaption itemprop="caption description" class=""><span class="credit" itemprop="copyrightHolder">(Image credit: Fortinet)</span></figcaption></figure><p class="fancy-box__body-text"><a data-analytics-id="inline-link" href="https://www.itpro.com/cloud/cloud-security/2024-cloud-security-report"><em>Insights on the trends driving cloud security</em></a></p></div></div><p>Many systems are designed to provide period data updates, for example, rather than continuous, real-time streams. It’s this area in particular that’s causing serious trouble for CDOs ramping up AI adoption, with only a third of enterprises reporting meaningful progress on this front. </p><p>The report called for new national standards for data quality in the UK, and suggested that the proposed National Data Library - a core goal within the <a href="https://www.itpro.com/technology/artificial-intelligence/public-sector-improvements-infrastructure-investment-and-ai-pothole-repairs-tech-industry-welcomes-uks-ambitious-ai-action-plan">UK’s AI Action Plan</a> - could play a key role in bolstering national data governance benchmarks and best practices. </p><p>These standards would ensure clear compliance guidelines while supporting the UK’s pro-innovation regulatory goals.</p><p>"The report makes one thing clear: <a href="https://www.itpro.com/technology/artificial-intelligence/what-hpes-results-say-about-the-direction-of-enterprise-ai">enterprise AI</a> initiatives rely on a foundation of trusted data," said Jay Limburn, chief product officer at Ataccama. </p><p>"Without addressing systemic data quality challenges, organisations risk stalling progress. The UK’s approach to <a href="https://www.itpro.com/business/policy-and-legislation/how-the-eu-ai-act-compares-to-other-international-regulatory-approaches">AI regulation</a> shows how aligning data trust principles with national standards and infrastructure modernization can deliver tangible results."</p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/data-and-insights/ai-projects-are-faltering-as-cdos-grapple-with-poor-data-quality</link>
                                                                            <description>
                            <![CDATA[ Chief data officers say they can't maintain consistent data quality, and that it's affecting AI outcomes ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">yKCJY2iHbV9hpFikNsBU43</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/aBKCDtKRs8pAMuFuiPBoxF-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Tue, 21 Jan 2025 11:03:47 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:16:40 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Management]]></category>
                                                    <category><![CDATA[Data and Insights]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Business]]></category>
                                                                                                                    <dc:creator><![CDATA[ Emma Woollacott ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/aWfskavxoVSMDy6cDWtYmJ-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ null ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/aBKCDtKRs8pAMuFuiPBoxF-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Female chief data officer (CDO) examines statistics on a tablet device while male counterparts observe figures on a wall-mounted screen.]]></media:description>                                                            <media:text><![CDATA[Female chief data officer (CDO) examines statistics on a tablet device while male counterparts observe figures on a wall-mounted screen.]]></media:text>
                                <media:title type="plain"><![CDATA[Female chief data officer (CDO) examines statistics on a tablet device while male counterparts observe figures on a wall-mounted screen.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/aBKCDtKRs8pAMuFuiPBoxF-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Only a third of businesses are making meaningful progress in <a href="https://www.itpro.com/strategy/28181/what-is-ai">AI</a> adoption, and <a href="https://www.itpro.com/strategy/28226/cdo-job-description-what-does-a-cdo-do">chief data officers (CDOs)</a> are pinning the blame on poor data quality. </p><p>More than two-thirds (68%) of <a href="https://www.itpro.com/business-strategy/chief-data-officer-cdo/370082/role-of-the-chief-data-officer-cdo-evolve">CDOs</a> said data quality was their top challenge, according to the Ataccama <a href="https://www.ataccama.com/ebook/data-trust-report" target="_blank"><em>Data Trust Report 2025</em></a>. Meanwhile, four-in-ten struggle to maintain consistent data quality, directly hindering AI outcomes. </p><p>The report noted that trust is a critical factor when leveraging data in daily operations. Without it, organizations face inefficiencies, poor decision-making, and the risk of compliance failures, ultimately limiting their ability to achieve business objectives.</p><p>However, the report found most organizations still struggle with <a href="https://www.itpro.com/business/digital-transformation/disparate-data-silos-are-still-blocking-the-path-to-digital-transformation-success">siloed systems</a>.</p><p>"Untrusted data erodes every decision it informs. Without real insights into data quality, businesses risk cascading failures, from unreliable AI outputs to stalled growth," said Krishna Cheriath, chief digital Officer at Thermo Fisher Scientific. </p><p>"Trust must permeate every layer — data, models, and decisions."</p><p>Bad data leads to bad insights, the report noted, affecting decision-making, slowing down operations, and wasting valuable resources. Similarly, it jeopardizes compliance, leaving organizations vulnerable to regulatory and financial risks, and diminishes ROI.</p><h2 id="knowledge-gaps-are-hampering-digital-progress">Knowledge gaps are hampering digital progress</h2><p>Knowledge gaps around data trust and governance are slowing progress, the report found, with a lack of unified standards leading to inconsistency. Without guidelines for data formats, definition, and validation, CDOs find it hard to establish a centralized system of control. </p><p>A third of organizations experience processing delays because there are too many barriers that stand in the way of integration.</p><p>"Fragmented systems bleed efficiency and inflate costs," said Andrew Foster, chief data officer at M&amp;T Bank.</p><p>The report also found <a href="https://www.itpro.com/security/the-risks-of-legacy-technology-for-your-business">legacy systems</a> are still a major barrier to innovation, with CDOs finding that outdated systems are ill-equipped to handle increasing data volumes. </p><div  class="fancy-box"><div class="fancy_box-title">RELATED WHITEPAPER</div><div class="fancy_box_body"><figure class="van-image-figure "  ><div class='image-full-width-wrapper'><div class='image-widthsetter' ><p class="vanilla-image-block" style="padding-top:56.25%;"><img id="LwJQUwZFb66w8TQNw3yMh7" name="2024 Cloud Security Report" caption="" alt="2024 Cloud Security Report" src="https://cdn.mos.cms.futurecdn.net/LwJQUwZFb66w8TQNw3yMh7-1920-80.jpg" mos="" link="" align="" fullscreen="" width="" height="" attribution="" endorsement="" class="pinterest-pin-exclude" /></p></div></div><figcaption itemprop="caption description" class=""><span class="credit" itemprop="copyrightHolder">(Image credit: Fortinet)</span></figcaption></figure><p class="fancy-box__body-text"><a data-analytics-id="inline-link" href="https://www.itpro.com/cloud/cloud-security/2024-cloud-security-report"><em>Insights on the trends driving cloud security</em></a></p></div></div><p>Many systems are designed to provide period data updates, for example, rather than continuous, real-time streams. It’s this area in particular that’s causing serious trouble for CDOs ramping up AI adoption, with only a third of enterprises reporting meaningful progress on this front. </p><p>The report called for new national standards for data quality in the UK, and suggested that the proposed National Data Library - a core goal within the <a href="https://www.itpro.com/technology/artificial-intelligence/public-sector-improvements-infrastructure-investment-and-ai-pothole-repairs-tech-industry-welcomes-uks-ambitious-ai-action-plan">UK’s AI Action Plan</a> - could play a key role in bolstering national data governance benchmarks and best practices. </p><p>These standards would ensure clear compliance guidelines while supporting the UK’s pro-innovation regulatory goals.</p><p>"The report makes one thing clear: <a href="https://www.itpro.com/technology/artificial-intelligence/what-hpes-results-say-about-the-direction-of-enterprise-ai">enterprise AI</a> initiatives rely on a foundation of trusted data," said Jay Limburn, chief product officer at Ataccama. </p><p>"Without addressing systemic data quality challenges, organisations risk stalling progress. The UK’s approach to <a href="https://www.itpro.com/business/policy-and-legislation/how-the-eu-ai-act-compares-to-other-international-regulatory-approaches">AI regulation</a> shows how aligning data trust principles with national standards and infrastructure modernization can deliver tangible results."</p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ Etam harnesses the power of data by teaming up with Snowflake for AI and cloud-driven transformation ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Many believe start-ups today have it relatively easy because they have a blank canvas, ripe for utilizing the latest innovations in AI and cloud. If that is so, the converse should be true for much older, more established businesses. </p><p>Despite the challenges of transitioning from legacy operations to more modern infrastructure and processes, many firms realize the end rewards are worth the effort. </p><p>French lingerie brand Etam, founded in 1916, is one such company, with innovation and the desire to continually improve part of its DNA. </p><p>Indeed, back in 1965, it was credited with inventing the concept of automatic re-stocking. Fast-forward just five years and in 1970 another first for the company as it started using hangers to display bras. </p><p>Many other industry-leading developments have come since, including the launch of its online store in 2001. Demonstrating expertise and innovation remains important today and is one of the <a href="https://etam-groupe.com/en/wecare-etam-group/"><u>nine pillars Etam retains at its core</u></a>. </p><p>Today, Etam Group comprises five brands (123, Etam, Maison, Livy, Undiz, and Ysé. In addition to its ecommerce operations, the company has more than 1,500 physical stores in 57 countries. </p><p>This still-family-owned and independently operated business is keen not just to survive, but also thrive. Loyalty will be key, making CRM and data-driven efforts critical to Etam’s business strategy today and tomorrow. </p><p>To this end, Etam embarked on a data transformation strategy back in 2023, according to Sophie Gallay, the company’s global data and client IT director. </p><p>“Even though Etam was really advanced in terms of digital transformation, it was a bit late compared to the market [when it comes to]  data. So when I took this position, I saw something that was really great: All the businesses had lots of use cases,” she tells <em>CloudPro. </em></p><p>“So I had a business that was still expecting lots in terms of BI, data science, and AI use cases, but I had data foundations that were not ready to support these use cases.” </p><h2 id="selecting-the-right-partner">Selecting the right partner</h2><p>Having a vision is one thing, but being able to make it a reality can often be where the hard work really starts. However, by working with the right partner, many organizations can overcome such hurdles. By coupling the trusted partnership with the right tools and technologies, these companies, like Etam, can bring their IT estates into the present, ensuring operations remain fit for purpose and that the business is technologically set up for success both now and in the future. </p><p>Etam selected AI and cloud firm Snowflake as its partner of choice, working alongside a local French consultancy, which was the first to deploy the Snowflake platform in France. </p><p>“Snowflake is very much a part of the strategy of the data office,” Gallay says. </p><p>“The big project is creating the data platform with Snowflake. We had to go fast because creating a data platform in one year is a [big job]. So when we chose the best partner to help us with that challenge, we chose Snowflake. [We did so] for various reasons, but one of the reasons was because if we needed to develop a platform that is strong and robust quickly, [we believed that Snowflake] would be the best partner to help do that.” </p><p>The transformation work Etam has embarked on will span years but has been broken down into more digestible projects. The first lasted 18 months and was set to run from June 2023 until December 2024.</p><p>During this initial phase, the focus was 70% on the data foundation and 30% on value. Looking ahead, things will shift gears considerably. </p><h2 id="future-focus">Future focus</h2><p>“In 2025, we will just switch the balance,” Gallay says. </p><p>“We decided that Snowflake will be the data platform for all the data domains. So we will have one data platform.. We could have had what has happened in other companies where you start your data platformization for certain data domains, and then you choose another partner for other domains. And it [then] becomes something really complicated to manage. We will have only one data platform, and it&apos;s great.”</p><p>The first phase focused on creating a solid data foundation that will, according to Gallay, help Etam scale and then “accelerate on data value afterward.”</p><p>“I have one particular use case in mind that is super important, which is sales, forecasts, and inventory. [Specifically] the improvement of inventory management, which is super key to retailers right now, especially with the difficult economic conditions,” Gallay adds.</p><p>“So that&apos;s really my objective: proving that we can create value. That may be just a little value, but it is starting that value creation process.” </p><p>Snowflake made <a href="https://www.itpro.com/news/live/snowflake-data-cloud-summit-2024-all-the-news-and-updates-live"><u>several key announcements at its Summit in San Francisco</u></a> in June 2024 and many customers were buoyed by the idea of adding AI to what they can already do. Etam is no exception, according to Gallay. </p><p>“When I heard all the announcements, I realized that now I can do pretty much everything in the platform. It was not the case [before] as I still had to exchange with other partners for data governance and other things," she says.</p><p>“[Now] I guess I can do pretty much 90% of my data work directly within the platform. It&apos;s going to greatly simplify my work and the way we organize and the way we monitor everything.”</p><p>Outside of Etam’s ambition to drive increased value with and from data, Gallay has an added human-focused ambition with the transformation project. This, in essence, is to ensure team members continue to enjoy what they do and feel fulfilled in their work. </p><p>“I feel that it&apos;s one of my objectives as a manager to make sure that my team wants to keep working for Etam,” she adds. </p><p>“Technology is a very competitive environment, so they&apos;re being approached by lots and lots of other companies. So, for me, it&apos;s also - in terms of management - a great thing, because I know I&apos;m going to feed them with interesting things to do in the next two to three years, at minimum.”</p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/etam-harnesses-the-power-of-data-by-teaming-up-with-snowflake-for-ai-and-cloud-driven-transformation</link>
                                                                            <description>
                            <![CDATA[ The 100-plus-year-old French lingerie brand aims to breathe new life into its business - and employee satisfaction - by using Snowflake as its data foundation… ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">MY84fLA7BZFBGpSFws6gkS</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/EjX6HiJfVE3y32nFU7DwnR-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Wed, 01 Jan 2025 23:47:23 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:17:04 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Platforms]]></category>
                                                    <category><![CDATA[Business]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                                                                <author><![CDATA[ Maggie.holland@futurenet.com (Maggie Holland) ]]></author>                    <dc:creator><![CDATA[ Maggie Holland ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/yR3aBSQeNTZZ8SzoXbFEQ3-320-70.png ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Maggie has been a journalist since 1999. She started her career as an editorial assistant on then-weekly magazine Computing, before working her way up to senior reporter level. After several years on the magazine, she moved to &#039;the other side of the fence&#039; to work as a copywriter for a marketing agency, writing case studies and working on ad and website copy for companies such as eBay, Dell, Microsoft and more. In 2006, just weeks before&amp;nbsp;ITPro&amp;nbsp;was launched, Maggie joined Dennis Publishing as a reporter. Having worked her way up to editor of ITPro, she was appointed group editor of&amp;nbsp;CloudPro&amp;nbsp;and&amp;nbsp;ITPro&amp;nbsp;in April 2012. She became the editorial director and took responsibility for&amp;nbsp;ChannelPro,&amp;nbsp;in 2016.&lt;/p&gt;
&lt;p&gt;Her areas of particular interest, aside from cloud, include management and C-level issues, the business value of technology, green and environmental issues and careers to name but a few.&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/EjX6HiJfVE3y32nFU7DwnR-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Snowflake logo pictured on their pavilion at the Mobile World Congress 2024 in Barcelona, Spain, on February 28, 2024]]></media:description>                                                            <media:text><![CDATA[Snowflake logo pictured on their pavilion at the Mobile World Congress 2024 in Barcelona, Spain, on February 28, 2024]]></media:text>
                                <media:title type="plain"><![CDATA[Snowflake logo pictured on their pavilion at the Mobile World Congress 2024 in Barcelona, Spain, on February 28, 2024]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/EjX6HiJfVE3y32nFU7DwnR-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Many believe start-ups today have it relatively easy because they have a blank canvas, ripe for utilizing the latest innovations in AI and cloud. If that is so, the converse should be true for much older, more established businesses. </p><p>Despite the challenges of transitioning from legacy operations to more modern infrastructure and processes, many firms realize the end rewards are worth the effort. </p><p>French lingerie brand Etam, founded in 1916, is one such company, with innovation and the desire to continually improve part of its DNA. </p><p>Indeed, back in 1965, it was credited with inventing the concept of automatic re-stocking. Fast-forward just five years and in 1970 another first for the company as it started using hangers to display bras. </p><p>Many other industry-leading developments have come since, including the launch of its online store in 2001. Demonstrating expertise and innovation remains important today and is one of the <a href="https://etam-groupe.com/en/wecare-etam-group/"><u>nine pillars Etam retains at its core</u></a>. </p><p>Today, Etam Group comprises five brands (123, Etam, Maison, Livy, Undiz, and Ysé. In addition to its ecommerce operations, the company has more than 1,500 physical stores in 57 countries. </p><p>This still-family-owned and independently operated business is keen not just to survive, but also thrive. Loyalty will be key, making CRM and data-driven efforts critical to Etam’s business strategy today and tomorrow. </p><p>To this end, Etam embarked on a data transformation strategy back in 2023, according to Sophie Gallay, the company’s global data and client IT director. </p><p>“Even though Etam was really advanced in terms of digital transformation, it was a bit late compared to the market [when it comes to]  data. So when I took this position, I saw something that was really great: All the businesses had lots of use cases,” she tells <em>CloudPro. </em></p><p>“So I had a business that was still expecting lots in terms of BI, data science, and AI use cases, but I had data foundations that were not ready to support these use cases.” </p><h2 id="selecting-the-right-partner">Selecting the right partner</h2><p>Having a vision is one thing, but being able to make it a reality can often be where the hard work really starts. However, by working with the right partner, many organizations can overcome such hurdles. By coupling the trusted partnership with the right tools and technologies, these companies, like Etam, can bring their IT estates into the present, ensuring operations remain fit for purpose and that the business is technologically set up for success both now and in the future. </p><p>Etam selected AI and cloud firm Snowflake as its partner of choice, working alongside a local French consultancy, which was the first to deploy the Snowflake platform in France. </p><p>“Snowflake is very much a part of the strategy of the data office,” Gallay says. </p><p>“The big project is creating the data platform with Snowflake. We had to go fast because creating a data platform in one year is a [big job]. So when we chose the best partner to help us with that challenge, we chose Snowflake. [We did so] for various reasons, but one of the reasons was because if we needed to develop a platform that is strong and robust quickly, [we believed that Snowflake] would be the best partner to help do that.” </p><p>The transformation work Etam has embarked on will span years but has been broken down into more digestible projects. The first lasted 18 months and was set to run from June 2023 until December 2024.</p><p>During this initial phase, the focus was 70% on the data foundation and 30% on value. Looking ahead, things will shift gears considerably. </p><h2 id="future-focus">Future focus</h2><p>“In 2025, we will just switch the balance,” Gallay says. </p><p>“We decided that Snowflake will be the data platform for all the data domains. So we will have one data platform.. We could have had what has happened in other companies where you start your data platformization for certain data domains, and then you choose another partner for other domains. And it [then] becomes something really complicated to manage. We will have only one data platform, and it&apos;s great.”</p><p>The first phase focused on creating a solid data foundation that will, according to Gallay, help Etam scale and then “accelerate on data value afterward.”</p><p>“I have one particular use case in mind that is super important, which is sales, forecasts, and inventory. [Specifically] the improvement of inventory management, which is super key to retailers right now, especially with the difficult economic conditions,” Gallay adds.</p><p>“So that&apos;s really my objective: proving that we can create value. That may be just a little value, but it is starting that value creation process.” </p><p>Snowflake made <a href="https://www.itpro.com/news/live/snowflake-data-cloud-summit-2024-all-the-news-and-updates-live"><u>several key announcements at its Summit in San Francisco</u></a> in June 2024 and many customers were buoyed by the idea of adding AI to what they can already do. Etam is no exception, according to Gallay. </p><p>“When I heard all the announcements, I realized that now I can do pretty much everything in the platform. It was not the case [before] as I still had to exchange with other partners for data governance and other things," she says.</p><p>“[Now] I guess I can do pretty much 90% of my data work directly within the platform. It&apos;s going to greatly simplify my work and the way we organize and the way we monitor everything.”</p><p>Outside of Etam’s ambition to drive increased value with and from data, Gallay has an added human-focused ambition with the transformation project. This, in essence, is to ensure team members continue to enjoy what they do and feel fulfilled in their work. </p><p>“I feel that it&apos;s one of my objectives as a manager to make sure that my team wants to keep working for Etam,” she adds. </p><p>“Technology is a very competitive environment, so they&apos;re being approached by lots and lots of other companies. So, for me, it&apos;s also - in terms of management - a great thing, because I know I&apos;m going to feed them with interesting things to do in the next two to three years, at minimum.”</p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ The data analytics market is booming – here's why ]]></title>
                                                                                                <dc:content><![CDATA[ <p>The global <a href="https://www.itpro.com/business-intelligence/28220/what-is-data-analytics">data analytics</a> market is growing fast, driven by advancements in IoT, <a href="https://www.itpro.com/627952/what-is-cloud-computing">cloud computing</a>, and <a href="https://www.itpro.com/strategy/28181/what-is-ai">AI</a>, according to new research from GlobalData.</p><p>With data volumes projected to exceed 175 zettabytes by 2025, the total data analytics market is set to grow  at a compound annual growth rate (CAGR) of 11.1% between 2023 and 2028, hitting $190 billion in 2028.</p><p>While the data analytics space is a relatively mature market, it has seen significant innovation in recent years across the four layers of its value chain - hardware, data management, applications, and delivery.</p><p>Prescriptive analytics is the most advanced innovation, according to GlobalData, telling organizations what to do next rather than just describing what has happened and why. </p><p>Machine learning techniques can now provide data-driven recommendations by parsing large amounts of data and assessing 'what if' scenarios. </p><p>The traditional data analytics vendors such as SAS, IBM, Oracle, and SAP are being disrupted by AI-native vendors, such as Cognitive Scale and H2O.ai, which aim to help companies automate operational decision-making using ML. </p><p>Similarly, the emergence of generative <a href="https://www.itpro.com/technology/artificial-intelligence/amazing-ai-tools-to-try-today">AI tools</a> has led data analytics vendors to embed solutions in their platforms. Microsoft's launch of <a href="https://www.itpro.com/technology/artificial-intelligence/microsoft-copilot-review-ai-baked-into-your-apps">Copilot</a>, for example, embedding <a href="https://www.itpro.com/technology/artificial-intelligence-ai/369965/what-is-chatgpt-and-what-does-it-mean-for-businesses">ChatGPT</a> into analytics products such as <a href="https://www.itpro.com/security/data-protection/using-excel-for-data-analysis-vs-management">Excel</a> and PowerBI, represents a step change for enterprise capabilities. </p><p>"The traditional data analytics vendors are being disrupted by AI-native vendors that aim to help companies automate operational decision-making using <a href="https://www.itpro.com/strategy/28071/what-is-machine-learning">machine learning</a>," said Isabel Al-Dhahir, GlobalData principal analyst, strategic intelligence.</p><p>"Furthermore, the emergence of generative AI tools has led data analytics vendors to embed those solutions in their platforms, democratizing access to data science capabilities. For instance, Microsoft has launched Copilot, embedding ChatGPT into analytics products such as Excel and PowerBI."</p><h2 id="governance-security-and-skills-are-key-concerns">Governance, security, and skills are key concerns</h2><p>The <a href="https://www.globaldata.com/store/report/data-analytics-theme-analysis/?utm_source=cision&amp;utm_medium=press%20release&amp;utm_campaign=gd_press%20release_cision_strategic%20alliance_data%20analytics_report"><u>report</u></a> warned that the rapid growth of data volumes and the expectation of advanced analytics brings great pressure in terms of management, governance, and security.</p><p>"The ability of GenAI to create highly sophisticated models and simulations from vast datasets raises significant concerns about the potential misuse of personal information," said Al-Dhahir.</p><p>"The risk of exposing sensitive data increases as these AI systems become more adept at generating detailed, realistic outputs. This calls for stringent data governance frameworks."</p><p>Managing <a href="https://www.itpro.com/business-strategy/data-insights/369275/data-science-vs-data-analytics-which-field-is-right-for-you">data analytics</a> pipelines means a need for more skilled workers, including <a href="https://www.itpro.com/business-strategy/careers-training/357656/how-to-become-a-data-scientist">data scientists</a>, data engineers, and other data specialists. Meanwhile, data analysis requires skills in <a href="https://www.itpro.com/development/programming/361267/11-best-python-courses">visualization</a>, reporting, and communication. </p><div  class="fancy-box"><div class="fancy_box-title">RELATED WHITEPAPER</div><div class="fancy_box_body"><figure class="van-image-figure "  ><div class='image-full-width-wrapper'><div class='image-widthsetter' ><p class="vanilla-image-block" style="padding-top:56.25%;"><img id="trn4ackLzZb7hLT9wy24wL" name="Help skilled workers succeed with Dell Latitude 7030 and 7230 Rugged Extreme tablets" caption="" alt="Help skilled workers succeed with Dell Latitude 7030 and 7230 Rugged Extreme tablets" src="https://cdn.mos.cms.futurecdn.net/trn4ackLzZb7hLT9wy24wL-1920-80.jpg" mos="" link="" align="" fullscreen="" width="" height="" attribution="" endorsement="" class="pinterest-pin-exclude" /></p></div></div><figcaption itemprop="caption description" class=""><span class="credit" itemprop="copyrightHolder">(Image credit: Dell)</span></figcaption></figure><p class="fancy-box__body-text"><a data-analytics-id="inline-link" href="https://www.itpro.com/hardware/help-skilled-workers-succeed-with-dell-latitude-7030-and-7230-rugged-extreme-tablets"><em>Rugged devices designed for challenging environments</em></a></p></div></div><p>"Organizations must attract, train, retain, and upskill their current workforce to fill these roles. Companies may also attempt to plug the data-skills gap by encouraging less technical employees to act as citizen data scientists," said Al-Dhahir.</p><p>"Businesses must build up their in-house capabilities, but in some cases, strategic acquisitions or partnerships with small data analytics service companies may be preferable," Al-Dhahir added. </p><p>"As the market evolves, innovation across data management, AI integration, and governance will shape the future of data-driven strategies."</p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/data-and-insights/the-data-analytics-market-is-booming-heres-why</link>
                                                                            <description>
                            <![CDATA[ Prescriptive analytics and a rise in AI-native vendors look set to fuel major growth over the next five years ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">5nice4SCkAxYUWkPNt4dJm</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/g5n9KRJ5P7npvfDD27hqaL-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Thu, 19 Dec 2024 09:56:16 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:15:48 +0000</updated>
                                                                                                                                            <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Data and Insights]]></category>
                                                    <category><![CDATA[Business]]></category>
                                                                                                                    <dc:creator><![CDATA[ Emma Woollacott ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/aWfskavxoVSMDy6cDWtYmJ-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ null ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/g5n9KRJ5P7npvfDD27hqaL-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Data analytics concept image showing data analysis graph on a digitized screen against colorful blocks in background.]]></media:description>                                                            <media:text><![CDATA[Data analytics concept image showing data analysis graph on a digitized screen against colorful blocks in background.]]></media:text>
                                <media:title type="plain"><![CDATA[Data analytics concept image showing data analysis graph on a digitized screen against colorful blocks in background.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/g5n9KRJ5P7npvfDD27hqaL-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>The global <a href="https://www.itpro.com/business-intelligence/28220/what-is-data-analytics">data analytics</a> market is growing fast, driven by advancements in IoT, <a href="https://www.itpro.com/627952/what-is-cloud-computing">cloud computing</a>, and <a href="https://www.itpro.com/strategy/28181/what-is-ai">AI</a>, according to new research from GlobalData.</p><p>With data volumes projected to exceed 175 zettabytes by 2025, the total data analytics market is set to grow  at a compound annual growth rate (CAGR) of 11.1% between 2023 and 2028, hitting $190 billion in 2028.</p><p>While the data analytics space is a relatively mature market, it has seen significant innovation in recent years across the four layers of its value chain - hardware, data management, applications, and delivery.</p><p>Prescriptive analytics is the most advanced innovation, according to GlobalData, telling organizations what to do next rather than just describing what has happened and why. </p><p>Machine learning techniques can now provide data-driven recommendations by parsing large amounts of data and assessing 'what if' scenarios. </p><p>The traditional data analytics vendors such as SAS, IBM, Oracle, and SAP are being disrupted by AI-native vendors, such as Cognitive Scale and H2O.ai, which aim to help companies automate operational decision-making using ML. </p><p>Similarly, the emergence of generative <a href="https://www.itpro.com/technology/artificial-intelligence/amazing-ai-tools-to-try-today">AI tools</a> has led data analytics vendors to embed solutions in their platforms. Microsoft's launch of <a href="https://www.itpro.com/technology/artificial-intelligence/microsoft-copilot-review-ai-baked-into-your-apps">Copilot</a>, for example, embedding <a href="https://www.itpro.com/technology/artificial-intelligence-ai/369965/what-is-chatgpt-and-what-does-it-mean-for-businesses">ChatGPT</a> into analytics products such as <a href="https://www.itpro.com/security/data-protection/using-excel-for-data-analysis-vs-management">Excel</a> and PowerBI, represents a step change for enterprise capabilities. </p><p>"The traditional data analytics vendors are being disrupted by AI-native vendors that aim to help companies automate operational decision-making using <a href="https://www.itpro.com/strategy/28071/what-is-machine-learning">machine learning</a>," said Isabel Al-Dhahir, GlobalData principal analyst, strategic intelligence.</p><p>"Furthermore, the emergence of generative AI tools has led data analytics vendors to embed those solutions in their platforms, democratizing access to data science capabilities. For instance, Microsoft has launched Copilot, embedding ChatGPT into analytics products such as Excel and PowerBI."</p><h2 id="governance-security-and-skills-are-key-concerns">Governance, security, and skills are key concerns</h2><p>The <a href="https://www.globaldata.com/store/report/data-analytics-theme-analysis/?utm_source=cision&amp;utm_medium=press%20release&amp;utm_campaign=gd_press%20release_cision_strategic%20alliance_data%20analytics_report"><u>report</u></a> warned that the rapid growth of data volumes and the expectation of advanced analytics brings great pressure in terms of management, governance, and security.</p><p>"The ability of GenAI to create highly sophisticated models and simulations from vast datasets raises significant concerns about the potential misuse of personal information," said Al-Dhahir.</p><p>"The risk of exposing sensitive data increases as these AI systems become more adept at generating detailed, realistic outputs. This calls for stringent data governance frameworks."</p><p>Managing <a href="https://www.itpro.com/business-strategy/data-insights/369275/data-science-vs-data-analytics-which-field-is-right-for-you">data analytics</a> pipelines means a need for more skilled workers, including <a href="https://www.itpro.com/business-strategy/careers-training/357656/how-to-become-a-data-scientist">data scientists</a>, data engineers, and other data specialists. Meanwhile, data analysis requires skills in <a href="https://www.itpro.com/development/programming/361267/11-best-python-courses">visualization</a>, reporting, and communication. </p><div  class="fancy-box"><div class="fancy_box-title">RELATED WHITEPAPER</div><div class="fancy_box_body"><figure class="van-image-figure "  ><div class='image-full-width-wrapper'><div class='image-widthsetter' ><p class="vanilla-image-block" style="padding-top:56.25%;"><img id="trn4ackLzZb7hLT9wy24wL" name="Help skilled workers succeed with Dell Latitude 7030 and 7230 Rugged Extreme tablets" caption="" alt="Help skilled workers succeed with Dell Latitude 7030 and 7230 Rugged Extreme tablets" src="https://cdn.mos.cms.futurecdn.net/trn4ackLzZb7hLT9wy24wL-1920-80.jpg" mos="" link="" align="" fullscreen="" width="" height="" attribution="" endorsement="" class="pinterest-pin-exclude" /></p></div></div><figcaption itemprop="caption description" class=""><span class="credit" itemprop="copyrightHolder">(Image credit: Dell)</span></figcaption></figure><p class="fancy-box__body-text"><a data-analytics-id="inline-link" href="https://www.itpro.com/hardware/help-skilled-workers-succeed-with-dell-latitude-7030-and-7230-rugged-extreme-tablets"><em>Rugged devices designed for challenging environments</em></a></p></div></div><p>"Organizations must attract, train, retain, and upskill their current workforce to fill these roles. Companies may also attempt to plug the data-skills gap by encouraging less technical employees to act as citizen data scientists," said Al-Dhahir.</p><p>"Businesses must build up their in-house capabilities, but in some cases, strategic acquisitions or partnerships with small data analytics service companies may be preferable," Al-Dhahir added. </p><p>"As the market evolves, innovation across data management, AI integration, and governance will shape the future of data-driven strategies."</p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ What is data democratization and how will embracing it benefit your business? ]]></title>
                                                                                                <dc:content><![CDATA[ <p>With AI and other groundbreaking technologies growing in popularity and capabilities, more and more data is becoming available to employees who may not have traditionally had the skills or expertise to use it in their day-to-day workloads. This is data democratization – the idea that we can make data more accessible beyond simply available to <a href="https://www.itpro.com/business-strategy/careers-training/357656/how-to-become-a-data-scientist"><u>data scientists</u></a> or engineers – so that more people across a business can use it to derive valuable insights and shape decision-making. </p><p>There are plenty of benefits to embracing data democratization, as well as risks. But instigating a data democratization drive is a complex strategic process that requires not just a technological shift, but also a cultural and mindset shift. </p><p>The rise of <a href="https://www.itpro.com/technology/artificial-intelligence-ai/369959/what-is-generative-ai"><u>generative AI</u></a> has also had a massive influence on data democratization. Embracing this paradigm shift requires leaders to pursue dedicated programs across various disciplines so that their businesses can truly gain a competitive edge and make better, quicker, and smarter <a href="https://www.itpro.com/business/business-strategy/what-does-data-driven-mean-in-business"><u>data-driven</u></a> decisions at several levels.</p><h2 id="what-is-data-democratization">What is data democratization?</h2><p>Democracy refers to the distribution of power to the people of a society – ensuring that a single person or entity is not dominant without the consent of the masses. In exchange, people agree to live within certain rules and structures. Data democratization follows the same pattern, director of data at Penguin Random House, Pete Williams, tells <em>ITPro</em>. </p><p>"Excepting certain security and confidentiality needs, access to data should be decreed open and equal for all members of an organization who could find a use for it," Williams says. "Those colleagues should receive appropriate access to tools and training to unlock potential data use cases." </p><p>It opens up data to everyone in an organization regardless of technical expertise, <a href="https://www.itpro.com/business-strategy/data-insights/370274/taking-back-control-of-the-data-silos-holding-your-business"><u>removes silos</u></a>, increases <a href="https://www.itpro.com/business/careers-and-training/why-is-computer-literacy-still-an-issue-in-2023"><u>data literacy</u></a>, and allows self-service so that employees across the breadth of an organization can use data responsibly. A central team may be responsible for gathering, <a href="https://www.itpro.com/business/data-and-insights/data-governance-in-the-spotlight-as-uk-firms-ramp-up-ai-adoption"><u>governing</u></a>, and distributing data, Williams adds, but structures and controls ensure people can trust the data they access.  </p><h2 id="what-are-the-benefits-and-risks-of-data-democratization">What are the benefits and risks of data democratization?</h2><p>There are several benefits to data democratization. These include reduced reliance on IT resources – allowing users to identify trends and make real-time decisions – enhanced collaboration, and improved employee engagement by allowing them to contribute to improving customer experiences, says Forrester analyst Jayesh Chaurasia. "These factors directly contribute to a higher return on data investments and enhanced market competitiveness," he tells <em>ITPro</em>.</p><p>Williams says that by instigating data democratization, you have a much larger pool of well-informed decision-makers across the organization, who collectively take more key decisions than were previously possible. </p><p>"Data-enabled organizations are more innovative, <a href="https://www.itpro.com/business/business-strategy/how-embracing-agile-principles-can-boost-your-it-career"><u>more agile</u></a>, and have a better sense of the connectivity across domains or pillars that enable business processes," he explains. "This DNA exposure helps them understand how the organization truly functions and where it could become more efficient. I’d expect lower costs, higher productivity, more innovation, and a better connection of the product to the customer."</p><p>On the flip side, there are a handful of risks. An organization may not appreciate the loss of control over decision-making that data democratization permits, Williams adds. It can also feel that different delivery models may occur when the pace of change outweighs the control systems in place – in short if there are no guardrails or governance measures to manage this shift, it may feel like things are spinning out of control. "To use the racing analogy, 'slow down to speed up', as if you don’t brake sometimes, you’re going to spin out at the corner."</p><h2 id="data-democratization-and-ai-a-key-trend-in-2025">Data democratization and AI: A key trend in 2025</h2><p>Has AI influenced data democratization trends? It's complicated if you ask our experts. Chaurasia describes AI as a "game changer" thanks to the way it has helped users look for and access data using <a href="https://www.itpro.com/machine-learning/33308/what-is-natural-language-processing"><u>natural language processing</u></a>. "Interaction using natural language has also lowered the technical barriers for users to query and analyze data," he elaborates. "It is helping improve the understanding of data by creating summaries and explanations about data, queries, <a href="https://www.itpro.com/business-intelligence/28220/what-is-data-analytics"><u>analytics</u></a>, results, and visualization.</p><p>Williams attributes a more nuanced impact on generative AI and says in some ways it has hurt data quality. "To the non-technical user, it looks too easy, and they expect the simple provision of useful, consistent, accurate information to be solved by 'adding <a href="https://www.itpro.com/technology/artificial-intelligence-ai/369965/what-is-chatgpt-and-what-does-it-mean-for-businesses"><u>ChatGPT</u></a>’," he says.</p><p>"But it has driven curiosity and expectation, which can be helpful to the data democratizers if they can maintain the momentum," he continues. He agrees with Chaurasia on natural language, adding the biggest impact will be the "short-circuiting of data literacy needs" and by making "deeper analytics a conversation rather than an equation".</p><h2 id="how-to-implement-a-data-democratization-strategy">How to implement a data democratization strategy</h2><p>To become data-driven, businesses must embrace a new management paradigm, according to <a href="https://hbr.org/2023/11/5-pillars-for-democratizing-data-at-your-organization" target="_blank"><u><em>Harvard Business Review</em></u></a><em>. </em>Everyone within the organization must be empowered to work with data, regardless of how far outside their comfort zone it may be or their experience levels, but doing so requires several measures that need to be taken in parallel – not just new just making new technologies, tools, and systems available. <em> </em></p><p>Fundamentally, argues Williams, the C-suite should want to democratize data and then focus on "instilling a culture of measurement and asking better questions". </p><p>On the technology side of the equation, says Chaurasia, organizations should invest in data fabric architecture, unified governance tools, data quality and observability platforms, and <a href="https://www.itpro.com/cloud/cloud-computing/what-is-cloud-native-and-how-can-it-generate-business-value"><u>cloud-native</u></a> applications. If these tools are embedded with <a href="https://www.itpro.com/strategy/28071/what-is-machine-learning"><u>machine learning (ML)</u></a>, automation, and generative AI features, then all the better. </p><p>But, as he and Williams agree, technology is the easy part. Williams adds: "It’s simple to initiate and join up a modern data stack where you can gather, process, and send data in almost any way you want; I do not see that as a barrier."</p><div  class="fancy-box"><div class="fancy_box-title">RELATED WHITEPAPER</div><div class="fancy_box_body"><figure class="van-image-figure "  ><div class='image-full-width-wrapper'><div class='image-widthsetter' ><p class="vanilla-image-block" style="padding-top:56.25%;"><img id="QG6vhN3APSsV7GwFnj5f3o" name="Discover the six superpowers of Dell PowerEdge servers.jpg" caption="" alt="Discover the six superpowers of Dell PowerEdge servers" src="https://cdn.mos.cms.futurecdn.net/QG6vhN3APSsV7GwFnj5f3o-1920-80.jpg" mos="" link="" align="" fullscreen="" width="" height="" attribution="" endorsement="" class="pinterest-pin-exclude" /></p></div></div><figcaption itemprop="caption description" class=""><span class="credit" itemprop="copyrightHolder">(Image credit: Dell &amp; AMD)</span></figcaption></figure><p class="fancy-box__body-text"><a data-analytics-id="inline-link" href="https://www.itpro.com/infrastructure/discover-the-six-superpowers-of-dell-poweredge-servers"><em>Transform your data center</em></a></p></div></div><p>"There should be dedicated resources for change management to address user concerns and resolve resistance," says Chaurasia on the cultural changes. "Organizations need to promote a data-driven approach and a data product mindset. This helps employees understand the importance of data and the roles they play in leveraging data for growth."</p><p>This must come in addition to a data literacy program that focuses on not just tool usage but on processes, workflows, and responsibilities. Users should understand frameworks, data ownership, and the importance of data quality, he adds, with governance and quality seen as everybody's joining responsibility.</p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/business/data-and-insights/what-is-data-democratization</link>
                                                                            <description>
                            <![CDATA[ Data is no longer the preserve of a small number of highly skilled employees – everyone across the organization may soon have the tools to derive real-time insights at pace ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">vT6jpi3A9es85gywNkrCQj</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/LV8Ns4LoC29MeNXNsMy2Si-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Tue, 10 Dec 2024 13:03:00 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:16:35 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Governance]]></category>
                                                    <category><![CDATA[Data and Insights]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                    <category><![CDATA[Business]]></category>
                                                                                                <author><![CDATA[ keumars.afifi-sabet@futurenet.com (Keumars Afifi-Sabet) ]]></author>                    <dc:creator><![CDATA[ Keumars Afifi-Sabet ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/EAvwpZggMZ2K5h8s2pTAEm-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ null ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/LV8Ns4LoC29MeNXNsMy2Si-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[A diverse range of hands all grabbing pieces of a colorful pie chart, to represent data democratization. The hands are coming into frame from all angles and the arms of two can be seen, while all are set against a blue background.]]></media:description>                                                            <media:text><![CDATA[A diverse range of hands all grabbing pieces of a colorful pie chart, to represent data democratization. The hands are coming into frame from all angles and the arms of two can be seen, while all are set against a blue background.]]></media:text>
                                <media:title type="plain"><![CDATA[A diverse range of hands all grabbing pieces of a colorful pie chart, to represent data democratization. The hands are coming into frame from all angles and the arms of two can be seen, while all are set against a blue background.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/LV8Ns4LoC29MeNXNsMy2Si-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>With AI and other groundbreaking technologies growing in popularity and capabilities, more and more data is becoming available to employees who may not have traditionally had the skills or expertise to use it in their day-to-day workloads. This is data democratization – the idea that we can make data more accessible beyond simply available to <a href="https://www.itpro.com/business-strategy/careers-training/357656/how-to-become-a-data-scientist"><u>data scientists</u></a> or engineers – so that more people across a business can use it to derive valuable insights and shape decision-making. </p><p>There are plenty of benefits to embracing data democratization, as well as risks. But instigating a data democratization drive is a complex strategic process that requires not just a technological shift, but also a cultural and mindset shift. </p><p>The rise of <a href="https://www.itpro.com/technology/artificial-intelligence-ai/369959/what-is-generative-ai"><u>generative AI</u></a> has also had a massive influence on data democratization. Embracing this paradigm shift requires leaders to pursue dedicated programs across various disciplines so that their businesses can truly gain a competitive edge and make better, quicker, and smarter <a href="https://www.itpro.com/business/business-strategy/what-does-data-driven-mean-in-business"><u>data-driven</u></a> decisions at several levels.</p><h2 id="what-is-data-democratization">What is data democratization?</h2><p>Democracy refers to the distribution of power to the people of a society – ensuring that a single person or entity is not dominant without the consent of the masses. In exchange, people agree to live within certain rules and structures. Data democratization follows the same pattern, director of data at Penguin Random House, Pete Williams, tells <em>ITPro</em>. </p><p>"Excepting certain security and confidentiality needs, access to data should be decreed open and equal for all members of an organization who could find a use for it," Williams says. "Those colleagues should receive appropriate access to tools and training to unlock potential data use cases." </p><p>It opens up data to everyone in an organization regardless of technical expertise, <a href="https://www.itpro.com/business-strategy/data-insights/370274/taking-back-control-of-the-data-silos-holding-your-business"><u>removes silos</u></a>, increases <a href="https://www.itpro.com/business/careers-and-training/why-is-computer-literacy-still-an-issue-in-2023"><u>data literacy</u></a>, and allows self-service so that employees across the breadth of an organization can use data responsibly. A central team may be responsible for gathering, <a href="https://www.itpro.com/business/data-and-insights/data-governance-in-the-spotlight-as-uk-firms-ramp-up-ai-adoption"><u>governing</u></a>, and distributing data, Williams adds, but structures and controls ensure people can trust the data they access.  </p><h2 id="what-are-the-benefits-and-risks-of-data-democratization">What are the benefits and risks of data democratization?</h2><p>There are several benefits to data democratization. These include reduced reliance on IT resources – allowing users to identify trends and make real-time decisions – enhanced collaboration, and improved employee engagement by allowing them to contribute to improving customer experiences, says Forrester analyst Jayesh Chaurasia. "These factors directly contribute to a higher return on data investments and enhanced market competitiveness," he tells <em>ITPro</em>.</p><p>Williams says that by instigating data democratization, you have a much larger pool of well-informed decision-makers across the organization, who collectively take more key decisions than were previously possible. </p><p>"Data-enabled organizations are more innovative, <a href="https://www.itpro.com/business/business-strategy/how-embracing-agile-principles-can-boost-your-it-career"><u>more agile</u></a>, and have a better sense of the connectivity across domains or pillars that enable business processes," he explains. "This DNA exposure helps them understand how the organization truly functions and where it could become more efficient. I’d expect lower costs, higher productivity, more innovation, and a better connection of the product to the customer."</p><p>On the flip side, there are a handful of risks. An organization may not appreciate the loss of control over decision-making that data democratization permits, Williams adds. It can also feel that different delivery models may occur when the pace of change outweighs the control systems in place – in short if there are no guardrails or governance measures to manage this shift, it may feel like things are spinning out of control. "To use the racing analogy, 'slow down to speed up', as if you don’t brake sometimes, you’re going to spin out at the corner."</p><h2 id="data-democratization-and-ai-a-key-trend-in-2025">Data democratization and AI: A key trend in 2025</h2><p>Has AI influenced data democratization trends? It's complicated if you ask our experts. Chaurasia describes AI as a "game changer" thanks to the way it has helped users look for and access data using <a href="https://www.itpro.com/machine-learning/33308/what-is-natural-language-processing"><u>natural language processing</u></a>. "Interaction using natural language has also lowered the technical barriers for users to query and analyze data," he elaborates. "It is helping improve the understanding of data by creating summaries and explanations about data, queries, <a href="https://www.itpro.com/business-intelligence/28220/what-is-data-analytics"><u>analytics</u></a>, results, and visualization.</p><p>Williams attributes a more nuanced impact on generative AI and says in some ways it has hurt data quality. "To the non-technical user, it looks too easy, and they expect the simple provision of useful, consistent, accurate information to be solved by 'adding <a href="https://www.itpro.com/technology/artificial-intelligence-ai/369965/what-is-chatgpt-and-what-does-it-mean-for-businesses"><u>ChatGPT</u></a>’," he says.</p><p>"But it has driven curiosity and expectation, which can be helpful to the data democratizers if they can maintain the momentum," he continues. He agrees with Chaurasia on natural language, adding the biggest impact will be the "short-circuiting of data literacy needs" and by making "deeper analytics a conversation rather than an equation".</p><h2 id="how-to-implement-a-data-democratization-strategy">How to implement a data democratization strategy</h2><p>To become data-driven, businesses must embrace a new management paradigm, according to <a href="https://hbr.org/2023/11/5-pillars-for-democratizing-data-at-your-organization" target="_blank"><u><em>Harvard Business Review</em></u></a><em>. </em>Everyone within the organization must be empowered to work with data, regardless of how far outside their comfort zone it may be or their experience levels, but doing so requires several measures that need to be taken in parallel – not just new just making new technologies, tools, and systems available. <em> </em></p><p>Fundamentally, argues Williams, the C-suite should want to democratize data and then focus on "instilling a culture of measurement and asking better questions". </p><p>On the technology side of the equation, says Chaurasia, organizations should invest in data fabric architecture, unified governance tools, data quality and observability platforms, and <a href="https://www.itpro.com/cloud/cloud-computing/what-is-cloud-native-and-how-can-it-generate-business-value"><u>cloud-native</u></a> applications. If these tools are embedded with <a href="https://www.itpro.com/strategy/28071/what-is-machine-learning"><u>machine learning (ML)</u></a>, automation, and generative AI features, then all the better. </p><p>But, as he and Williams agree, technology is the easy part. Williams adds: "It’s simple to initiate and join up a modern data stack where you can gather, process, and send data in almost any way you want; I do not see that as a barrier."</p><div  class="fancy-box"><div class="fancy_box-title">RELATED WHITEPAPER</div><div class="fancy_box_body"><figure class="van-image-figure "  ><div class='image-full-width-wrapper'><div class='image-widthsetter' ><p class="vanilla-image-block" style="padding-top:56.25%;"><img id="QG6vhN3APSsV7GwFnj5f3o" name="Discover the six superpowers of Dell PowerEdge servers.jpg" caption="" alt="Discover the six superpowers of Dell PowerEdge servers" src="https://cdn.mos.cms.futurecdn.net/QG6vhN3APSsV7GwFnj5f3o-1920-80.jpg" mos="" link="" align="" fullscreen="" width="" height="" attribution="" endorsement="" class="pinterest-pin-exclude" /></p></div></div><figcaption itemprop="caption description" class=""><span class="credit" itemprop="copyrightHolder">(Image credit: Dell &amp; AMD)</span></figcaption></figure><p class="fancy-box__body-text"><a data-analytics-id="inline-link" href="https://www.itpro.com/infrastructure/discover-the-six-superpowers-of-dell-poweredge-servers"><em>Transform your data center</em></a></p></div></div><p>"There should be dedicated resources for change management to address user concerns and resolve resistance," says Chaurasia on the cultural changes. "Organizations need to promote a data-driven approach and a data product mindset. This helps employees understand the importance of data and the roles they play in leveraging data for growth."</p><p>This must come in addition to a data literacy program that focuses on not just tool usage but on processes, workflows, and responsibilities. Users should understand frameworks, data ownership, and the importance of data quality, he adds, with governance and quality seen as everybody's joining responsibility.</p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ Cognizant and Nvidia team up to supercharge data modernization ]]></title>
                                                                                                <dc:content><![CDATA[ <p><a href="https://www.itpro.com/business/acquisition/cognizant-enhances-engineering-capabilities-with-dollar129-billion-belcan-acquisition">Cognizant</a> has announced a new partnership with <a href="https://www.itpro.com/business/business-strategy/everything-you-need-to-know-about-nvidia">Nvidia</a> that aims to enhance the IT consultancy firm’s <a href="https://www.itpro.com/business/digital-transformation/digital-transformation-floundering-at-enterprises-with-just-10-of-it-leaders-working-with-modern-data-stacks">data modernization</a> offering and enable faster AI adoption.</p><p>The collaboration will see Cognizant leverage the chipmaker’s full stack accelerated computing platform, including Nvidia RAPIDS, part of the Nvidia AI Enterprise software platform, alongside the Cognizant Data and Intelligence Toolkit.</p><p>The move aims to tackle the escalating costs and performance bottlenecks caused by the rapid growth of data and enterprise need for real-time analytics, while laying the groundwork for faster adoption of <a href="https://www.itpro.com/strategy/28181/what-is-ai">AI</a> use cases, Cognizant said in an announcement.</p><p>“Our latest collaboration with Nvidia aims to transform the way businesses process and analyze large datasets, delivering, we believe, unprecedented speed and efficiency,” commented Annadurai Elango, EVP and global head of core technologies and insights at Cognizant. </p><p>“Transitioning clients to GPU-based infrastructure will also lay the groundwork for implementing exciting new <a href="https://www.itpro.com/technology/artificial-intelligence/examples-of-generative-ai-in-action-today">generative AI use cases</a> in critical business functions.”</p><p>The new and enhanced data modernization offering will leverage Nvidia’s RAPIDS Accelerator for Apache Spark to help customers speed up data processing tasks, ramp up resource efficiency, and leverage more sophisticated analytics. </p><p>The pair said the combination will outperform traditional <a href="https://www.itpro.com/hardware/components/cpu-architectures-whats-the-difference-between-arm-and-x86-and-why-does-it-matter">CPU</a>-based processing without the need for code changes in Apache Spark-based workloads.</p><p>Cognizant’s Data and Intelligence Toolkit, which features a set of accelerators designed to eliminate friction when leveraging data for decision making, will harness Nvidia GPU acceleration through the RAPIDS software libraries and APIs.</p><div  class="fancy-box"><div class="fancy_box-title">RELATED WHITEPAPER</div><div class="fancy_box_body"><figure class="van-image-figure "  ><div class='image-full-width-wrapper'><div class='image-widthsetter' ><p class="vanilla-image-block" style="padding-top:56.25%;"><img id="XXjzkN96kJfYDq8jVEVFpL" name="BT AI Healthcare.png" caption="" alt="whitepaper from BT on AI Security" src="https://cdn.mos.cms.futurecdn.net/XXjzkN96kJfYDq8jVEVFpL-1920-80.png" mos="" link="" align="" fullscreen="" width="" height="" attribution="" endorsement="" class="pinterest-pin-exclude" /></p></div></div><figcaption itemprop="caption description" class=""><span class="credit" itemprop="copyrightHolder">(Image credit: BT)</span></figcaption></figure><p class="fancy-box__body-text"><a data-analytics-id="inline-link" href="https://www.itpro.com/security/where-will-ai-take-security-and-are-we-ready"><em>Optimize security during your AI adoption journey</em></a></p></div></div><p>Customers stand to benefit from enhancements across analytics processing performance, data preparation, model training, as well as deployment. Proprietary benchmarks have shown an increase of 2.5x in acceleration in data engineering and data science workloads, alongside a 66% reduction in computing costs when compared with traditional CPU processing. </p><p>"Enterprises migrating to the cloud need efficient solutions for large-scale data processing and real-time analytics to speed development and retrieval-augmented generation for agentic AI,” said John Fanelli, Nvidia’s vice president of enterprise software.</p><p>“With Nvidia RAPIDS accelerated data processing, Cognizant can help businesses significantly reduce computing costs and accelerate workloads to extract more value from their cloud investments."</p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/infrastructure/cognizant-and-nvidia-team-up-to-supercharge-data-modernization</link>
                                                                            <description>
                            <![CDATA[ The collaboration merges Nvidia AI with Cognizant’s data analytics accelerators to deliver “unprecedented speed and efficiency” ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">7cK5XUNfB5NCurgaArTb4Y</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/UXkNjru25GwMS6QND4woGZ-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Thu, 31 Oct 2024 13:03:51 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:16:40 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Management]]></category>
                                                    <category><![CDATA[Infrastructure]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                                                                <author><![CDATA[ itpro@futurenet.com (Daniel Todd) ]]></author>                    <dc:creator><![CDATA[ Daniel Todd ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/SRyC34qeLpNDj3dJtsVDhT-320-70.jpg ]]></dc:source>
                                                                <dc:description><![CDATA[ null ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/UXkNjru25GwMS6QND4woGZ-1920-80.jpg">
                                                            <media:credit><![CDATA[Getty Images]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Cognizant logo displayed on a blue flag placed in ground.]]></media:description>                                                            <media:text><![CDATA[Cognizant logo displayed on a blue flag placed in ground.]]></media:text>
                                <media:title type="plain"><![CDATA[Cognizant logo displayed on a blue flag placed in ground.]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/UXkNjru25GwMS6QND4woGZ-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p><a href="https://www.itpro.com/business/acquisition/cognizant-enhances-engineering-capabilities-with-dollar129-billion-belcan-acquisition">Cognizant</a> has announced a new partnership with <a href="https://www.itpro.com/business/business-strategy/everything-you-need-to-know-about-nvidia">Nvidia</a> that aims to enhance the IT consultancy firm’s <a href="https://www.itpro.com/business/digital-transformation/digital-transformation-floundering-at-enterprises-with-just-10-of-it-leaders-working-with-modern-data-stacks">data modernization</a> offering and enable faster AI adoption.</p><p>The collaboration will see Cognizant leverage the chipmaker’s full stack accelerated computing platform, including Nvidia RAPIDS, part of the Nvidia AI Enterprise software platform, alongside the Cognizant Data and Intelligence Toolkit.</p><p>The move aims to tackle the escalating costs and performance bottlenecks caused by the rapid growth of data and enterprise need for real-time analytics, while laying the groundwork for faster adoption of <a href="https://www.itpro.com/strategy/28181/what-is-ai">AI</a> use cases, Cognizant said in an announcement.</p><p>“Our latest collaboration with Nvidia aims to transform the way businesses process and analyze large datasets, delivering, we believe, unprecedented speed and efficiency,” commented Annadurai Elango, EVP and global head of core technologies and insights at Cognizant. </p><p>“Transitioning clients to GPU-based infrastructure will also lay the groundwork for implementing exciting new <a href="https://www.itpro.com/technology/artificial-intelligence/examples-of-generative-ai-in-action-today">generative AI use cases</a> in critical business functions.”</p><p>The new and enhanced data modernization offering will leverage Nvidia’s RAPIDS Accelerator for Apache Spark to help customers speed up data processing tasks, ramp up resource efficiency, and leverage more sophisticated analytics. </p><p>The pair said the combination will outperform traditional <a href="https://www.itpro.com/hardware/components/cpu-architectures-whats-the-difference-between-arm-and-x86-and-why-does-it-matter">CPU</a>-based processing without the need for code changes in Apache Spark-based workloads.</p><p>Cognizant’s Data and Intelligence Toolkit, which features a set of accelerators designed to eliminate friction when leveraging data for decision making, will harness Nvidia GPU acceleration through the RAPIDS software libraries and APIs.</p><div  class="fancy-box"><div class="fancy_box-title">RELATED WHITEPAPER</div><div class="fancy_box_body"><figure class="van-image-figure "  ><div class='image-full-width-wrapper'><div class='image-widthsetter' ><p class="vanilla-image-block" style="padding-top:56.25%;"><img id="XXjzkN96kJfYDq8jVEVFpL" name="BT AI Healthcare.png" caption="" alt="whitepaper from BT on AI Security" src="https://cdn.mos.cms.futurecdn.net/XXjzkN96kJfYDq8jVEVFpL-1920-80.png" mos="" link="" align="" fullscreen="" width="" height="" attribution="" endorsement="" class="pinterest-pin-exclude" /></p></div></div><figcaption itemprop="caption description" class=""><span class="credit" itemprop="copyrightHolder">(Image credit: BT)</span></figcaption></figure><p class="fancy-box__body-text"><a data-analytics-id="inline-link" href="https://www.itpro.com/security/where-will-ai-take-security-and-are-we-ready"><em>Optimize security during your AI adoption journey</em></a></p></div></div><p>Customers stand to benefit from enhancements across analytics processing performance, data preparation, model training, as well as deployment. Proprietary benchmarks have shown an increase of 2.5x in acceleration in data engineering and data science workloads, alongside a 66% reduction in computing costs when compared with traditional CPU processing. </p><p>"Enterprises migrating to the cloud need efficient solutions for large-scale data processing and real-time analytics to speed development and retrieval-augmented generation for agentic AI,” said John Fanelli, Nvidia’s vice president of enterprise software.</p><p>“With Nvidia RAPIDS accelerated data processing, Cognizant can help businesses significantly reduce computing costs and accelerate workloads to extract more value from their cloud investments."</p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
                                <item>
                                                            <title><![CDATA[ How Snowflake is helping customers navigate new and emerging challenges ]]></title>
                                                                                                <dc:content><![CDATA[ <p>Easy, efficient, and trusted. These were the three keywords that played out on the screen and on the stage at Snowflake’s World Tour London event at the Excel earlier this week. </p><p>Sridhar Ramaswamy, the company’s CEO, took to the stage for the opening keynote to reiterate how Snowflake -  together with partners - is helping customers navigate myriad new and emerging challenges. </p><p>“The scale of the platform is truly massive with over five billion jobs running on a daily basis. We see our customers executing their data strategies through a variety of architectures.  There are thousands of customers sharing data. We call these points of sharing stable edges and it demonstrates the value of collaboration on data,” he said. </p><p>“And that’s just where we are today. So what’s next? Together, we are ushering in the era of enterprise AI. An era where AI  is easy, efficient, and trusted. An era where you can focus on the future of your business and stay ahead. And we are here to help make this possible.” </p><p>There’s no question that businesses of all sizes are currently enveloped in a world of opportunity, intrigue, and - at times - concern - about how AI will disrupt and transform the world around them. But Snowflake,  Ramaswamy says, is prepped and primed to assist. </p><p>Ramaswamy went on to say that the AI data cloud delivers on enterprise needs by being both an AI-powered data platform and a data-powered AI platform at the same time. </p><p>“Much like cloud computing enabled a reinvention of the data platform, AI is already transforming [workloads and business],” he said. </p><p>“AI will become a co-pilot for data engineers and anyone working with data. And that is the power of an AI-powered data platform.”</p><p>Ramaswamy continued: “AI has become the new interface to data and knowledge. We all love chatbots that can give us reliable answers. There’s a potential for AI to augment and transform every function in the company and also unleash entirely new biz models. To make that a reality, though, you need an AI platform and it needs to be built around your enterprise data.”</p><p>Importantly, Ramaswamy wasn’t simply paying lip service to all the good on offer. He also highlighted the challenges that organizations face, citing there were three key areas of concern: Rising complexity, controlling costs, and security and privacy. </p><p>“Now that you are ready to take advantage of AI to get more out of your data you have to recognize there are challenges to getting there. First, as you manage more data across sources, you end up creating complexity. And, of course, you have to control costs. Finally, you have to navigate growing security and privacy constraints amidst increasing regulation,” he said. </p><p>Complexity, according to Ramaswamy, is something Snowflake has been focused on since its foundation, meaning the company is very well placed to help firms address these challenges head-on. </p><p>“Complexity is driven by silos of data. Siloed data and siloed tools that prevent you from accessing insights. You’re likely forced to leverage specialized skills just to move data from place to place and you have to be able to patchwork up,” he added. </p><p>“This is a foundational problem and if you don’t fix this, all other initiatives including your AI data strategy will get slowed down or not even get off the ground.”</p><p>What matters most here, according to Ramaswamy, is ensuring clarity and focusing on what matters most. This, he said, is “building and executing on your data strategy.”</p><p>Alas, vendors are also part of the problem when it comes to increasing complexity, which Ramaswamy acknowledged. </p><p>“Complexity, unfortunately, is also driven by vendors. Many vendors sell you parts of a car and tell you to build it yourself. At Snowflake we have a different philosophy. We want to give you the car. We go out of our way to obstruct complexity for you so that we make it easy to derive value from your data and accelerate your AI strategy,” he said. </p><p>“Complexity within your enterprise creates a lot of cost. Managing your own infrastructure can get very expensive. It requires costly, specialized resources and creates a lot of hidden overheads. </p><p>“AI adds to this challenge creating unpredictable demand and usage patterns. And this is where Snowflake shines. We have tried to deliver the most efficient Ai and data platform out there. And we are a single platform for all of your workloads.” </p><p>While AI offers many benefits, when it comes to compliance, AI somewhat intensifies things, according to Ramaswamy. But, he added, Snowflake can help here, too. </p><div  class="fancy-box"><div class="fancy_box-title">RELATED WHITEPAPER</div><div class="fancy_box_body"><figure class="van-image-figure "  ><div class='image-full-width-wrapper'><div class='image-widthsetter' ><p class="vanilla-image-block" style="padding-top:56.25%;"><img id="LALv3mddedPZS6zEt9NfKT" name="The Business Leader’s Guide to Digital Worker Technology for Improving Productivity.jpg" caption="" alt="The Business Leader’s Guide to Digital Worker Technology for Improving Productivity" src="https://cdn.mos.cms.futurecdn.net/LALv3mddedPZS6zEt9NfKT-1920-80.jpg" mos="" link="" align="" fullscreen="" width="" height="" attribution="" endorsement="" class="pinterest-pin-exclude" /></p></div></div><figcaption itemprop="caption description" class=""><span class="credit" itemprop="copyrightHolder">(Image credit: IBM)</span></figcaption></figure><p class="fancy-box__body-text"><a data-analytics-id="inline-link" href="https://www.itpro.com/business/business-strategy/the-business-leaders-guide-to-digital-worker-technology-for-improving-productivity"><em>Digital workers could help retain talented employees</em></a></p></div></div><p>In particular, he reiterated the dedicated features Snowflake’s built-in governance solution, Horizon, brings to bear by ensuring baked-in capabilities that focus on access, compliance, privacy, and security. </p><p>“We help you proactively identify ways you can monitor and improve your security posture. The key thing with the AI data cloud is that you not only get the platform but also the content, data, applications, models -  the things you need to do your job effectively,” he said. </p><p>“All of this comes together to form the AI data cloud. We support all data types and leading architectural patterns… all kinds of compute needs and all personas on a single, solid enterprise-grade, data foundation. We delivered a platform that is unified, easy to use,  and provides much better TCO. This isn't just talk. The era of enterprise AI is here.”</p> ]]></dc:content>
                                                                                                                                            <link>https://www.itpro.com/technology/artificial-intelligence/snowflake-ceo-many-vendors-sell-you-parts-of-a-car-and-tell-you-to-build-it-yourself-at-snowflake-we-have-a-different-philosophy-we-want-to-give-you-the-car</link>
                                                                            <description>
                            <![CDATA[ AI data cloud firm’s leader uses its local event series to reiterate how it is helping customers address current and future challenges head on… ]]>
                                                                                                            </description>
                                                                                                                                <guid isPermaLink="false">w3FhsLwxRuvhtGmis3u7Ub</guid>
                                                                                                <enclosure url="https://cdn.mos.cms.futurecdn.net/DJKZzWX9QNBXzcnvfRrpak-1920-80.jpg" type="image/jpeg" length="0"></enclosure>
                                                                        <pubDate>Sun, 13 Oct 2024 19:33:57 +0000</pubDate>                                                                                                                                <updated>Thu, 19 Nov 2026 13:17:05 +0000</updated>
                                                                                                                                            <category><![CDATA[Data Platforms]]></category>
                                                    <category><![CDATA[Artificial Intelligence]]></category>
                                                    <category><![CDATA[Data and Analytics]]></category>
                                                                                                <author><![CDATA[ Maggie.holland@futurenet.com (Maggie Holland) ]]></author>                    <dc:creator><![CDATA[ Maggie Holland ]]></dc:creator>                                                                                    <dc:source><![CDATA[ https://cdn.mos.cms.futurecdn.net/yR3aBSQeNTZZ8SzoXbFEQ3-320-70.png ]]></dc:source>
                                                                <dc:description><![CDATA[ &lt;p&gt;Maggie has been a journalist since 1999. She started her career as an editorial assistant on then-weekly magazine Computing, before working her way up to senior reporter level. After several years on the magazine, she moved to &#039;the other side of the fence&#039; to work as a copywriter for a marketing agency, writing case studies and working on ad and website copy for companies such as eBay, Dell, Microsoft and more. In 2006, just weeks before&amp;nbsp;ITPro&amp;nbsp;was launched, Maggie joined Dennis Publishing as a reporter. Having worked her way up to editor of ITPro, she was appointed group editor of&amp;nbsp;CloudPro&amp;nbsp;and&amp;nbsp;ITPro&amp;nbsp;in April 2012. She became the editorial director and took responsibility for&amp;nbsp;ChannelPro,&amp;nbsp;in 2016.&lt;/p&gt;
&lt;p&gt;Her areas of particular interest, aside from cloud, include management and C-level issues, the business value of technology, green and environmental issues and careers to name but a few.&lt;/p&gt; ]]></dc:description>
                                                                                                                                <cf:isSponsored>false</cf:isSponsored>
                <cf:hasAffiliateLinks>false</cf:hasAffiliateLinks>
                <cf:isPaid>false</cf:isPaid>
                                                                                                                                                                                    <media:content type="image/jpeg" url="https://cdn.mos.cms.futurecdn.net/DJKZzWX9QNBXzcnvfRrpak-1920-80.jpg">
                                                            <media:credit><![CDATA[Future]]></media:credit>
                                                                                                                                                                                                                                    <media:description><![CDATA[Stage at Snowflake World Tour London 2024]]></media:description>                                                            <media:text><![CDATA[Stage at Snowflake World Tour London 2024]]></media:text>
                                <media:title type="plain"><![CDATA[Stage at Snowflake World Tour London 2024]]></media:title>
                                                    </media:content>
                                                    <media:thumbnail url="https://cdn.mos.cms.futurecdn.net/DJKZzWX9QNBXzcnvfRrpak-1920-80.jpg" />
                                                                                                                                                                    <content:encoded >
                            <![CDATA[
                            <article>
                                <p>Easy, efficient, and trusted. These were the three keywords that played out on the screen and on the stage at Snowflake’s World Tour London event at the Excel earlier this week. </p><p>Sridhar Ramaswamy, the company’s CEO, took to the stage for the opening keynote to reiterate how Snowflake -  together with partners - is helping customers navigate myriad new and emerging challenges. </p><p>“The scale of the platform is truly massive with over five billion jobs running on a daily basis. We see our customers executing their data strategies through a variety of architectures.  There are thousands of customers sharing data. We call these points of sharing stable edges and it demonstrates the value of collaboration on data,” he said. </p><p>“And that’s just where we are today. So what’s next? Together, we are ushering in the era of enterprise AI. An era where AI  is easy, efficient, and trusted. An era where you can focus on the future of your business and stay ahead. And we are here to help make this possible.” </p><p>There’s no question that businesses of all sizes are currently enveloped in a world of opportunity, intrigue, and - at times - concern - about how AI will disrupt and transform the world around them. But Snowflake,  Ramaswamy says, is prepped and primed to assist. </p><p>Ramaswamy went on to say that the AI data cloud delivers on enterprise needs by being both an AI-powered data platform and a data-powered AI platform at the same time. </p><p>“Much like cloud computing enabled a reinvention of the data platform, AI is already transforming [workloads and business],” he said. </p><p>“AI will become a co-pilot for data engineers and anyone working with data. And that is the power of an AI-powered data platform.”</p><p>Ramaswamy continued: “AI has become the new interface to data and knowledge. We all love chatbots that can give us reliable answers. There’s a potential for AI to augment and transform every function in the company and also unleash entirely new biz models. To make that a reality, though, you need an AI platform and it needs to be built around your enterprise data.”</p><p>Importantly, Ramaswamy wasn’t simply paying lip service to all the good on offer. He also highlighted the challenges that organizations face, citing there were three key areas of concern: Rising complexity, controlling costs, and security and privacy. </p><p>“Now that you are ready to take advantage of AI to get more out of your data you have to recognize there are challenges to getting there. First, as you manage more data across sources, you end up creating complexity. And, of course, you have to control costs. Finally, you have to navigate growing security and privacy constraints amidst increasing regulation,” he said. </p><p>Complexity, according to Ramaswamy, is something Snowflake has been focused on since its foundation, meaning the company is very well placed to help firms address these challenges head-on. </p><p>“Complexity is driven by silos of data. Siloed data and siloed tools that prevent you from accessing insights. You’re likely forced to leverage specialized skills just to move data from place to place and you have to be able to patchwork up,” he added. </p><p>“This is a foundational problem and if you don’t fix this, all other initiatives including your AI data strategy will get slowed down or not even get off the ground.”</p><p>What matters most here, according to Ramaswamy, is ensuring clarity and focusing on what matters most. This, he said, is “building and executing on your data strategy.”</p><p>Alas, vendors are also part of the problem when it comes to increasing complexity, which Ramaswamy acknowledged. </p><p>“Complexity, unfortunately, is also driven by vendors. Many vendors sell you parts of a car and tell you to build it yourself. At Snowflake we have a different philosophy. We want to give you the car. We go out of our way to obstruct complexity for you so that we make it easy to derive value from your data and accelerate your AI strategy,” he said. </p><p>“Complexity within your enterprise creates a lot of cost. Managing your own infrastructure can get very expensive. It requires costly, specialized resources and creates a lot of hidden overheads. </p><p>“AI adds to this challenge creating unpredictable demand and usage patterns. And this is where Snowflake shines. We have tried to deliver the most efficient Ai and data platform out there. And we are a single platform for all of your workloads.” </p><p>While AI offers many benefits, when it comes to compliance, AI somewhat intensifies things, according to Ramaswamy. But, he added, Snowflake can help here, too. </p><div  class="fancy-box"><div class="fancy_box-title">RELATED WHITEPAPER</div><div class="fancy_box_body"><figure class="van-image-figure "  ><div class='image-full-width-wrapper'><div class='image-widthsetter' ><p class="vanilla-image-block" style="padding-top:56.25%;"><img id="LALv3mddedPZS6zEt9NfKT" name="The Business Leader’s Guide to Digital Worker Technology for Improving Productivity.jpg" caption="" alt="The Business Leader’s Guide to Digital Worker Technology for Improving Productivity" src="https://cdn.mos.cms.futurecdn.net/LALv3mddedPZS6zEt9NfKT-1920-80.jpg" mos="" link="" align="" fullscreen="" width="" height="" attribution="" endorsement="" class="pinterest-pin-exclude" /></p></div></div><figcaption itemprop="caption description" class=""><span class="credit" itemprop="copyrightHolder">(Image credit: IBM)</span></figcaption></figure><p class="fancy-box__body-text"><a data-analytics-id="inline-link" href="https://www.itpro.com/business/business-strategy/the-business-leaders-guide-to-digital-worker-technology-for-improving-productivity"><em>Digital workers could help retain talented employees</em></a></p></div></div><p>In particular, he reiterated the dedicated features Snowflake’s built-in governance solution, Horizon, brings to bear by ensuring baked-in capabilities that focus on access, compliance, privacy, and security. </p><p>“We help you proactively identify ways you can monitor and improve your security posture. The key thing with the AI data cloud is that you not only get the platform but also the content, data, applications, models -  the things you need to do your job effectively,” he said. </p><p>“All of this comes together to form the AI data cloud. We support all data types and leading architectural patterns… all kinds of compute needs and all personas on a single, solid enterprise-grade, data foundation. We delivered a platform that is unified, easy to use,  and provides much better TCO. This isn't just talk. The era of enterprise AI is here.”</p>
                                                            </article>
                            ]]>
                        </content:encoded>
                                                </item>
            </channel>
</rss>