IT Pro is supported by its audience. When you purchase through links on our site, we may earn an affiliate commission. Learn more

Google Cloud makes significant BigQuery upgrade in pursuit of the ‘ultimate data cloud’

The tech giant is also adding support for Apache Iceberg, Delta Lake, and Apache Hudi - the leading open source table formats commonly used in data lakes

Google Cloud is making upgrades to BigQuery hoping it will lead to the 'ultimate data cloud', the tech giant revealed at its Next conference this week.

Starting today, data teams will be able to analyse structured and unstructured data in BigQuery, with easy access to Google Cloud’s capabilities in machine learning, speech recognition, computer vision, translation, and text processing, using BigQuery’s familiar SQL interface.

In the past, data teams have worked with structured data, using BigQuery to analyse data from operational databases and SaaS applications like Adobe, SAP, ServiceNow, and Workday as well as semi-structured data such as JSON log files. 

This comes after it announced a public preview last January for the BigQuery native JSON data type, a capability which brings support for storing and analysing semi-structured data in BigQuery. Through this, it said semi-structured data in BigQuery is now intuitive to use and query in its native format.

The company is making changes to how structured and unstructured data works in BigQuery, its data warehouse platform. It underlined that unstructured data may account for up to 90% of all data today, including video from television archives, audio from call centres or radio, and documents in different formats.

It’s also adding support for major data formats in use today. BigLake, its storage engine, will add support for Apache Iceberg, Delta Lake, and Apache Hudi, the leading open-source table formats commonly used in data lakes. Support for Apache Iceberg will be entering preview now while support for the other two formats will be coming soon, but at an undetermined date.

Related Resource

The time for cloud MDM is now

Know the differences between cloud-native and cloud-enabled MDM

Whitepaper cover with title and image of car driving at speed with blurred outlookFree Download

The company hopes that by supporting these widely adopted data formats, it can help eliminate barriers that prevent organisations from getting the full value from their data.

The tech giant is also unifying two of its business intelligence products, Looker and Google Data Studio, under the new Looker umbrella to create a deep integration of Looker, Data Studio, and core Google technologies like AI and ML. This means Data Studio has now become Looker Studio, and Google hopes this will help customers make better data-driven decisions. 

It says Looker Studio helps to make it easier to carry out self-service analytics. It currently supports more than 800 data sources with a catalogue surpassing 600 connectors, which it says makes it simple to explore data from different sources.

Looker data models from Looker Studio are currently available in preview. This allows customers to explore trusted data via the Looker modelling layer, and for the first time they will be able to combine both self-service analytics from ad-hoc data sources with trusted data that has already been vetted and modelled in Looker.

Additionally, customers who upgrade to Looker Studio Pro will get new enterprise management features, team collaboration capabilities, and SLAs. The tech giant underlined that this is only the first release, and it has developed a roadmap of capabilities, including Dataplex integration for data lineage and metadata visibility, which enterprise customers have been asking for. 

Google Cloud also shared that Looker (Google Cloud core) is in preview. This is a new version of Looker available on the Google Cloud Console and is deeply integrated with core cloud infrastructure services, such as key security and management services. 

Enhancements for Looker and BigQuery with Microsoft Power BI have been introduced, too, with Google Cloud branding the move a significant step forward in providing customers with the most open data cloud. It said this means Tableau and Microsoft customers can easily analyse trusted data from Looker and seamlessly connect with BigQuery.

Google Cloud also said that a data cloud should enable organisations to bring together all of their data confidently, which helps ensure that data is of high quality and enables strong, flexible management and governance capabilities.

To address this, the company is updating Dataplex which will automate common processes associated with data quality. For example, users will now be able to more easily understand data lineage — where data originates and how it has transformed and moved over time — reducing the need for manual, time-consuming processes.

“The ability to let our customers work with all kinds of data, in the formats they prefer, is the hallmark of an open data cloud,” said Gerrit Kazmaier, VP and GM of Data Analytics at Google Cloud. “We’re committed to delivering the support and integrations that customers need to remove limits from their data and avoid data lock-in.”

Google Cloud confirmed its ambition to create "the most open, extensible, and powerful data cloud" on the market. It wants customers to be able to utilise all their data from as many sources and in as many formats as necessary.

Featured Resources

2022 State of the multi-cloud report

What are the biggest multi-cloud motivations for decision-makers, and what are the leading challenges

Free Download

The Total Economic Impact™ of IBM robotic process automation

Cost savings and business benefits enabled by robotic process automation

Free Download

Multi-cloud data integration for data leaders

A holistic data-fabric approach to multi-cloud integration

Free Download

MLOps and trustworthy AI for data leaders

A data fabric approach to MLOps and trustworthy AI

Free Download

Recommended

2022 IBM's Security X-Force cloud threat landscape report
Whitepaper

2022 IBM's Security X-Force cloud threat landscape report

22 Nov 2022
The Total Economic Impact™ Of Turbonomic Application Resource Management
Whitepaper

The Total Economic Impact™ Of Turbonomic Application Resource Management

22 Nov 2022
Build innovation, intelligence and sustainability into your industrial processes, with the cloud
Whitepaper

Build innovation, intelligence and sustainability into your industrial processes, with the cloud

9 Nov 2022
Hybrid cloud for video surveillance
Whitepaper

Hybrid cloud for video surveillance

9 Nov 2022

Most Popular

Empowering employees to truly work anywhere
Sponsored

Empowering employees to truly work anywhere

22 Nov 2022
Salesforce co-CEO Bret Taylor resigns with cryptic parting message
Business operations

Salesforce co-CEO Bret Taylor resigns with cryptic parting message

1 Dec 2022
The top 12 password-cracking techniques used by hackers
Security

The top 12 password-cracking techniques used by hackers

14 Nov 2022