Google Announces Updates to BigQuery Data Warehouse • The Register

Google is promoting updates to its cloud-based data management portfolio with the goal of bringing structured and unstructured data analytics closer together.

In its cloud-based data warehouse BigQuery, Chocolate Factory announces support for unstructured data that users with adjacent capabilities in ML, speech recognition, computer vision, translation, and word processing can analyze using BigQuery’s familiar SQL interface.

Also new to the data warehouse is support for Apache Spark, the open-source analytics engine commonly used for data exploration and ML in data lakes. Google said the move would allow users to create BigQuery stored procedures with Spark that integrate with their SQL pipelines.

Meanwhile, BigLake, Google Cloud’s data lake product, would support Apache Iceberg spreadsheet format, with Databricks Delta format and Hudi streaming coming soon.

Gerrit Kazmaier, Veep and General Manager of Google Data Analytics, explains the reg that Google with its Open Data Cloud “wanted to standardize data across all data formats, across all clouds, all possible workloads and for all sides of the analysis”.

“Second, the Open Data Cloud enables a connected ecosystem. It’s really a platform for data providers to build their data applications on and innovate with us on behalf of our customers,” he said.

Keen observers might spot a trend here. Cloudera, the data lake company that grew out of the Hadoop world, has also announced its support for Iceberg. Data warehouse expert Teradata has announced a data lake as part of its data platform. And towards the end of 2020, Databricks announced support for SQL in its data lake as part of a plan to support BI-style workloads in its environment.

But just because users can move data warehousing and data lake jobs into the same environment doesn’t mean they will, said Miles Ward, CTO of data consultancy SADA The registry.

“The strategy here is not necessarily to move towards one strategy or the other as doing so risks trying to introduce a ‘one size fits all’ approach which can complicate things, but it is about exploring the core strengths of the Leverage Google Technology Create a flexible offering to better meet customers’ needs.

“The key here is that the architecture allows us to pick and choose every option we need, and the customer’s business needs dictate what the platform looks like, not the other way around.” ® Google Announces Updates to BigQuery Data Warehouse • The Register

Rick Schindler

World Time Todays is an automatic aggregator of the all world’s media. In each content, the hyperlink to the primary source is specified. All trademarks belong to their rightful owners, all materials to their authors. If you are the owner of the content and do not want us to publish your materials, please contact us by email – The content will be deleted within 24 hours.

Related Articles

Back to top button