수납장

Speed up Amazon Athena Queries using Partition Projection

페이지 정보

작성자 Amazon Web Serv… 작성일21-01-04 00:00 조회7회 댓글0건

본문



Amazon Athena has added support for Partition Projection, a new functionality that you can use to speed up query processing of highly partitioned tables and automate partition management. When processing queries, Athena retrieves metadata information from your metadata store such as AWS Glue Data Catalog or your Hive Metastore before performing partition pruning. In cases when your tables have a large number of partitions, retrieving metadata can be time consuming.

To avoid this, you can use partition projection. Partition projection allows you to specify configuration information such as the patterns (for example, YYYY/MM/DD) that are commonly used to form partitions. This gives Athena the information necessary to build partitions without retrieving metadata information from your metadata store. Athena will read the partition values and locations from configuration, rather than from a repository like the AWS Glue Data Catalog.

Partition projection reduces the runtime of queries against highly partitioned tables since in-memory operations are often faster than remote operations. This video demonstrates partition projection in Athena.

Learn more about partition projection in Amazon Athena at - http://amzn.to/3mFDY3W

Subscribe:
More AWS videos http://bit.ly/2O3zS75
More AWS events videos http://bit.ly/316g9t4

#AWS

댓글목록

등록된 댓글이 없습니다.

Total 3,107건 1 페이지
게시물 검색
Copyright © www.uniticket.kr. All rights reserved.  Contact : help@oxmail.xyz