Ask Your Question
0

What is the problem with hive indexing when dealing with partitioned tables?

asked 2023-06-20 11:47:39 +0000

nofretete gravatar image

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
2

answered 2023-06-20 11:50:01 +0000

djk gravatar image

The problem with hive indexing when dealing with partitioned tables is that the index is created on the entire table instead of just one partition, which can be inefficient and slow down queries. This is because hive indexes need to be rebuilt every time a new partition is added or an existing partition is modified. Additionally, the size of the index becomes too large to handle efficiently as the number of partitions increases. To overcome this problem, it is recommended to create partition-specific indexes or use an external indexing system like Apache Solr or Elasticsearch.

edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account. This space is reserved only for answers. If you would like to engage in a discussion, please instead post a comment under the question or an answer that you would like to discuss

Add Answer


Question Tools

Stats

Asked: 2023-06-20 11:47:39 +0000

Seen: 8 times

Last updated: Jun 20 '23