Ask Your Question
1

Why is the PutAzureBlobStorage processor in Apache Nifi overwriting the file instead of appending to it?

asked 2023-01-03 11:00:00 +0000

woof gravatar image

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
3

answered 2022-07-21 18:00:00 +0000

david gravatar image

The PutAzureBlobStorage processor in Apache Nifi is designed to write new content to an existing blob in Azure Blob Storage. By default, it overwrites the existing content with the new data. This behavior can be changed by setting the Azure Blob Storage property "overwrite" to "false", which tells the processor to append to the existing blob instead of overwriting it.

It is important to note that for the processor to append to the blob, the blob must be block blob (not page blob), and the content must be larger than the minimum block size (4MB). Additionally, a new block must be created for each write, and the blocks must be committed to the blob once all content has been written. So, while the processor can be configured to append to an existing blob, it may be less efficient than simply overwriting the blob.

edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account. This space is reserved only for answers. If you would like to engage in a discussion, please instead post a comment under the question or an answer that you would like to discuss

Add Answer


Question Tools

Stats

Asked: 2023-01-03 11:00:00 +0000

Seen: 7 times

Last updated: Jul 21 '22