4/22/2023 0 Comments File archives tool![]() ![]() KeyUtil - A utility for creating and parsing null-byte separated strings into/from Text objects. ![]() FileDataQuery - Retrieves file data based on the hash of the file.FileDataIngest - Takes a list of files and archives them into Accumulo keyed on hashes of the files.ChunkInputStream - An input stream over file data stored in Accumulo.ChunkInputFormat - An Accumulo InputFormat that provides keys containing file info (ListChunkCombiner - An Iterator that dedupes file data and sets their visibilities to a combined visibility based on current references to the file data.CharacterHistogram - A MapReduce that computes a histogram of byte frequency for each file and stores the histogram alongside the file data.Files with duplicate data are only stored once. This example archives file data into an Accumulo table. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |