[SERVER-13678] filemd5 should support an arbitrary range of chunks to hash Created: 22/Apr/14  Updated: 03/Sep/14  Resolved: 03/Sep/14

Status: Closed
Project: Core Server
Component/s: GridFS
Affects Version/s: 2.6.0
Fix Version/s: None

Type: Improvement Priority: Major - P3
Reporter: Robert Ditthardt Assignee: Ramon Fernandez Marina
Resolution: Incomplete Votes: 0
Labels: gridfs, query
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Participants:

 Description   

My specific use case is implementing copy on write in my gridfs driver.

I would like to update some chunks in a very large file and then use filemd5 to hash just the chunks that I wrote. I could then compare that hash to the hash of the chunks that I have written to in memory to make sure the entire write succeeded. If the hashes match, I would make them permanent. Otherwise, I would roll back the write.

As you can see, I don't really have a performant workaround for this particular use case... My only option is to filemd5 the entire file, which is inefficient.



 Comments   
Comment by Ramon Fernandez Marina [ 03/Sep/14 ]

dditthardt, we haven't heard back from you for a while, so we're going to mark this issue as resolved. If you want to pursue this improvement feel free to reopen the ticket and provide more details on your use case(s).

Regards,
Ramón.

Comment by Ramon Fernandez Marina [ 19/Aug/14 ]

dditthardt, we haven't heard from you for a while. If you are still interested in pursuing this improvement, could you please follow up and provide further details on your use case(s)?

Thanks,
Ramón.

Comment by Ramon Fernandez Marina [ 22/Jul/14 ]

dditthardt, can you please elaborate further on your use case? The more information you can provide the better we can determine how to best address your needs here.

Comment by Robert Ditthardt [ 23/Apr/14 ]

What would be even better would be to allow specification of a query to match the chunks the user wants to find, and also what field to use. Then, make filemd5 a wrapper around this generic md5 command.

Generated at Thu Feb 08 03:32:31 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.