[Duplicity-talk] Re: S3 and Large Sigtars

[Daniel Carleton]

Hey Guys,

Oops, found this in the tracker:

https://bugs.launchpad.net/duplicity/+bug/385495

- D

On Thu, Jun 24, 2010 at 6:48 PM, Daniel Carleton
<address@hidden> wrote:
> Hello List,
>
> I'm a grateful new duplicity user trying to do a full backup to S3.
> It looks like all the data makes it up there, but the signatures end
> up exceeding the max file size, resulting in:
>
> ...
>
> WARNING 1
> . Upload 
> 's3://s3.amazonaws.com/rieke-duplicity/duplicity-full-signatures.20100620T182934Z.sigtar.gz'
> failed (attempt #5, reason: error: [Errno 32] Broken pipe)
>
> WARNING 1
> . Giving up trying to upload
> s3://s3.amazonaws.com/rieke-duplicity/duplicity-full-signatures.20100620T182934Z.sigtar.gz
> after 5 attempts
>
> ERROR 23 BackendException
> . BackendException: Error uploading
> s3://s3.amazonaws.com/rieke-duplicity/duplicity-full-signatures.20100620T182934Z.sigtar.gz
>
> (Our "duplicity-full-signatures.20100620T182934Z.sigtar.gz" was a bit over 
> 5GB).
>
> From reading the code, I don't see anything about splitting up large
> files in backends.botobackend.  Seems like this would be easy to add
> -- should I go ahead or is there something I'm missing?
>
> Thanks,
>
> - Daniel
>