Re: [Duplicity-talk] Duplicity error with s3-eu-central-1.amazonaws.com

[Christian Saga]

Hi Edgar, Hi Nicolas,
thanks for your response

@Edgar:
1. does the bucket exist prior to running the backup?
>Tried both, didn't work

2. can you try to use the latest boto?
>How do I do that? 

3. what's your duplicity version?
>0.6.23-1ubuntu4.1

@Nicolas:
>I tried what you described, however the error still persists.
>Below some logging:

Start duply v1.5.10, time is 2015-01-08 21:38:12.
Using profile '/home/christian/.duply/Christian-ThinkPad'.
Using installed duplicity version 0.6.23, python 2.7.6, gpg 1.4.16 (Home: 
~/.gnupg), awk 'GNU Awk 4.0.1'.
Autoset found secret key of first GPG_KEY entry 'XXXXXXXX' for signing.
Test - Encrypt to XXXXXXXX & Sign with XXXXXXXX (OK)
Test - Decrypt (OK)
Test - Compare (OK)
Cleanup - Delete '/tmp/duply.24702.1420749492_*'(OK)

--- Start running command PRE at 21:38:13.037 ---
Running '/home/christian/.duply/Christian-ThinkPad/pre' - OK
--- Finished state OK at 21:38:13.055 - Runtime 00:00:00.018 ---

--- Start running command BKP at 21:38:13.069 ---
Benutze Archiv-Verzeichnis: 
/home/christian/.cache/duplicity/duply_Christian-ThinkPad
Benutze Sicherungs-Namen: duply_Christian-ThinkPad
Import of duplicity.backends.localbackend Succeeded
Import of duplicity.backends.megabackend Succeeded
Import of duplicity.backends.botobackend Succeeded
Import of duplicity.backends.webdavbackend Succeeded
Import of duplicity.backends.u1backend Succeeded
Import of duplicity.backends.rsyncbackend Succeeded
Import of duplicity.backends.dpbxbackend Succeeded
Import of duplicity.backends.hsibackend Succeeded
Import of duplicity.backends.imapbackend Succeeded
Import of duplicity.backends.cfbackend Succeeded
Import of duplicity.backends.sshbackend Succeeded
Import of duplicity.backends.gdocsbackend Succeeded
Import of duplicity.backends.swiftbackend Succeeded
Import of duplicity.backends.ftpsbackend Succeeded
Import of duplicity.backends.ftpbackend Succeeded
Import of duplicity.backends.tahoebackend Succeeded
Lese ausdruckbasierte Dateiliste 
/home/christian/.duply/Christian-ThinkPad/filelist.txt
Lese ausdruckbasierte Dateiliste 
/home/christian/.duply/Christian-ThinkPad/exclude
Hauptaufgabe: inc
================================================================================
duplicity 0.6.23 (January 24, 2014)
Args: /usr/bin/duplicity --name duply_Christian-ThinkPad --encrypt-key XXXXXXXX 
--sign-key XXXXXXXX --verbosity 9 --include-globbing-filelist 
/home/christian/.duply/Christian-ThinkPad/filelist.txt --s3-use-new-style 
--s3-european-buckets --full-if-older-than 1M --volsize 50 
--exclude-globbing-filelist /home/christian/.duply/Christian-ThinkPad/exclude / 
s3://s3-eu-central-1.amazonaws.com/XX/backup
Linux Christian-ThinkPad 3.13.0-37-generic #64-Ubuntu SMP Mon Sep 22 21:28:38 
UTC 2014 x86_64 x86_64
/usr/bin/python 2.7.6 (default, Mar 22 2014, 22:59:56) 
[GCC 4.8.2]
================================================================================
Benutze temporäres Verzeichnis /tmp/duplicity-Vamu0I-tempdir
Registriere (mkstemp) temporäre Datei 
/tmp/duplicity-Vamu0I-tempdir/mkstemp-rxuJjJ-1
3781853184 temporärer Speicherplatz ist verfügbar, das Backup wird ungefähr 
68157440 nutzen.
Releasing lockfile <lockfile.LinkFileLock instance at 0x7f299927b8c0>
Entferne temporäre Datei /tmp/duplicity-Vamu0I-tempdir/mkstemp-rxuJjJ-1
Backend Fehler Detail: Traceback (most recent call last):
  File "/usr/bin/duplicity", line 1494, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 1488, in with_tempdir
    fn()
  File "/usr/bin/duplicity", line 1337, in main
    do_backup(action)
  File "/usr/bin/duplicity", line 1366, in do_backup
    sync_archive(decrypt)
  File "/usr/bin/duplicity", line 1099, in sync_archive
    remlist = globals.backend.list()
  File "/usr/lib/python2.7/dist-packages/duplicity/backend.py", line 430, in 
list
    return map(tobytes, self._list())
  File "/usr/lib/python2.7/dist-packages/duplicity/backends/_boto_single.py", 
line 270, in _list
    raise BackendException("No connection to backend")
BackendException: No connection to backend

--- Finished state FAILED 'code 23' at 21:38:13.432 - Runtime 00:00:00.363 ---

--- Start running command POST at 21:38:13.445 ---
Skipping n/a script '/home/christian/.duply/Christian-ThinkPad/post'.
--- Finished state OK at 21:38:13.460 - Runtime 00:00:00.015 ---


Regards
  Christian

> Hello
> 
> On Wed, Jan 7, 2015 at 2:48 PM, Edgar Soldin wrote:
> 
> > On 07.01.2015 00:11, Christian Saga wrote:
> > >
> > >
> > > Hi there,
> > > I wanted to switch to the new S3 datacenter in Frankfurt, however when
> > > doing so, I receive a 403 error. Similar to what was described in a
> > > question asked on launchpad:
> > > https://answers.launchpad.net/duplicity/+question/256418
> > >
> > > However no one is picking this up? Does anyone here have a solution or
> > > idea what to do?
> > >
> >
> >
> I encountered the same issue. Here is how to make it work: before using
> duplicity, set the following environment variable
> S3_USE_SIGV4="True"
> 
> and use the full url to access your bucket, e.g.
> duplicity [your options here] s3://
> s3-eu-central-1.amazonaws.com/my_own_bucket
> 
> 
> check this http://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region
> and
> http://stackoverflow.com/questions/26744712/s3-using-boto-and-sigv4-missing-host-parameter
> (among other links)
> 
> Regards
> Nicolas