Re: [Duplicity-talk] OVHCloud's S3

[Kenneth Loafman]

Thanks for trying it.

It looks like the 400 error is a catchall for a lot of possible errors.  Would you go through the list here and check if any might apply to this case?

Our code for S3 has only minimal error reporting.  If I gave you a patch to improve it, would you be able to apply it?

...Ken

On Fri, May 12, 2023 at 2:26 PM Troels Arvin via Duplicity-talk <duplicity-talk@nongnu.org> wrote:

Hello,

Kenneth wrote:
>
>  1. try again and report back with a full traceback if not fixed.
>
Unfortunately, installing boto3 using pip didn't change anything:

#################################################

/usr/bin/python3 3.11.3 (main, Apr  5 2023, 00:00:00) [GCC 13.0.1
20230401 (Red Hat 13.0.1-0)]
================================================================================
Using temporary directory /tmp/duplicity-_d6rc1al-tempdir
Registering (mkstemp) temporary file
/tmp/duplicity-_d6rc1al-tempdir/mkstemp-9z_5oga1-1
Temp has 4056948736 available, backup will use approx 482344960.
Backtrace of previous error: Traceback (innermost last):
   File "/usr/lib64/python3.11/site-packages/duplicity/backend.py", line
387, in inner_retry
     return fn(self, *args)
            ^^^^^^^^^^^^^^^
   File "/usr/lib64/python3.11/site-packages/duplicity/backend.py", line
607, in list
     return [tobytes(x) for x in self.backend._list()]
                                 ^^^^^^^^^^^^^^^^^^^^
   File
"/usr/lib64/python3.11/site-packages/duplicity/backends/s3_boto3_backend.py",
line 172, in _list
     self.reset_connection()
   File
"/usr/lib64/python3.11/site-packages/duplicity/backends/s3_boto3_backend.py",
line 97, in reset_connection
     self.s3.meta.client.head_bucket(Bucket=self.bucket_name)
   File "/usr/lib/python3.11/site-packages/botocore/client.py", line
530, in _api_call
     return self._make_api_call(operation_name, kwargs)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
   File "/usr/lib/python3.11/site-packages/botocore/client.py", line
964, in _make_api_call
     raise error_class(parsed_response, operation_name)
  botocore.exceptions.ClientError: An error occurred (400) when calling
the HeadBucket operation: Bad Request

Attempt of list Nr. 1 failed. ClientError: An error occurred (400) when
calling the HeadBucket operation: Bad Request

#################################################

This is after installed removed the system's boto packages and instead
installed boto3 using "pip install --prefix=/usr ...".

Here's some info about the PIP packages:

[root@troels2 site-packages]# pip show jmespath s3transfer boto3
Name: jmespath
Version: 1.0.1
Summary: JSON Matching Expressions
Home-page: https://github.com/jmespath/jmespath.py
Author: James Saryerwinnie
Author-email: js@jamesls.com
License: MIT
Location: /usr/lib/python3.11/site-packages
Requires:
Required-by: boto3, botocore
---
Name: s3transfer
Version: 0.6.1
Summary: An Amazon S3 Transfer Manager
Home-page: https://github.com/boto/s3transfer
Author: Amazon Web Services
Author-email: kyknapp1@gmail.com
License: Apache License 2.0
Location: /usr/lib/python3.11/site-packages
Requires: botocore
Required-by: boto3
---
Name: boto3
Version: 1.26.133
Summary: The AWS SDK for Python
Home-page: https://github.com/boto/boto3
Author: Amazon Web Services
Author-email:
License: Apache License 2.0
Location: /usr/lib/python3.11/site-packages
Requires: botocore, jmespath, s3transfer
Required-by:

--
Regards,
Troels Arvin


_______________________________________________
Duplicity-talk mailing list
Duplicity-talk@nongnu.org
https://lists.nongnu.org/mailman/listinfo/duplicity-talk