Coscine Python API Large Upload Error [20230928-0823]
We received an issue from the customer, who is wondering about the upload speed. After 2 hours uploading he receives the following error (I redacted the PID in the url):
---------------------------------------------------------------------------
HTTPError Traceback (most recent call last)
File ~/anaconda3/envs/iambjudas/lib/python3.9/site-packages/coscine/client.py:382, in Client._request(self, method, uri, **kwargs)
381 response = self.session.request(method, uri, **kwargs)
--> 382 response.raise_for_status()
383 logger.debug("response: %s", str(response.content))
File ~/anaconda3/envs/iambjudas/lib/python3.9/site-packages/requests/models.py:1021, in Response.raise_for_status(self)
1020 if http_error_msg:
-> 1021 raise HTTPError(http_error_msg, response=self)
HTTPError: 500 Server Error: Internal Server Error for url:
https://coscine.rwth-aachen.de/coscine/api/Coscine.Api.Blob/Blob/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX?path=Raw%2BData.zip
The above exception was the direct cause of the following exception:
RuntimeError Traceback (most recent call last)
Cell In[7], line 2
1 metadata = form.generate()
----> 2 resource.upload(File, FileAddress, metadata)
File ~/anaconda3/envs/iambjudas/lib/python3.9/site-packages/coscine/resource.py:537, in Resource.upload(self, key, file, metadata, callback)
535 with open(file, "rb") as file_handle:
536 self._upload_file_metadata(key, metadata)
--> 537 self._upload_file_data(key, file_handle, callback)
538 else:
539 raise TypeError("Argument `file` has unexpected type!")
File ~/anaconda3/envs/iambjudas/lib/python3.9/site-packages/coscine/resource.py:571, in Resource._upload_file_data(self, key, file_handle, callback)
569 headers = {"Content-Type": monitor.content_type}
570 params = {"path": key}
--> 571 self.client.put(uri, data=monitor, headers=headers, params=params)
File ~/anaconda3/envs/iambjudas/lib/python3.9/site-packages/coscine/client.py:463, in Client.put(self, uri, **kwargs)
432 def put(self, uri: str, **kwargs) -> requests.Response:
433 """
434 Performs a PUT request to the Coscine API.
435
(...)
460 The response of the Coscine server as a requests.Response object.
461 """
--> 463 return self._request("PUT", uri, **kwargs)
File ~/anaconda3/envs/iambjudas/lib/python3.9/site-packages/coscine/client.py:390, in Client._request(self, method, uri, **kwargs)
388 if exc.response.status_code == 401:
389 raise PermissionError("Invalid Coscine API token!") from exc
--> 390 raise RuntimeError(
391 "Unspecified error occurred when communicating "
392 "with the Coscine servers"
393 ) from exc
RuntimeError: Unspecified error occurred when communicating with the Coscine servers
@romin.benfer is the abortion of the upload process due to a time out?