Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.
Sign upComments
leeper
added
the
enhancement
label
Nov 20, 2016
This comment has been minimized.
This comment has been minimized.
You can currently rig this together using |
This comment has been minimized.
This comment has been minimized.
mbjoseph
commented
Apr 7, 2017
I'm just running across this with the same problem. I've taken a look at the API docs for multipart uploads and may be able to hack something together, but it would be awesome if there were a quick example that @leeper could share here (time permitting), and maybe even an example in the help page for |
This comment has been minimized.
This comment has been minimized.
This should be straightforward. Basically, Amazon recommends multipart uploads if file size is larger than 100MB. So, conditional on that,
Separately, this requires an abort upload procedure: http://docs.aws.amazon.com/AmazonS3/latest/API/mpUploadAbort.html, which will need to be a separate function. |
added a commit
that referenced
this issue
Apr 23, 2017
leeper
modified the milestone:
First stable release to CRAN
Apr 27, 2017
This comment has been minimized.
This comment has been minimized.
martenlindblad
commented
Aug 23, 2017
When I try
If I have |
added a commit
to amoeba/aws.s3
that referenced
this issue
Feb 8, 2018
This comment has been minimized.
This comment has been minimized.
amoeba
commented
Feb 8, 2018
I'm also getting a signature match error. While looking at the source, I saw this call to readBin: Line 75 in 72a632c My understanding of readBin is that it only reads the first byte when it's called without an > readLines("message.txt")
[1] "abcd"
> rawToChar(readBin("message.txt", raw()))
[1] "a"
> rawToChar(readBin("message.txt", raw(), file.size("message.txt")))
[1] "abcd\n" My PR attempts to fix this. Thoughts @leeper? After that change, I'm now getting another error, which I haven't debugged yet but it makes sense given the traceback:
I can look into that some other time. |
leeper
added
the
bug
label
Jul 26, 2018
This comment has been minimized.
This comment has been minimized.
This should now be fixed in the version on GitHub. |
leeper
closed this
in
d16d413
Jul 26, 2018
This comment has been minimized.
This comment has been minimized.
amoeba
commented
Jul 26, 2018
Thanks @leeper! |
This comment has been minimized.
This comment has been minimized.
himanshu-sikaria
commented
Dec 8, 2018
Can you add this to CRAN version as well? |
This comment has been minimized.
This comment has been minimized.
The new maintainer of this package is @acolum. Please check with them about release schedule. |
russellpierce commentedNov 19, 2016
It wasn't immediately obvious to me how you'd perform multipart uploads using aws.s3. The Java SDK has a high-level API for this sort of thing, perhaps
aws.s3
should as well. Ideally, one would put and the package would select for itself if multi-part uploads were called for.I've written methods for doing this using python and boto. Is the aim for aws.s3 to only use the web API or would a PR with this feature that used rPython or rJava be considered?