ThreeSharp Forum Rss Feed

New Post: How to get a file from a bucket and then store it in another bucket

edfilesharp — Fri, 19 Oct 2012 20:00:27 GMT

I would like to know how can I get the a file from a bucket and then store it in another one. I tried the follwing method:

 ///  /// Gets a file object from a bucket, and streams it to disk ///  
 public void GetFileObject(String bucketName, String keyName, String localfile)
 {
   ObjectGetRequest objectGetRequest = new ObjectGetRequest(bucketName, keyName); 
   ObjectGetResponse objectGetResponse = _service.ObjectGet(objectGetRequest); 
   objectGetResponse.StreamResponseToFile(localfile); 
  }

But instead of sending it to the disk I would like to stream it some how and re send it but to a different bucket. How can I do this?.

New Post: Range for headers.

hreinn — Sun, 07 Oct 2012 17:55:57 GMT

It seems HttpWebRequest doesn't allow you to use the "Range" header directly, so I had to modify the project,

In private HttpWebRequest ConfigureWebRequest(Request request)

I added

if (request.UseRange)
httpWebRequest.AddRange(request.RangeFrom, request.RangeTo);

And three public members in the Request class,

public bool UseRange = false;
public int RangeFrom = 0;
public int RangeTo = 0;

New Post: Custom server URLs

ghelyar — Wed, 03 Oct 2012 12:51:44 GMT

As far as I can tell, ThreeSharp currently only uses the standard US Amazon S3 server (s3.amazonaws.com) and cloudfront (cloudfront.amazonaws.com).

There are other S3 servers, such as regional services (for example s3-eu-west-1.amazonaws.com for EU Ireland) and resellers (for example DreamHost DreamObjects objects.dreamhost.com).

This quick fix to Affirma.ThreeSharp.ThreeSharpConfig allows a custom server to be set. If no server is set, it uses the existing behaviour of switching between cloudfront and US standard S3 based on ThreeSharpServiceType. If Server property is set to null, it will also revert back to this behaviour.

ThreeSharpConfig .cs:

private string server;

/// <summary>
/// Server
/// </summary>
public String Server
{
    get { return this.server == null ? this.GetServerByType() : this.server; }
    set { this.server = value; }
}

thoughts?

New Post: Transport forcibly closed when trying to upload

wiadran — Wed, 02 Feb 2011 15:10:57 GMT

John,

thanks a lot for answering so fast. It seems that there's no possibility to overcome the subject and that is a helpful information as well, it's not a good news perhaps...

We've already had the resending mechanism, but sometimes it's not enough in our case while connection is closed so often. As I noticed it's much more often when uploading for https address, for http all seems working better. Using secure connection is very important for us. It seems that it's going to be necessary to contact support after all.

Thanks again & regards

New Post: Transport forcibly closed when trying to upload

johnlu_78759 — Wed, 02 Feb 2011 14:02:15 GMT

wiadran,

I ended up going through several cycles of interaction with Amazon engineers in July and August 2008, doing things like running Wireshark on my end while on the phone with them while they were doing diagnostics on their side. Along the way, they indicated that they were doing a "network configuration change that we believe will help to address some of the packet loss you are occasionally seeing," but unfortunately I can no longer pull up the full support case history on the Amazon site for some reason, so I can't provide any more details about what they did.

From my perspective, something that they did seemed to ease the problem significantly, but I also took the precaution of adding retry logic to the upload/download operations in my product code. Now the user doesn't get any kind of an error message unless an upload or download fails after three consecutive attempts. I'm honestly not sure how often this has occurred on the client side, but I can report that we do see occasional failures during a weekly archiving operation that we do--maybe one out of every few hundred large downloads. We just live with that now and pick up any failures a week later, and it evidently hasn't been a significant enough problem for our end-users that they have reported it.

Sorry I don't have more helpful information for you,

John

network configuration change that we believe will help to address some of the packet loss you are occasionally seeing

New Post: Transport forcibly closed when trying to upload

wiadran — Wed, 02 Feb 2011 10:05:35 GMT

Hello all, John

I've encountered identical problem in our application while uploading files to S3 (same exception), while googling I've found this topic here, so I thought that maybe you have found some kind of solution to overcome this connection forcibly closed.

I'll be really grateful for any information

New Post: Use within Silverlight Upload App

m1is — Mon, 16 Aug 2010 23:02:30 GMT

Thanks to the client stack I am able to add custom headers and set ACLs on PUT requests and I am also able to read back the headers through HEAD requests.

New Post: Use within Silverlight Upload App

dhorne41 — Mon, 16 Aug 2010 19:35:55 GMT

That's almost exactly the route I took, except using POST. I wasn't sure what hte capabilities were for adding custom META tags and setting ACL's via the PUT method (and using SSL) so I opted for POST because it let me accomplish all of it.

New Post: Use within Silverlight Upload App

m1is — Mon, 16 Aug 2010 19:32:50 GMT

I ended up using the client stack for my requests instead of the browser stack and all my troubles went away. Before I discovered the client stack I tried POST for uploading but in the end found it much easier with the REST/PUT via the client stack. Also since I am using the client stack I can disable read and write stream buffering for uploads and downloads and include a progress indicator. I've been testing uploading and downloading of a 1 GB file without any issues.

New Post: Use within Silverlight Upload App

dhorne41 — Mon, 16 Aug 2010 13:47:32 GMT

m1is -

The problem is that with Silverlight versions prior to Silverlight 4 there was no way to disable write stream buffering. The class library we build that I linked in my previous reply constructs a POST, but it uses Silverlight 4. It also disables buffering and reports progress back to the UI. The problem with using Silverlight 3 and below and not being able to disable the buffering is:

1. You cannot get progress for your uploads.

2. The entire file is buffered in browser memory, even if you specify to use ClientHTTP.

So since the entire file would be buffered, if you were uploading a 1 Gig file, you would consume 1 gig of RAM, which is bad for the client. I put a lot of time into communicating with the Silverlight dev team to get them to allow for unbuffered uploads with Silverlight 4. Our class library is priced at $99, you should at least go read the documentation. It may save you a lot of time and effort.

New Post: Use within Silverlight Upload App

m1is — Mon, 26 Jul 2010 18:17:40 GMT

I've been messing around with this library trying to port it over to Silverlight. From what I've found using the HttpWebRequest class to upload files via the S3 REST interface is not possible because using the PUT verb for the Method property is not supported. I image the best solution would be to derive a new class S3WebRequest from the WebRequest abstract class and go from there.

I've been able to port it over for downloading files though. Although from what I've found the HttpWebRequest does not support adding custom headers when using the GET verb so I had to use a query string method instead. If anyone wants me to post an example of my code just let me know.

For my purposes all I need to do is download and would like to figure out a solution to upload. Is there any other way to upload to S3 other than using the REST interface?

New Post: Use within Silverlight Upload App

DustinHorne — Fri, 07 May 2010 18:36:03 GMT

We just finished created an S3 Upload library. It will upload files up to 5 GB (the Amazon S3 size limit). It uses a stream for uploading so the file isn't cached in memory and it uses an event model so you can report upload progress back to your users. I've also built it to use good security practices and discourage you from storing your AWS Secret Key in your silverlight app and by defualt it uploads to S3 using SSL, but you can disable that via a UseSSL property if you'd like. There's sample code and more information on the site.

Here's the link if you're interested in downloading the trial. We're also interested in building a base of beta testers for new versions as well which would include some free licensing. If you're interested, check out the trial and fill out the contact form on the site.

http://www.parentelement.com/products/slights3

New Post: wrapper.AddFileObject gives me a Concurrent IO...error

Hanover — Mon, 15 Mar 2010 19:19:50 GMT

Using ThreeSharp.Query I played around with the config options and got it to work.

New Post: wrapper.AddFileObject gives me a Concurrent IO...error

Hanover — Mon, 15 Mar 2010 18:01:28 GMT

Hi there,

I've spent a good hour just trying to upload a file to our S3 server using the wrapper with no luck. When I call wrapper.AddFileObject(bucket, fileName, sourceFilePath); I keep getting "The stream does not support concurrent IO read or write operations."

What am I missing? I've tried to switch this.config.Format = CallingFormat.SUBDOMAIN with no luck...

Thanks in advance.

New Post: Web service connection timeout on API

webcloudsolutions — Wed, 10 Mar 2010 23:51:48 GMT

Hi there,

Im using the follow code to connect to Amazon S3 to list contents of a bucket:

And I get the following error: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond 207.171.191.241:443

            ThreeSharpWrapper wrapper = new ThreeSharpWrapper(AccessKeyID, SecretAccessKey);

            Response.Write( wrapper.ListBucket(strBucket));

When I ping:

P:\>ping 207.171.191.241

Pinging 207.171.191.241 with 32 bytes of data:

Request timed out.
Request timed out.
Request timed out.
Request timed out.

Ping statistics for 207.171.191.241:
Packets: Sent = 4, Received = 0, Lost = 4 (100% loss),

New Post: Where is the latest source code?

meboz — Thu, 04 Mar 2010 05:18:56 GMT

Howdy,

To be honest, this is one of the most frustrating open-source projects im currently dealing with.

Where is the latest source? The Source.zip file on the homepage has version 2.0 in the readme.txt, yet apparently the project is at 2.2

Also, why cant we check the source out of svn?

I need some answers here as there are some serious unresolved timeout issues with unclosed http connections.

I feel like this project should be forked and put up on git.

New Post: How to set Expire Http Header when uploading file

stuartlodge — Sun, 14 Feb 2010 22:08:28 GMT

Thanks for posting this - most helpful!

One question - why have you set ACL to public-read-write, rather than just public-read?

New Post: [newbie] Affirma.ThreeSharp.ThreeSharpException: The request signature we calculated does not match the signature you provided. Check your key and signing method..

Chiliyago — Sun, 31 Jan 2010 15:50:55 GMT

Make sure you wrap your request strings with System.Web.HttpUtility.UrlEncode() to be sure spaces and other things are properly converted for the web!

New Post: Medium Trust

qorbani — Wed, 25 Nov 2009 18:54:07 GMT

Does this Library works under Medium Trust Hosting Enviroments?

I'm working on Hosted File Management which required to store and retrieve files from S3 or any other Cloud Storages, but only issue for me is the API should work under Medium Trust.

I would appreciate any comments.

Regards,

New Post: Need help to upload file on S3 with C#

dhavalg2006 — Tue, 10 Nov 2009 12:50:33 GMT

Hi,

I want to implement the concept of Amazon CDN for my project, where by during Upload Video section, the file will be added on my created Bucket. And in the video detail page, i will be using the formatted URL, i.e. http://s3.amazonaws.com/[bucketname]/[filename]. I am reviewing Affirma.ThreeSharp code for my task, but need your help to get the output. In other words, you can guide me, which functions & their class to be used for my activity.

If in case, there is any query, from my question, then let me know. Thanks for your support. Waiting for your update.

Regards,

Dhaval Gandhi