We'd run GCMU on the machine hosting the service. Then the file is local to the service or set of services that are apt to be using those files. On Apr 24, 2013, at 3:45 PM, Dan Olson wrote:

That's correct, the dtn's aren't visible to the service machines.

I think the easiest way imho to enable that integration is through: a. a shock fuse mount on the dtn b. a dtn "mailbox" to shock (which we've used before on the ornl variation service) c. a gridftp plugin for shock

Maybe I'm not seeing GCMU in the same light, how would you envision a file transfer through GCMU getting to a service?

----- Original Message -----

...

From: "Robert Olson" <[email protected]> To: "Dan Olson" <[email protected]> Cc: [email protected] Sent: Wednesday, April 24, 2013 3:15:04 PM Subject: Re: [Kbase-core] Globus online

I mentioned gcmu because as far as I know the dtn isn't visible from any of the service machines, is it? Say I upload my 4GB sample file via GO; how does my service see it to process it?

On Apr 24, 2013, at 3:10 PM, Dan Olson wrote:

...

We do have the dtn's defined in GO. kbase-chicago, and kbase-knoxville are defined.

In order to use shock directly we need to figure out the optimal way to display the shock data as a filesystem abstraction. I think this should be a priority for the shock developers.

GCMU isn't required to use globus connect. You can fire up globus connect and transfer data to the kbase DTNs today. However, you have to use your developer credentials to auth.

We are trying to get GCMU installed on some KBase endpoints to support richer user-user sharing of data. The globus connect to standard gridftp interface just puts the data down on the filesystem with no good way to link it to accounts outside of unix perms on the DTN.

----- Original Message -----

...

From: "Robert Olson" <[email protected]> To: [email protected] Sent: Wednesday, April 24, 2013 2:55:13 PM Subject: [Kbase-core] Globus online

Do we have any KBase Globus Online endpoints defined? It seems it would make sense to have ADM storage visible via both Globus Online and Shock. Since Shock doesn't supply any real upload support (the client application doesn't seem to do much from my read of it) it would make sense to utilize GO to provide high performance upload.

With Globus Connect (a client-side application that appears to integrate nicely with the Mac at least), we could enable high performance up/downloads between user systems and KBase.

This seems related - globus connect multiuser https://www.globusonline.org/gcmu/ and would be required on the KB transfer node (it requires firewall be opened).

The context of this is enabling real-life large file upload for KB users without forcing them to handle the huge details required since the Shock folks don't care to make things easy for the end user. _______________________________________________ Kbase-core mailing list [email protected] https://lists.kbase.us/mailman/listinfo/kbase-core