Data sharing from Comet and Gordon clusters using SeedMe.org
11/04/2015 13:00 - 11/04/2015 14:00 CSTwebcast
- Registration open date
- 09/29/2015 09:00 CDT
- Registration close date
- 11/04/2015 10:00 CST
- Class size restriction
- 50 registrants
(44 spots left)
- Amit Chourasia
- Contact phone
- Contact email
Research projects involving scientific computing are now increasingly collaborative and performed on high performance clusters. These clusters offer significant computing capacity and capability to carry out several computation and analysis in parallel or distributed manner. However, the tools and policies on clusters are single user centric and impose restrictions on how processed data and computed results can be accessed and shared with research team. Furthermore, the tools and policies vary on different clusters making the sharing process non-portable and laborious. To overcome these gaps we have developed the SeedMe (Stream Encode Explore and Disseminate My Experiments) platform that offers easy to use sharing infrastructure and tools. These tools could be used in ad-hoc or automated manner that are conducive to batch computing needs of researchers.
This webcast tutorial aims to provide rapid hands-on training for researchers to take advantage of SeedMe resource by providing hands on introduction and exercises to easily share data from Comet and Gordon clusters. The following topics will be covered in the tutorial
- Short overview of SeedMe
- Sample use cases
- Automation setup on Comet and Gordon (hands on)
- Upload content using command line (hands on)
- Upload content programmatically using Python (hands on, python knowledge in not required)
- Familiarity with using any command line tools
- Please register for an account on SeedMe.org. This is required for hands on exercises.
- Account on Comet or Gordon cluster. Please contact us if you don’t have an account.
Amit Chourasia, SDSC (Project leader: SeedMe.org)