ccl.cse.nd.edu
Makeflow = Make + Workflow - Cooperative Computing Lab
http://ccl.cse.nd.edu/software/makeflow
Makeflow = Make Workflow. Makeflow is a workflow engine. For executing large complex workflows on clusters, clouds, and grids. Makeflow is very similar to traditional Make, so if you can write a Makefile, then you can write a Makeflow. Makeflow is portable. A workflow is written in a technology neutral way, and then can be deployed to a variety of different systems without modification, including local execution on a single multicore machine as well as batch systems like HTCondor. Patrick Donnelly and Do...
ccl.cse.nd.edu
Cooperative Computing Lab
http://ccl.cse.nd.edu/software/autobuild
Cctools-current-i386-osx-10.6.tar.gz. Cctools-current-x86 64-centos5.tar.gz. Cctools-current-x86 64-centos6.tar.gz. Cctools-current-x86 64-centos7.tar.gz. Cctools-current-x86 64-debian8.tar.gz. Cctools-current-x86 64-osx-10.9.tar.gz. Cctools-current-x86 64-redhat5.tar.gz. Cctools-current-x86 64-redhat6.tar.gz. Cctools-current-x86 64-redhat7.tar.gz. Cctools-current-x86 64-ubuntu14.04.tar.gz. Build and Test History. Add umbrella spec for an easy makeflow. Tue, Aug 23, 2016. Mon, Aug 22, 2016. Merge pull re...
ccl.cse.nd.edu
Cooperative Computing Lab
http://ccl.cse.nd.edu/reu
Undergraduate Research (REU) in Cooperative Computing. The Cooperative Computing Lab has many opportunities for undergraduate students to participate in research. Students from around the country may apply for NSF-sponsored research projects during the summer. Students at Notre Dame may also perform research for credit during the school year. Summer 2016 REU Session. The CCL is participating in the Data Intensive Scientific Computing. REU; please apply through that program. Summer 2013 REU Session.
ccl.cse.nd.edu
The Chirp Distributed File System - Cooperative Computing Lab
http://ccl.cse.nd.edu/software/chirp
The Chirp Distributed Filesystem. Chirp is a user-level file system for collaboration across distributed systems such as clusters, clouds, and grids. Chirp allows ordinary users to discover, share, and access storage, whether within a single machine room or over a wide area network. Chirp requires no special privileges. When used with Parrot. Chirp is easy to deploy. Chirp Protocol Version 2. Chirp @ Notre Dame. Showing papers with tag chirp. Patrick Donnelly and Douglas Thain,. Data Locality Techniques ...
cse.nd.edu
Datalab
http://www.cse.nd.edu/~ccl/software/datalab
The Cooperative Computing Lab. Datalab is an interactive platform for distributed scientific computing. Datalab lets you store sets of data files that are much larger than a single disk can handle, then define special functions to perform work on that data. Data processing is done in parallel on each storage node, so users reap the benefit of both distributed storage and processing in a way that outperforms conventional storage-only distributed computing systems. DataLab Poster at HPDC 2008.
ccl.cse.nd.edu
The Parrot Virtual File System - Cooperative Computing Lab
http://ccl.cse.nd.edu/software/parrot
The Parrot Virtual File System. Parrot is a tool for attaching existing programs to remote I/O systems through the filesystem interface. For example, here's how to use Parrot with vi in order to edit a file on a remote file server:. Parrot run vi /chirp/server.nd.edu/mydata. Parrot "speaks" a variety of remote I/O services include HTTP, FTP, GridFTP. On behalf of ordinary programs. It works by trapping a program's system calls through the. And can be applied to almost any program. Conducting Reproducible...