02/28/2018
What's new at ANRG? We recently released open source code for Jupiter, a novel system for dispersed computing (a generalization of grid computing, intended to handle more distributed and dynamic data-driven applications and dynamic networks). Jupiter automates the distributed scheduling and running of software that can be described by a computational task graph across a large number of (potentially geographically-distributed) computing nodes. It includes an implementation of WAVE, a novel framework for distributed task scheduling. As a sample dispersed computing application for testing, benchmarking and evaluation, we also developed and released a distributed network anomaly detection application (https://github.com/ANRGUSC/coded-dnad) that includes novel coded computing techniques developed and implemented by our colleagues Prof. Avestimehr, Annavaram and their groups, also from the USC EE department. Jupiter also includes a re-factored version of CIRCE, a task dispatch and run-time ex*****on environment for dispersed computing that we had originally developed and released last year as a stand-alone providing centralized scheduling. We have tested Jupiter on a 100-node cloud with nodes distributed across a dozen locations around the world; in principle it can handle even larger systems.
Jupiter is an Orchestrator for Dispersed Computing