Skip to content
This repository has been archived by the owner on Jul 9, 2018. It is now read-only.
/ exec Public archive

Common wrapper around process execution with high level docker support.

Notifications You must be signed in to change notification settings

travetto/exec

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

99 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

travetto: Exec

The exec module provides the necessary foundation for calling executables at runtime. Additionally special attention is provided to running docker containers.

Simple Execution

Just like child_process, the module exposes spawn, fork, and exec. These are generally wrappers around the underlying functionality. In addition to the base functionality, each of those functions is converted to a Promise structure, that throws an error on an non-zero return status.

A simple example would be

async function executeListing() {
  const [process, resultPromise] = spawn('ls');
  await resultPromise;
}

As you can see, the call returns not only the child process information, but the Promise to wait for. Additionally, some common patterns are provided for the default construction of the child process. In addition to the standard options for running child processes, the module also supports:

  • timeout as the number of milliseconds the process can run before terminating and throwing an error
  • quiet which suppresses all stdout/stderr output
  • stdin as a string, buffer or stream to provide input to the program you are running;
  • timeoutKill allows for registering functionality to execute when a process is force killed by timeout

Inter-process Communication (IPC)

Node provides ipc functionality out of the box, and this module builds upon this by providing enhanced event management functionality, as well as constructs for orchestrating multi-step processes.

Docker Support

Docker provides a unified way of executing external programs with a high level of consistency and simplicity. For that reason, the framework leverages this functionality to provide a clean cross-platform experience. The docker functionality allows you to interact with containers in two ways:

  • Invoke a single operation against a container
  • Spin up a container and run multiple executions against it. In this format, the container, once started, will be scheduled to terminate on Shutdown of the application.
async function runMongo() {
  const port = 10000;
  const container = new DockerContainer('mongo:latest')
    .createTempVolume('/var/workspace')
    .exposePort(port)
    .setWorkingDir('/var/workspace')
    .forceDestroyOnShutdown();

  container.run('--storageEngine', 'ephemeralForTest', '--port', port);
  await DockerContainer.waitForPort(port);

  return;
}

Command Service

While docker containers provide a high level of flexibility, performance can be an issue. CommandService is a construct that wraps execution of a specific child program. It allows for the application to decide between using docker to invoke the child program or calling the binary against the host operating system. This is especially useful in environments where installation of programs (and specific versions) is challenging.

  const converter = new CommandService({
    image: 'agregad/pngquant',
    checkForLocal: async () => {
      return (await spawn('pngquant -h')[1]).valid;
    }
  });

  async function compress(img) {
    const [proc, prom] = await converter.exec('pngquant', '--quality', '40-80', '--speed 1', '--force', '-');
    const out = `${img}.compressed`;

    fs.createReadStream(img).pipe(proc.stdin);
    proc.stdout.pipe(fs.createWriteStream(out));
    
    await prom;
  }