BigData Express Docker Manual

This manual discusses deployment, configuration, and operation of BigData Express in Docker containers. If you are operating BigData Express in a non-container environment, you should follow BigData Express Administrator Manual.

Big Data Express (BDE) is a data transfer tool developed at Fermi National Accelerator Laboratory. BDE seeks to provide schedulable, predictable, and high-performance data transfer service in big data and high-performance computing environments. Please visit BDE project website for more details.

mdtmFTP is BDE’s default data transfer engine. Detailed information on mdtmFTP is available at MDTM website.

BDE makes use of CILogon single-point sign-on service to obtain X.509 certificates for secure acces to data transfer cyberinfrastructure.

If you have questions about the project, or need assistance, please contact the team at Fermilab:

Intended audience

This document is intended for engineers and system administrators who need to operate, configure, and deploy BigData Express.

You are expected to have basic Linux/Unix system administration skills, command line expertise, and familiarity with Docker.