HTMap is a library that wraps the process of mapping Python function calls out to an HTCondor pool. It provides tools for submitting, managing, and processing the output of arbitrary functions.
Our goal is to provide as transparent an interface as possible to high-throughput computing resources so that you can spend more time thinking about your own code, and less about how to get it running on a cluster.
Running a map over a Python function is as easy as
import htmap def double(x): return 2 * x doubled = list(htmap.map(double, range(10))) print(doubled) # [0, 2, 4, 6, 8, 10, 12, 14, 16, 18]
If you’re just getting started, jump into the first tutorial: First Steps.
Bug reports and feature requests should go on our GitHub issue tracker.
Tutorials on using HTMap.
- Dependency Management
Information about how to manage your what your code depends on (e.g., other Python packages).
- API Reference
Public API documentation.
- CLI Reference
Use of the HTMap CLI.
- Using HTCondor with HTMap
Tips on using HTMap with HTCondor
- Tips and Tricks
Useful tips & tricks on the API.
These questions are asked, sometimes frequently.
Documentation for the various settings.
- Version History
New features, bug fixes, and known issues by version.
- Contributing and Developing
How to contribute to HTMap, how to set up a development environment, how HTMap works under the hood, etc.