Skip to content
Snippets Groups Projects
Commit acdec4d5 authored by Christoph Heidecker's avatar Christoph Heidecker
Browse files

Update README.md

parent e09da7d9
Branches
Tags
No related merge requests found
Pipeline #
......@@ -19,7 +19,13 @@ We suggest a coordination of those distributed caches, so that data scheduling t
The aim is to reach data locality by bringing workflows to most suitable resource or cache.
For that purpose we developed NaviX, a intermediate between the workflow scheduler HTCondor and the data transfer protocol XRootD.
...(work ongoing)...
This protocol was developed by the High Energy Physics community for streaming of event-based data and already supports basic caching functionality.
Proxy servers cache files on-the-fly during access and redirect iterated accesses to the cached version instead of the remote one.
On top, XRootD managers coordinate data accesses and collect meta-data of the underlying proxy or data servers.
This hierarchical infrastructure enables utillization of meta-data for redirecting data accesses to the most suitable cache proxy.
Here, NaviX integrates all coordination decisions into the overlaying batch system HTCondor to influence the job to resource matching using cache meta-data.
...(writing ongoing)...
## Requirements
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment