Skip to content

Fractions of streams

Ghost User requested to merge fractions_of_streams into master

if you want to only process a fraction of a stream of events, it is now possible to do so. just call in the config:

"data": {

"Test": {

  "streams": null,

  "fraction": 0.5

}

},

to only get half the stream. the stream get's cut equally over all experiments and runs. it has a bias to take events of the beginning of the experiment over events from the end, but if you only want to use these smaller files to test things quickly, it should not matter, since for the final study you will use full streams anyways.

the parameter is optional, which means: if you don't add the "fraction" tag it will set it to 1 per default. so there will be no missing parameter error or something like this.

e.g:

"data": {

"Test": {

  "streams": null

}

},

still works

Edited by Ghost User

Merge request reports

Loading