Compare commits

Home / Compare 4b387624 .. 67db9a41

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.376-31.041=39.334
σ0.059-0.050=0.009
min70.332-31.002=39.330
max70.540-31.180=39.361
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.159-0.081=0.078
σ0.004-0.003=0.000
min0.155-0.078=0.077
max0.165-0.088=0.077
cache=y
dps=1
iters=10
policies=100
mean21.143-21.142=0.000
σ0.002-0.002=0.000
min21.139-21.140=-0.001
max21.146-21.146=-0.000
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.062-0.062=-0.000
σ0.004-0.004=0.000
min0.058-0.059=-0.001
max0.068-0.071=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.198-1751.413=0.784
σ0.362-0.365=-0.003
min1751.633-1750.845=0.788
max1752.781-1751.999=0.782
mean1641.900-1658.950=-17.050
σ623.255-628.959=-5.704
min670.000-676.000=-6.000
max2503.000-2659.000=-156.000
mean2.831-2.875=-0.044
σ0.181-0.157=0.024
min2.356-2.347=0.009
max3.117-3.094=0.023

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.935-266.781=3.154
σ0.008-0.010=-0.003
min269.924-266.770=3.154
max269.945-266.795=3.150
mean2503.000-2659.000=-156.000
σ0.000
min2503.000-2659.000=-156.000
max2503.000-2659.000=-156.000
mean0.383-0.368=0.016
σ0.005-0.004=0.001
min0.379-0.365=0.014
max0.392-0.375=0.017
iters=5
new-facts=1
prior-facts=6402
mean1930.387-1927.212=3.175
σ0.026-0.004=0.022
min1930.355-1927.208=3.147
max1930.409-1927.216=3.192
mean2503.000-2659.000=-156.000
σ0.000
min2503.000-2659.000=-156.000
max2503.000-2659.000=-156.000
mean2.540-3.080=-0.540
σ0.100-0.346=-0.246
min2.453-2.572=-0.119
max2.692-3.421=-0.729
iters=5
new-facts=6402
prior-facts=1
mean4750.754-4747.748=3.006
σ0.949-0.766=0.183
min4749.714-4747.349=2.364
max4752.309-4749.114=3.195
mean2503.000-2659.000=-156.000
σ0.000
min2503.000-2659.000=-156.000
max2503.000-2659.000=-156.000
mean8.708-8.177=0.531
σ0.337-0.358=-0.020
min8.383-7.790=0.594
max9.084-8.726=0.358
iters=5
new-facts=6402
prior-facts=6402
mean4941.326-4938.072=3.254
σ0.090-0.105=-0.015
min4941.248-4937.897=3.351
max4941.427-4938.178=3.248
mean2959.200-2984.800=-25.600
σ280.985-353.114=-72.128
min2587.000-2659.000=-72.000
max3331.000-3477.000=-146.000
mean8.421-8.384=0.037
σ0.042-0.147=-0.105
min8.363-8.215=0.149
max8.468-8.608=-0.139

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.709-1.200=0.509
σ0.134-0.277=-0.143
min1.488-0.937=0.551
max1.845-1.653=0.192

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.901-465.118=0.783
σ575.756-575.765=-0.009
min178.020-177.234=0.785
max1329.536-1328.766=0.770
mean81.750-79.750=2.000
σ7.500
min78.000-76.000=2.000
max93.000-91.000=2.000
mean2503.000-2659.000=-156.000
σ0.000
min2503.000-2659.000=-156.000
max2503.000-2659.000=-156.000
mean0.565-0.566=-0.001
σ0.575-0.562=0.013
min0.274-0.279=-0.005
max1.428-1.409=0.019
policies=20
mean1780.425-1772.586=7.839
σ0.352-0.343=0.009
min1780.188-1772.357=7.831
max1780.945-1773.095=7.851
mean780.000-760.000=20.000
σ0.000
min780.000-760.000=20.000
max780.000-760.000=20.000
mean2503.000-2659.000=-156.000
σ0.000
min2503.000-2659.000=-156.000
max2503.000-2659.000=-156.000
mean2.770-2.764=0.005
σ0.015-0.022=-0.007
min2.748-2.747=0.001
max2.779-2.794=-0.014
policies=200
mean17811.184-17732.474=78.710
σ0.602-0.383=0.219
min17810.786-17732.241=78.546
max17812.073-17733.042=79.031
mean7800.000-7600.000=200.000
σ0.000
min7800.000-7600.000=200.000
max7800.000-7600.000=200.000
mean2503.000-2659.000=-156.000
σ0.000
min2503.000-2659.000=-156.000
max2503.000-2659.000=-156.000
mean27.774-27.799=-0.025
σ0.068-0.133=-0.065
min27.712-27.680=0.032
max27.868-27.926=-0.058