Compare commits

Home / Compare 2cba969a .. 228e4fb2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.372=0.002
σ0.058-0.057=0.001
min70.336-70.337=-0.000
max70.535-70.532=0.003
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.160-0.154=0.006
σ0.003-0.005=-0.002
min0.156-0.150=0.006
max0.165-0.163=0.002
cache=y
dps=1
iters=10
policies=100
mean21.143-21.142=0.000
σ0.002-0.002=0.000
min21.137-21.138=-0.001
max21.146-21.146=-0.001
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.062-0.059=0.003
σ0.003-0.002=0.001
min0.058-0.057=0.000
max0.067-0.065=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.198-1752.202=-0.004
σ0.362-0.361=0.001
min1751.633-1751.627=0.006
max1752.787-1752.786=0.001
mean1676.950-1664.500=12.450
σ626.465-626.020=0.445
min669.000-660.000=9.000
max2622.000-2516.000=106.000
mean2.790-2.860=-0.071
σ0.154-0.065=0.089
min2.269-2.757=-0.488
max2.966-3.016=-0.050

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.932-269.933=-0.001
σ0.007-0.010=-0.003
min269.925-269.919=0.006
max269.941-269.945=-0.004
mean2622.000-2516.000=106.000
σ0.000
min2622.000-2516.000=106.000
max2622.000-2516.000=106.000
mean0.373-0.380=-0.007
σ0.005-0.006=-0.001
min0.369-0.376=-0.007
max0.382-0.390=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1930.390-1930.399=-0.008
σ0.020-0.018=0.003
min1930.360-1930.376=-0.015
max1930.409-1930.420=-0.011
mean2622.000-2516.000=106.000
σ0.000
min2622.000-2516.000=106.000
max2622.000-2516.000=106.000
mean2.510-2.480=0.029
σ0.068-0.124=-0.057
min2.457-2.318=0.138
max2.611-2.661=-0.051
iters=5
new-facts=6402
prior-facts=1
mean4750.845-4750.597=0.248
σ0.830-1.029=-0.199
min4750.334-4749.732=0.602
max4752.312-4752.276=0.035
mean2622.000-2516.000=106.000
σ0.000
min2622.000-2516.000=106.000
max2622.000-2516.000=106.000
mean8.653-8.640=0.012
σ0.200-0.228=-0.029
min8.469-8.419=0.050
max8.868-8.932=-0.064
iters=5
new-facts=6402
prior-facts=6402
mean4941.264-4941.334=-0.070
σ0.202-0.083=0.118
min4940.926-4941.266=-0.340
max4941.423-4941.432=-0.008
mean2968.400-2984.600=-16.200
σ263.754-308.334=-44.580
min2622.000-2575.000=47.000
max3316.000-3376.000=-60.000
mean8.456-8.572=-0.116
σ0.157-0.135=0.022
min8.291-8.412=-0.122
max8.694-8.744=-0.051

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.287-1.789=-0.502
σ0.372-0.214=0.158
min0.939-1.445=-0.507
max1.823-2.015=-0.192

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.907-465.901=0.006
σ575.765-575.759=0.006
min178.021-178.021=0.000
max1329.555-1329.540=0.015
mean81.750
σ7.500
min78.000
max93.000
mean2622.000-2516.000=106.000
σ0.000
min2622.000-2516.000=106.000
max2622.000-2516.000=106.000
mean0.568-0.547=0.021
σ0.562-0.525=0.037
min0.280-0.279=0.000
max1.411-1.334=0.077
policies=20
mean1780.429-1780.444=-0.015
σ0.353-0.346=0.007
min1780.191-1780.219=-0.029
max1780.951-1780.957=-0.006
mean780.000
σ0.000
min780.000
max780.000
mean2622.000-2516.000=106.000
σ0.000
min2622.000-2516.000=106.000
max2622.000-2516.000=106.000
mean2.787-2.774=0.013
σ0.020-0.019=0.001
min2.758-2.758=0.000
max2.800-2.794=0.006
policies=200
mean17811.251-17811.200=0.051
σ0.530-0.457=0.073
min17810.887-17810.782=0.104
max17812.036-17811.848=0.188
mean7800.000
σ0.000
min7800.000
max7800.000
mean2622.000-2516.000=106.000
σ0.000
min2622.000-2516.000=106.000
max2622.000-2516.000=106.000
mean27.916-27.792=0.125
σ0.118-0.042=0.076
min27.807-27.734=0.073
max28.044-27.833=0.211