Compare commits

Home / Compare 8b189c11 .. 1f8697fd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.375-70.374=0.002
σ0.059-0.059=0.001
min70.335-70.336=-0.001
max70.542-70.537=0.005
mean416.000-413.400=2.600
σ0.000-0.516=-0.516
min416.000-413.000=3.000
max416.000-414.000=2.000
mean0.158-0.157=0.002
σ0.003-0.004=-0.000
min0.152-0.151=0.000
max0.165-0.162=0.003
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.001
σ0.002-0.002=0.000
min21.140-21.139=0.001
max21.146-21.145=0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.064-0.062=0.001
σ0.002-0.004=-0.002
min0.062-0.057=0.004
max0.068-0.069=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.200-1752.200=-0.000
σ0.362-0.360=0.002
min1751.629-1751.632=-0.003
max1752.788-1752.772=0.016
mean1654.700-1655.200=-0.500
σ623.384-618.978=4.406
min676.000-658.000=18.000
max2650.000-2495.000=155.000
mean2.853-2.800=0.053
σ0.138-0.188=-0.050
min2.487-2.144=0.344
max3.191-3.080=0.111

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.931-269.935=-0.004
σ0.005-0.006=-0.001
min269.926-269.929=-0.003
max269.937-269.945=-0.008
mean2650.000-2495.000=155.000
σ0.000
min2650.000-2495.000=155.000
max2650.000-2495.000=155.000
mean0.373-0.384=-0.011
σ0.007-0.006=0.001
min0.368-0.380=-0.012
max0.384-0.393=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1930.398-1930.384=0.014
σ0.009-0.016=-0.007
min1930.389-1930.364=0.025
max1930.410-1930.400=0.010
mean2650.000-2495.000=155.000
σ0.000
min2650.000-2495.000=155.000
max2650.000-2495.000=155.000
mean2.510-2.523=-0.013
σ0.069-0.098=-0.029
min2.453-2.452=0.001
max2.613-2.693=-0.079
iters=5
new-facts=6402
prior-facts=1
mean4750.872-4750.725=0.147
σ0.775-0.903=-0.128
min4750.282-4750.022=0.261
max4752.227-4752.286=-0.059
mean2650.000-2495.000=155.000
σ0.000
min2650.000-2495.000=155.000
max2650.000-2495.000=155.000
mean8.487-8.680=-0.192
σ0.346-0.291=0.055
min8.189-8.384=-0.195
max9.064-9.087=-0.023
iters=5
new-facts=6402
prior-facts=6402
mean4941.333-4941.330=0.003
σ0.089-0.082=0.007
min4941.255-4941.267=-0.012
max4941.435-4941.424=0.011
mean2996.800-2979.000=17.800
σ264.195-263.662=0.534
min2650.000-2635.000=15.000
max3322.000-3315.000=7.000
mean8.526-8.415=0.111
σ0.184-0.042=0.142
min8.332-8.372=-0.039
max8.721-8.477=0.243

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.146-1.663=-0.517
σ0.175-0.168=0.008
min0.946-1.478=-0.532
max1.371-1.844=-0.472

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.920-465.910=0.010
σ575.791-575.771=0.020
min178.021-178.022=-0.001
max1329.607-1329.567=0.039
mean81.750
σ7.500
min78.000
max93.000
mean2650.000-2495.000=155.000
σ0.000
min2650.000-2495.000=155.000
max2650.000-2495.000=155.000
mean0.568-0.568=0.001
σ0.568-0.573=-0.005
min0.281-0.275=0.006
max1.421-1.428=-0.007
policies=20
mean1780.459-1780.458=0.000
σ0.350-0.345=0.005
min1780.219-1780.231=-0.012
max1780.977-1780.970=0.007
mean780.000
σ0.000
min780.000
max780.000
mean2650.000-2495.000=155.000
σ0.000
min2650.000-2495.000=155.000
max2650.000-2495.000=155.000
mean2.778-2.778=-0.000
σ0.017-0.016=0.001
min2.764-2.759=0.004
max2.802-2.798=0.003
policies=200
mean17811.409-17811.508=-0.099
σ0.457-0.476=-0.019
min17811.037-17811.235=-0.198
max17812.077-17812.221=-0.144
mean7800.000
σ0.000
min7800.000
max7800.000
mean2650.000-2495.000=155.000
σ0.000
min2650.000-2495.000=155.000
max2650.000-2495.000=155.000
mean27.859-27.808=0.051
σ0.121-0.075=0.047
min27.755-27.708=0.047
max28.033-27.888=0.145