Compare commits

Home / Compare c442c2c2 .. 1648288c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.389-31.040=39.349
σ0.046-0.048=-0.003
min70.361-31.004=39.357
max70.518-31.174=39.343
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.159-0.079=0.080
σ0.003-0.004=-0.001
min0.157-0.072=0.085
max0.167-0.087=0.079
cache=y
dps=1
iters=10
policies=100
mean21.145-21.143=0.002
σ0.002-0.003=-0.001
min21.143-21.139=0.004
max21.149-21.148=0.001
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.064-0.062=0.002
σ0.003-0.003=0.000
min0.059-0.058=0.002
max0.071-0.066=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.395-1751.412=0.983
σ0.361-0.360=0.001
min1751.820-1750.839=0.981
max1752.980-1751.981=0.999
mean1654.400-1640.200=14.200
σ645.809-615.414=30.395
min631.000-630.000=1.000
max2850.000-2474.000=376.000
mean2.827-2.815=0.012
σ0.179-0.142=0.038
min2.134-2.362=-0.228
max2.986-3.002=-0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.145-266.783=3.362
σ0.008-0.006=0.002
min270.136-266.776=3.360
max270.153-266.791=3.362
mean2850.000-2474.000=376.000
σ0.000
min2850.000-2474.000=376.000
max2850.000-2474.000=376.000
mean0.380-0.364=0.015
σ0.006-0.001=0.005
min0.371-0.363=0.008
max0.388-0.366=0.022
iters=5
new-facts=1
prior-facts=6402
mean1930.608-1927.212=3.396
σ0.010-0.014=-0.004
min1930.594-1927.193=3.401
max1930.620-1927.227=3.393
mean2850.000-2474.000=376.000
σ0.000
min2850.000-2474.000=376.000
max2850.000-2474.000=376.000
mean2.550-3.060=-0.510
σ0.147-0.109=0.039
min2.437-2.972=-0.535
max2.783-3.245=-0.461
iters=5
new-facts=6402
prior-facts=1
mean4751.316-4747.660=3.655
σ0.852-0.467=0.385
min4750.824-4747.379=3.446
max4752.830-4748.484=4.346
mean2850.000-2474.000=376.000
σ0.000
min2850.000-2474.000=376.000
max2850.000-2474.000=376.000
mean8.500-7.870=0.631
σ0.400-0.270=0.130
min7.893-7.637=0.257
max9.016-8.334=0.682
iters=5
new-facts=6402
prior-facts=6402
mean4941.771-4938.166=3.605
σ0.019-0.075=-0.056
min4941.750-4938.106=3.643
max4941.794-4938.249=3.545
mean3057.800-2963.800=94.000
σ193.984-430.332=-236.348
min2850.000-2474.000=376.000
max3336.000-3544.000=-208.000
mean8.557-8.466=0.092
σ0.223-0.170=0.052
min8.374-8.332=0.042
max8.901-8.753=0.149

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.997-1.778=-0.781
σ0.154-0.120=0.034
min0.925-1.642=-0.716
max1.272-1.892=-0.620

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.381-465.114=1.267
σ575.941-575.753=0.188
min178.397-177.235=1.163
max1330.293-1328.743=1.549
mean84.250-79.750=4.500
σ8.500-7.500=1.000
min80.000-76.000=4.000
max97.000-91.000=6.000
mean2850.000-2474.000=376.000
σ0.000
min2850.000-2474.000=376.000
max2850.000-2474.000=376.000
mean0.527-0.562=-0.034
σ0.476-0.571=-0.095
min0.284-0.273=0.011
max1.242-1.418=-0.177
policies=20
mean1784.359-1772.605=11.754
σ0.369-0.327=0.043
min1784.101-1772.389=11.712
max1784.903-1773.090=11.813
mean800.000-760.000=40.000
σ0.000
min800.000-760.000=40.000
max800.000-760.000=40.000
mean2850.000-2474.000=376.000
σ0.000
min2850.000-2474.000=376.000
max2850.000-2474.000=376.000
mean2.862-2.736=0.126
σ0.017-0.011=0.006
min2.849-2.720=0.129
max2.887-2.746=0.141
policies=200
mean17849.946-17732.585=117.361
σ0.366-0.604=-0.238
min17849.680-17732.228=117.452
max17850.483-17733.488=116.995
mean8000.000-7600.000=400.000
σ0.000
min8000.000-7600.000=400.000
max8000.000-7600.000=400.000
mean2850.000-2474.000=376.000
σ0.000
min2850.000-2474.000=376.000
max2850.000-2474.000=376.000
mean28.515-27.665=0.850
σ0.647-0.090=0.557
min27.874-27.605=0.269
max29.080-27.798=1.282