Compare commits

Home / Compare ddea503f .. 4ff53f1f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.390=-0.001
σ0.048-0.047=0.001
min70.357-70.360=-0.002
max70.521-70.521=0.000
mean412.000-418.000=-6.000
σ0.000
min412.000-418.000=-6.000
max412.000-418.000=-6.000
mean0.157-0.162=-0.005
σ0.004-0.003=0.001
min0.150-0.159=-0.009
max0.164-0.167=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.145-21.144=0.001
σ0.002-0.003=-0.000
min21.141-21.140=0.001
max21.148-21.149=-0.000
mean412.000-418.000=-6.000
σ0.000
min412.000-418.000=-6.000
max412.000-418.000=-6.000
mean0.065-0.064=0.001
σ0.002-0.003=-0.001
min0.063-0.059=0.004
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.393-1752.395=-0.002
σ0.363-0.361=0.001
min1751.832-1751.826=0.006
max1752.976-1752.983=-0.007
mean1655.500-1662.750=-7.250
σ617.618-617.514=0.104
min638.000-640.000=-2.000
max2494.000
mean2.839-2.772=0.067
σ0.152-0.167=-0.015
min2.352-2.303=0.049
max3.143-2.948=0.195

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.145-270.143=0.003
σ0.008-0.005=0.003
min270.135-270.136=-0.002
max270.153-270.149=0.004
mean2494.000
σ0.000
min2494.000
max2494.000
mean0.380-0.383=-0.003
σ0.005-0.010=-0.004
min0.375-0.373=0.002
max0.389-0.394=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1930.608-1930.605=0.003
σ0.009-0.007=0.003
min1930.599-1930.599=-0.001
max1930.619-1930.616=0.003
mean2494.000
σ0.000
min2494.000
max2494.000
mean2.531-2.556=-0.025
σ0.103-0.167=-0.063
min2.447-2.455=-0.008
max2.676-2.848=-0.172
iters=5
new-facts=6402
prior-facts=1
mean4751.336-4751.320=0.016
σ0.860-0.829=0.031
min4750.831-4750.835=-0.004
max4752.863-4752.792=0.071
mean2494.000
σ0.000
min2494.000
max2494.000
mean8.428-8.449=-0.021
σ0.409-0.433=-0.024
min7.791-7.819=-0.028
max8.876-8.958=-0.082
iters=5
new-facts=6402
prior-facts=6402
mean4941.774-4941.765=0.009
σ0.014-0.021=-0.007
min4941.760-4941.738=0.022
max4941.794-4941.790=0.005
mean3013.800-3007.200=6.600
σ259.617-263.243=-3.625
min2627.000-2622.000=5.000
max3320.000-3323.000=-3.000
mean8.603-8.519=0.084
σ0.145-0.153=-0.008
min8.438-8.301=0.137
max8.780-8.684=0.096

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.626-1.646=-0.020
σ0.215-0.157=0.057
min1.345-1.396=-0.051
max1.841-1.801=0.039

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.367-466.364=0.003
σ575.920-575.920=-0.000
min178.402-178.398=0.004
max1330.246-1330.244=0.002
mean84.000
σ8.000
min80.000
max96.000
mean2494.000
σ0.000
min2494.000
max2494.000
mean0.554-0.557=-0.002
σ0.544-0.552=-0.008
min0.281-0.277=0.004
max1.371-1.385=-0.014
policies=20
mean1784.327-1784.309=0.018
σ0.360-0.365=-0.005
min1784.085-1784.074=0.011
max1784.860-1784.852=0.008
mean800.000
σ0.000
min800.000
max800.000
mean2494.000
σ0.000
min2494.000
max2494.000
mean2.792-2.774=0.018
σ0.010-0.021=-0.012
min2.778-2.754=0.024
max2.800-2.802=-0.002
policies=200
mean17849.904-17849.874=0.030
σ0.447-0.434=0.013
min17849.619-17849.550=0.069
max17850.570-17850.515=0.055
mean8000.000
σ0.000
min8000.000
max8000.000
mean2494.000
σ0.000
min2494.000
max2494.000
mean28.020-28.050=-0.030
σ0.048-0.112=-0.065
min27.992-27.912=0.079
max28.091-28.182=-0.091