Compare commits

Home / Compare c694ddd6 .. bf2cac12

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.392-70.396=-0.004
σ0.047-0.045=0.003
min70.369-70.369=-0.000
max70.525-70.518=0.007
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.154-0.160=-0.006
σ0.005-0.004=0.001
min0.148-0.153=-0.005
max0.165-0.168=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.147-21.144=0.003
σ0.011-0.003=0.008
min21.140-21.139=0.001
max21.178-21.148=0.030
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.062-0.063=-0.001
σ0.004-0.002=0.002
min0.057-0.057=-0.000
max0.071-0.067=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.393=0.001
σ0.360-0.360=0.000
min1751.827-1751.822=0.005
max1752.996-1752.961=0.035
mean1659.850-1655.750=4.100
σ629.874-645.809=-15.935
min619.000-634.000=-15.000
max2779.000-2849.000=-70.000
mean2.792-2.757=0.035
σ0.146-0.193=-0.047
min2.510-2.298=0.212
max3.090-3.003=0.086

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.241-270.243=-0.002
σ0.007-0.008=-0.001
min270.232-270.230=0.002
max270.249-270.253=-0.004
mean2779.000-2849.000=-70.000
σ0.000
min2779.000-2849.000=-70.000
max2779.000-2849.000=-70.000
mean0.381-0.380=0.001
σ0.008-0.003=0.005
min0.376-0.377=-0.001
max0.395-0.384=0.012
iters=5
new-facts=1
prior-facts=6402
mean1930.692-1930.701=-0.010
σ0.015-0.015=0.000
min1930.667-1930.679=-0.012
max1930.704-1930.715=-0.012
mean2779.000-2849.000=-70.000
σ0.000
min2779.000-2849.000=-70.000
max2779.000-2849.000=-70.000
mean2.545-2.568=-0.023
σ0.119-0.129=-0.010
min2.442-2.471=-0.030
max2.706-2.776=-0.070
iters=5
new-facts=6402
prior-facts=1
mean4751.320-4751.301=0.019
σ0.994-0.653=0.341
min4750.514-4750.905=-0.390
max4753.046-4752.455=0.590
mean2779.000-2849.000=-70.000
σ0.000
min2779.000-2849.000=-70.000
max2779.000-2849.000=-70.000
mean8.327-8.507=-0.179
σ0.562-0.473=0.089
min7.688-7.777=-0.089
max9.100-8.942=0.158
iters=5
new-facts=6402
prior-facts=6402
mean4941.792-4941.797=-0.005
σ0.177-0.170=0.007
min4941.478-4941.494=-0.016
max4941.890-4941.890=0.000
mean3055.000-3062.000=-7.000
σ336.904-207.864=129.039
min2779.000-2849.000=-70.000
max3563.000-3324.000=239.000
mean8.482-8.528=-0.046
σ0.174-0.116=0.059
min8.335-8.361=-0.027
max8.766-8.648=0.117

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.144-1.049=0.095
σ0.252-0.131=0.121
min0.931-0.928=0.003
max1.529-1.246=0.283

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.756-466.758=-0.002
σ575.942-575.937=0.006
min178.781-178.778=0.003
max1330.670-1330.663=0.007
mean86.250
σ8.500
min82.000
max99.000
mean2779.000-2849.000=-70.000
σ0.000
min2779.000-2849.000=-70.000
max2779.000-2849.000=-70.000
mean0.441-0.482=-0.040
σ0.304-0.379=-0.076
min0.287-0.287=-0.000
max0.897-1.051=-0.154
policies=20
mean1788.126-1788.127=-0.002
σ0.386-0.374=0.013
min1787.870-1787.855=0.015
max1788.699-1788.676=0.022
mean820.000
σ0.000
min820.000
max820.000
mean2779.000-2849.000=-70.000
σ0.000
min2779.000-2849.000=-70.000
max2779.000-2849.000=-70.000
mean2.859-2.863=-0.003
σ0.082-0.004=0.078
min2.778-2.859=-0.081
max2.967-2.868=0.099
policies=200
mean17888.114-17888.154=-0.041
σ0.568-0.468=0.100
min17887.676-17887.838=-0.163
max17888.949-17888.849=0.100
mean8200.000
σ0.000
min8200.000
max8200.000
mean2779.000-2849.000=-70.000
σ0.000
min2779.000-2849.000=-70.000
max2779.000-2849.000=-70.000
mean27.976-28.581=-0.606
σ0.114-0.403=-0.289
min27.881-28.214=-0.333
max28.127-29.002=-0.875