Compare commits

Home / Compare b2db5986 .. 35e6a88c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.384-70.390=-0.006
σ0.045-0.045=0.000
min70.354-70.364=-0.009
max70.509-70.514=-0.006
mean414.400-414.000=0.400
σ0.516-0.000=0.516
min414.000
max415.000-414.000=1.000
mean0.161-0.160=0.001
σ0.004-0.002=0.002
min0.157-0.157=0.000
max0.172-0.163=0.009
cache=y
dps=1
iters=10
policies=100
mean21.141-21.143=-0.002
σ0.002-0.002=0.001
min21.137-21.141=-0.004
max21.144-21.147=-0.003
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.065-0.062=0.003
σ0.002-0.003=-0.001
min0.063-0.058=0.005
max0.070-0.067=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.394=-0.001
σ0.362-0.362=0.001
min1751.826-1751.822=0.004
max1752.979-1752.979=0.000
mean1660.050-1641.550=18.500
σ632.992-618.816=14.176
min618.000-625.000=-7.000
max2776.000-2481.000=295.000
mean2.844-2.809=0.035
σ0.106-0.136=-0.030
min2.585-2.542=0.043
max2.966-3.010=-0.044

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.140-270.144=-0.004
σ0.007-0.009=-0.002
min270.130-270.131=-0.001
max270.150-270.154=-0.003
mean2776.000-2481.000=295.000
σ0.000
min2776.000-2481.000=295.000
max2776.000-2481.000=295.000
mean0.376-0.382=-0.006
σ0.004-0.007=-0.003
min0.369-0.378=-0.009
max0.380-0.394=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1930.602-1930.611=-0.009
σ0.020-0.009=0.011
min1930.571-1930.600=-0.029
max1930.619-1930.622=-0.003
mean2776.000-2481.000=295.000
σ0.000
min2776.000-2481.000=295.000
max2776.000-2481.000=295.000
mean2.526-2.483=0.043
σ0.071-0.096=-0.025
min2.479-2.353=0.127
max2.649-2.617=0.032
iters=5
new-facts=6402
prior-facts=1
mean4751.319-4751.256=0.064
σ0.865-0.948=-0.083
min4750.865-4750.789=0.077
max4752.864-4752.948=-0.084
mean2776.000-2481.000=295.000
σ0.000
min2776.000-2481.000=295.000
max2776.000-2481.000=295.000
mean8.350-8.968=-0.618
σ0.433-0.241=0.192
min7.684-8.618=-0.934
max8.738-9.298=-0.559
iters=5
new-facts=6402
prior-facts=6402
mean4941.694-4941.700=-0.006
σ0.147-0.165=-0.018
min4941.433-4941.405=0.028
max4941.785-4941.786=-0.001
mean3036.200-3014.200=22.000
σ226.153-295.493=-69.340
min2776.000-2604.000=172.000
max3314.000-3396.000=-82.000
mean8.524-8.595=-0.071
σ0.110-0.204=-0.094
min8.406-8.330=0.076
max8.640-8.847=-0.207

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.071-1.723=-0.652
σ0.230-0.080=0.150
min0.936-1.640=-0.704
max1.470-1.828=-0.357

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.379-466.359=0.020
σ575.938-575.920=0.017
min178.403-178.389=0.014
max1330.285-1330.239=0.046
mean84.250-84.000=0.250
σ8.500-8.000=0.500
min80.000
max97.000-96.000=1.000
mean2776.000-2481.000=295.000
σ0.000
min2776.000-2481.000=295.000
max2776.000-2481.000=295.000
mean0.427-0.560=-0.133
σ0.254-0.544=-0.290
min0.288-0.277=0.011
max0.808-1.376=-0.568
policies=20
mean1784.358-1784.292=0.066
σ0.365-0.365=0.000
min1784.097-1784.049=0.048
max1784.895-1784.833=0.062
mean800.000
σ0.000
min800.000
max800.000
mean2776.000-2481.000=295.000
σ0.000
min2776.000-2481.000=295.000
max2776.000-2481.000=295.000
mean2.900-2.781=0.118
σ0.113-0.014=0.100
min2.778-2.774=0.004
max2.999-2.802=0.197
policies=200
mean17849.636-17849.796=-0.160
σ0.611-0.510=0.100
min17849.278-17849.430=-0.152
max17850.548-17850.542=0.006
mean8000.000
σ0.000
min8000.000
max8000.000
mean2776.000-2481.000=295.000
σ0.000
min2776.000-2481.000=295.000
max2776.000-2481.000=295.000
mean28.031-27.998=0.033
σ0.137-0.074=0.063
min27.909-27.944=-0.034
max28.207-28.108=0.099