Compare commits

Home / Compare c2a786b4 .. 435c8c7b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.979=0.000
σ0.048-0.051=-0.003
min33.955-33.942=0.013
max34.111-34.118=-0.007
mean412.000-418.900=-6.900
σ0.000-0.316=-0.316
min412.000-418.000=-6.000
max412.000-419.000=-7.000
mean0.082-0.085=-0.003
σ0.005-0.003=0.002
min0.077-0.082=-0.005
max0.092-0.091=0.001
cache=y
dps=1
iters=10
policies=100
mean23.318-23.317=0.000
σ0.002-0.003=-0.000
min23.314-23.314=-0.000
max23.321-23.323=-0.002
mean412.000-420.000=-8.000
σ0.000
min412.000-420.000=-8.000
max412.000-420.000=-8.000
mean0.065-0.065=-0.000
σ0.003-0.002=0.000
min0.064-0.063=0.000
max0.073-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.428-1757.302=0.125
σ0.364-0.365=-0.001
min1756.854-1756.728=0.125
max1758.016-1757.887=0.129
mean1648.300-1652.750=-4.450
σ612.222-624.382=-12.160
min677.000-641.000=36.000
max2630.000-2830.000=-200.000
mean2.367-2.395=-0.028
σ0.093-0.115=-0.021
min2.255-2.267=-0.011
max2.595-2.694=-0.099

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.575-326.453=0.122
σ0.043-0.039=0.004
min326.503-326.385=0.118
max326.616-326.481=0.134
mean2630.000-2830.000=-200.000
σ0.000
min2630.000-2830.000=-200.000
max2630.000-2830.000=-200.000
mean0.424-0.427=-0.003
σ0.007-0.004=0.002
min0.420-0.423=-0.003
max0.436-0.433=0.003
iters=5
new-facts=1
prior-facts=6402
mean1988.727-1988.617=0.111
σ0.018-0.007=0.011
min1988.707-1988.610=0.097
max1988.749-1988.626=0.124
mean2630.000-2830.000=-200.000
σ0.000
min2630.000-2830.000=-200.000
max2630.000-2830.000=-200.000
mean2.803-2.674=0.129
σ0.283-0.121=0.162
min2.632-2.528=0.103
max3.305-2.856=0.448
iters=5
new-facts=6402
prior-facts=1
mean4813.458-4813.457=0.001
σ7.778-7.642=0.136
min4809.613-4809.965=-0.353
max4827.367-4827.127=0.241
mean2630.000-2830.000=-200.000
σ0.000
min2630.000-2830.000=-200.000
max2630.000-2830.000=-200.000
mean8.985-8.835=0.149
σ0.192-0.312=-0.120
min8.674-8.383=0.291
max9.173-9.142=0.032
iters=5
new-facts=6402
prior-facts=6402
mean5001.146-5000.945=0.201
σ0.034-0.166=-0.132
min5001.112-5000.649=0.463
max5001.200-5001.035=0.165
mean2989.800-3084.000=-94.200
σ275.427-253.010=22.417
min2630.000-2830.000=-200.000
max3317.000-3336.000=-19.000
mean9.752-9.714=0.039
σ0.388-0.376=0.013
min9.113-9.081=0.031
max10.125-10.023=0.102

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.118-1.000=0.118
σ0.304-0.068=0.236
min0.913-0.919=-0.005
max1.652-1.053=0.600

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.571-464.439=0.132
σ574.780-574.771=0.009
min177.172-177.044=0.128
max1326.741-1326.596=0.145
mean88.250
σ8.500
min84.000
max101.000
mean2630.000-2830.000=-200.000
σ0.000
min2630.000-2830.000=-200.000
max2630.000-2830.000=-200.000
mean0.556-0.436=0.120
σ0.568-0.306=0.262
min0.270-0.282=-0.012
max1.409-0.896=0.513
policies=20
mean1772.012-1770.797=1.215
σ0.353-0.362=-0.009
min1771.785-1770.550=1.235
max1772.538-1771.332=1.206
mean840.000
σ0.000
min840.000
max840.000
mean2630.000-2830.000=-200.000
σ0.000
min2630.000-2830.000=-200.000
max2630.000-2830.000=-200.000
mean2.728-2.800=-0.072
σ0.018-0.008=0.010
min2.704-2.793=-0.088
max2.747-2.811=-0.064
policies=200
mean17727.390-17714.857=12.533
σ0.544-0.560=-0.016
min17727.085-17714.324=12.761
max17728.205-17715.646=12.560
mean8400.000
σ0.000
min8400.000
max8400.000
mean2630.000-2830.000=-200.000
σ0.000
min2630.000-2830.000=-200.000
max2630.000-2830.000=-200.000
mean27.481-28.022=-0.541
σ0.093-0.468=-0.375
min27.390-27.482=-0.092
max27.577-28.581=-1.004