Compare commits

Home / Compare 043e3b65 .. 087e39d9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.987=-0.007
σ0.048-0.055=-0.007
min33.955-33.953=0.002
max34.111-34.142=-0.030
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.082-0.082=-0.000
σ0.005-0.005=0.000
min0.077-0.075=0.001
max0.092-0.092=0.000
cache=y
dps=1
iters=10
policies=100
mean23.318-23.324=-0.006
σ0.002-0.003=-0.000
min23.314-23.320=-0.006
max23.321-23.329=-0.008
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.065-0.065=0.000
σ0.003-0.003=-0.000
min0.064-0.063=0.000
max0.073-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.428-1756.727=0.701
σ0.364-0.366=-0.002
min1756.854-1756.150=0.703
max1758.016-1757.319=0.697
mean1648.300-1644.550=3.750
σ612.222-621.909=-9.687
min677.000-654.000=23.000
max2630.000-2827.000=-197.000
mean2.367-2.338=0.029
σ0.093-0.065=0.028
min2.255-2.260=-0.005
max2.595-2.485=0.111

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.575-325.325=1.250
σ0.043-0.043=0.000
min326.503-325.252=1.251
max326.616-325.364=1.252
mean2630.000-2827.000=-197.000
σ0.000
min2630.000-2827.000=-197.000
max2630.000-2827.000=-197.000
mean0.424-0.431=-0.007
σ0.007-0.006=0.000
min0.420-0.425=-0.004
max0.436-0.441=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1988.727-1985.875=2.853
σ0.018-0.020=-0.002
min1988.707-1985.841=2.866
max1988.749-1985.888=2.861
mean2630.000-2827.000=-197.000
σ0.000
min2630.000-2827.000=-197.000
max2630.000-2827.000=-197.000
mean2.803-2.669=0.135
σ0.283-0.087=0.196
min2.632-2.561=0.070
max3.305-2.804=0.501
iters=5
new-facts=6402
prior-facts=1
mean4813.458-4809.533=3.925
σ7.778-7.745=0.034
min4809.613-4805.571=4.042
max4827.367-4823.377=3.990
mean2630.000-2827.000=-197.000
σ0.000
min2630.000-2827.000=-197.000
max2630.000-2827.000=-197.000
mean8.985-8.879=0.105
σ0.192-0.324=-0.132
min8.674-8.434=0.241
max9.173-9.192=-0.018
iters=5
new-facts=6402
prior-facts=6402
mean5001.146-4997.040=4.106
σ0.034-0.185=-0.151
min5001.112-4996.821=4.290
max5001.200-4997.184=4.016
mean2989.800-3050.600=-60.800
σ275.427-222.029=53.398
min2630.000-2827.000=-197.000
max3317.000-3271.000=46.000
mean9.752-8.903=0.850
σ0.388-0.341=0.047
min9.113-8.606=0.506
max10.125-9.436=0.689

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.118-0.978=0.140
σ0.304-0.068=0.237
min0.913-0.922=-0.009
max1.652-1.053=0.600

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.571-463.381=1.190
σ574.780-574.771=0.010
min177.172-175.988=1.184
max1326.741-1325.537=1.204
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2630.000-2827.000=-197.000
σ0.000
min2630.000-2827.000=-197.000
max2630.000-2827.000=-197.000
mean0.556-0.432=0.125
σ0.568-0.304=0.264
min0.270-0.274=-0.004
max1.409-0.888=0.521
policies=20
mean1772.012-1760.157=11.855
σ0.353-0.352=0.001
min1771.785-1759.918=11.867
max1772.538-1760.679=11.859
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2630.000-2827.000=-197.000
σ0.000
min2630.000-2827.000=-197.000
max2630.000-2827.000=-197.000
mean2.728-2.805=-0.077
σ0.018-0.015=0.003
min2.704-2.795=-0.091
max2.747-2.827=-0.080
policies=200
mean17727.390-17608.289=119.101
σ0.544-0.518=0.026
min17727.085-17607.960=119.125
max17728.205-17609.060=119.145
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2630.000-2827.000=-197.000
σ0.000
min2630.000-2827.000=-197.000
max2630.000-2827.000=-197.000
mean27.481-27.915=-0.434
σ0.093-0.430=-0.337
min27.390-27.505=-0.115
max27.577-28.431=-0.854