Compare commits

Home / Compare 0f947599 .. ec8dbb32

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.980=-0.001
σ0.048-0.047=0.001
min33.952-33.950=0.002
max34.112-34.109=0.004
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.083-0.085=-0.002
σ0.005-0.003=0.001
min0.077-0.082=-0.005
max0.092-0.091=0.002
cache=y
dps=1
iters=10
policies=100
mean23.317-23.316=0.000
σ0.002-0.002=0.001
min23.313-23.313=-0.000
max23.320-23.318=0.002
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.064-0.063=0.000
σ0.004-0.004=-0.000
min0.060-0.060=0.000
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.429-1757.429=0.001
σ0.367-0.365=0.002
min1756.854-1756.855=-0.002
max1758.025-1758.019=0.006
mean1646.650-1651.600=-4.950
σ625.352-612.115=13.237
min636.000-680.000=-44.000
max2835.000-2633.000=202.000
mean2.360-2.377=-0.017
σ0.080-0.121=-0.040
min2.202-2.209=-0.007
max2.568-2.659=-0.091

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.575-326.576=-0.000
σ0.046-0.041=0.005
min326.496-326.504=-0.008
max326.611-326.602=0.009
mean2835.000-2633.000=202.000
σ0.000
min2835.000-2633.000=202.000
max2835.000-2633.000=202.000
mean0.423-0.422=0.001
σ0.002-0.002=0.000
min0.421-0.420=0.001
max0.426-0.424=0.002
iters=5
new-facts=1
prior-facts=6402
mean1848.399-1988.737=-140.339
σ313.801-0.010=313.791
min1287.055-1988.723=-701.668
max1988.741-1988.750=-0.009
mean2835.000-2633.000=202.000
σ0.000
min2835.000-2633.000=202.000
max2835.000-2633.000=202.000
mean2.618-2.751=-0.133
σ0.479-0.192=0.287
min1.801-2.636=-0.834
max3.005-3.093=-0.088
iters=5
new-facts=6402
prior-facts=1
mean4813.514-4813.603=-0.088
σ7.783-7.705=0.078
min4809.675-4810.037=-0.362
max4827.431-4827.385=0.046
mean2835.000-2633.000=202.000
σ0.000
min2835.000-2633.000=202.000
max2835.000-2633.000=202.000
mean8.324-8.365=-0.041
σ0.539-0.478=0.061
min7.799-7.806=-0.007
max9.180-9.053=0.127
iters=5
new-facts=6402
prior-facts=6402
mean5001.072-5001.132=-0.060
σ0.176-0.017=0.159
min5000.759-5001.113=-0.354
max5001.179-5001.146=0.033
mean3000.200-2954.800=45.400
σ242.765-341.942=-99.177
min2835.000-2633.000=202.000
max3392.000-3417.000=-25.000
mean9.741-9.692=0.049
σ0.162-0.198=-0.036
min9.539-9.458=0.081
max9.983-9.903=0.079

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.940-1.126=-0.186
σ0.057-0.248=-0.191
min0.898-0.919=-0.022
max1.040-1.510=-0.470

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.563-464.569=-0.006
σ574.771-574.780=-0.009
min177.173-177.172=0.001
max1326.720-1326.740=-0.020
mean88.250
σ8.500
min84.000
max101.000
mean2835.000-2633.000=202.000
σ0.000
min2835.000-2633.000=202.000
max2835.000-2633.000=202.000
mean0.439-0.545=-0.106
σ0.307-0.552=-0.245
min0.279-0.257=0.022
max0.900-1.373=-0.473
policies=20
mean1772.073-1772.033=0.040
σ0.360-0.345=0.015
min1771.825-1771.809=0.016
max1772.605-1772.546=0.059
mean840.000
σ0.000
min840.000
max840.000
mean2835.000-2633.000=202.000
σ0.000
min2835.000-2633.000=202.000
max2835.000-2633.000=202.000
mean2.792-2.710=0.082
σ0.014-0.008=0.006
min2.773-2.704=0.068
max2.804-2.722=0.082
policies=200
mean17727.543-17727.611=-0.068
σ0.560-0.543=0.017
min17727.155-17727.237=-0.082
max17728.374-17728.413=-0.039
mean8400.000
σ0.000
min8400.000
max8400.000
mean2835.000-2633.000=202.000
σ0.000
min2835.000-2633.000=202.000
max2835.000-2633.000=202.000
mean27.912-27.393=0.518
σ0.446-0.196=0.250
min27.546-27.214=0.333
max28.456-27.639=0.817