Compare commits

Home / Compare dcdad2b3 .. 8fb7c962

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.971-32.839=1.132
σ0.053-0.370=-0.317
min33.940-32.704=1.236
max34.121-33.893=0.229
mean413.000-416.300=-3.300
σ0.000-0.483=-0.483
min413.000-416.000=-3.000
max413.000-417.000=-4.000
mean0.085-0.082=0.003
σ0.003-0.005=-0.001
min0.082-0.077=0.005
max0.091-0.089=0.002
cache=y
dps=1
iters=10
policies=100
mean23.318-22.088=1.231
σ0.003-0.003=0.000
min23.311-22.083=1.227
max23.322-22.091=1.231
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.065-0.067=-0.002
σ0.002-0.003=-0.001
min0.064-0.064=0.000
max0.071-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean998.459-983.406=15.053
σ0.188-1.103=-0.914
min998.186-982.885=15.301
max998.761-988.032=10.730
mean1050.750-1056.000=-5.250
σ299.478-311.477=-11.999
min640.000-638.000=2.000
max1513.000-1519.000=-6.000
mean1.432-1.408=0.024
σ0.076-0.108=-0.032
min1.370-1.327=0.043
max1.696-1.802=-0.106

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.769-262.595=24.174
σ0.005-0.009=-0.004
min286.762-262.582=24.179
max286.775-262.606=24.169
mean1513.000-1519.000=-6.000
σ0.000
min1513.000-1519.000=-6.000
max1513.000-1519.000=-6.000
mean0.370-0.354=0.016
σ0.006-0.008=-0.002
min0.364-0.348=0.016
max0.379-0.363=0.016
iters=5
new-facts=1
prior-facts=6402
mean1286.865-1262.648=24.218
σ0.029-0.076=-0.047
min1286.813-1262.609=24.204
max1286.883-1262.784=24.099
mean1513.000-1519.000=-6.000
σ0.000
min1513.000-1519.000=-6.000
max1513.000-1519.000=-6.000
mean1.895-1.876=0.019
σ0.106-0.073=0.033
min1.803-1.785=0.017
max2.040-1.956=0.083
iters=5
new-facts=6402
prior-facts=1
mean4110.157-2058.199=2051.958
σ7.490-7.003=0.488
min4106.391-2054.874=2051.516
max4123.549-2070.714=2052.836
mean1513.000-1519.000=-6.000
σ0.000
min1513.000-1519.000=-6.000
max1513.000-1519.000=-6.000
mean7.401-4.556=2.845
σ0.323-0.193=0.130
min6.917-4.316=2.601
max7.763-4.794=2.970
iters=5
new-facts=6402
prior-facts=6402
mean4100.153-2047.394=2052.758
σ0.048-0.007=0.041
min4100.105-2047.383=2052.722
max4100.228-2047.402=2052.826
mean1802.200-1758.800=43.400
σ172.162-199.581=-27.419
min1591.000-1522.000=69.000
max2038.000-1961.000=77.000
mean7.761-4.444=3.318
σ0.264-0.117=0.147
min7.425-4.312=3.113
max8.128-4.610=3.518

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.541-1.542=-0.001
σ0.364-0.253=0.111
min0.947-1.131=-0.185
max1.848-1.771=0.078

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.433-437.102=27.331
σ574.777-572.825=1.952
min177.041-150.683=26.357
max1326.598-1296.339=30.258
mean88.250
σ8.500
min84.000
max101.000
mean1513.000-1519.000=-6.000
σ0.000
min1513.000-1519.000=-6.000
max1513.000-1519.000=-6.000
mean0.534-0.512=0.022
σ0.519-0.522=-0.003
min0.273-0.250=0.023
max1.312-1.296=0.017
policies=20
mean1770.743-1507.075=263.668
σ0.365-0.243=0.122
min1770.519-1506.900=263.619
max1771.289-1507.435=263.854
mean840.000
σ0.000
min840.000
max840.000
mean1513.000-1519.000=-6.000
σ0.000
min1513.000-1519.000=-6.000
max1513.000-1519.000=-6.000
mean2.717-2.505=0.211
σ0.012-0.013=-0.002
min2.703-2.493=0.210
max2.731-2.520=0.212
policies=200
mean17714.897-15078.847=2636.050
σ0.370-0.450=-0.081
min17714.668-15078.600=2636.067
max17715.450-15079.522=2635.927
mean8400.000
σ0.000
min8400.000
max8400.000
mean1513.000-1519.000=-6.000
σ0.000
min1513.000-1519.000=-6.000
max1513.000-1519.000=-6.000
mean27.443-25.426=2.017
σ0.112-0.100=0.013
min27.350-25.309=2.041
max27.603-25.537=2.066