Compare commits

Home / Compare b879cefb .. b391ba2b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.376-70.376=-0.000
σ0.056-0.059=-0.004
min70.346-70.335=0.011
max70.531-70.541=-0.010
mean417.000-416.800=0.200
σ0.000-0.422=-0.422
min417.000-416.000=1.000
max417.000
mean0.166-0.158=0.009
σ0.008-0.004=0.004
min0.157-0.151=0.006
max0.178-0.163=0.015
cache=y
dps=1
iters=10
policies=100
mean21.142-21.144=-0.001
σ0.002-0.002=-0.000
min21.140-21.141=-0.001
max21.144-21.145=-0.001
mean417.000
σ0.000
min417.000
max417.000
mean0.062-0.064=-0.002
σ0.004-0.003=0.001
min0.058-0.062=-0.004
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.200-1752.202=-0.002
σ0.361-0.361=0.000
min1751.633-1751.629=0.004
max1752.790-1752.792=-0.002
mean1644.400-1640.850=3.550
σ616.990-613.939=3.051
min635.000-630.000=5.000
max2481.000-2471.000=10.000
mean2.786-2.865=-0.079
σ0.146-0.098=0.048
min2.407-2.735=-0.328
max2.973-3.060=-0.087

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.937-269.936=0.001
σ0.004-0.006=-0.002
min269.932-269.928=0.003
max269.942-269.944=-0.002
mean2481.000-2471.000=10.000
σ0.000
min2481.000-2471.000=10.000
max2481.000-2471.000=10.000
mean0.388-0.384=0.004
σ0.012-0.010=0.002
min0.379-0.374=0.004
max0.409-0.397=0.011
iters=5
new-facts=1
prior-facts=6402
mean1930.403-1930.398=0.004
σ0.004-0.009=-0.005
min1930.398-1930.387=0.011
max1930.408-1930.410=-0.002
mean2481.000-2471.000=10.000
σ0.000
min2481.000-2471.000=10.000
max2481.000-2471.000=10.000
mean2.474-2.501=-0.027
σ0.035-0.057=-0.022
min2.436-2.436=-0.000
max2.527-2.567=-0.040
iters=5
new-facts=6402
prior-facts=1
mean4750.788-4750.931=-0.143
σ0.915-0.780=0.135
min4750.006-4750.500=-0.494
max4752.374-4752.319=0.055
mean2481.000-2471.000=10.000
σ0.000
min2481.000-2471.000=10.000
max2481.000-2471.000=10.000
mean8.385-8.080=0.305
σ0.509-0.402=0.107
min7.663-7.683=-0.020
max9.016-8.623=0.393
iters=5
new-facts=6402
prior-facts=6402
mean4941.331-4941.319=0.012
σ0.090-0.082=0.009
min4941.254-4941.253=0.001
max4941.431-4941.410=0.022
mean2996.200-2971.800=24.400
σ283.369-433.744=-150.374
min2606.000-2482.000=124.000
max3330.000-3563.000=-233.000
mean8.563-8.374=0.189
σ0.127-0.139=-0.012
min8.419-8.262=0.157
max8.754-8.612=0.142

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.738-1.810=-0.071
σ0.132-0.128=0.004
min1.596-1.611=-0.015
max1.874-1.928=-0.054

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.933-465.930=0.003
σ575.814-575.815=-0.001
min178.024-178.021=0.003
max1329.654-1329.653=0.002
mean81.750
σ7.500
min78.000
max93.000
mean2481.000-2471.000=10.000
σ0.000
min2481.000-2471.000=10.000
max2481.000-2471.000=10.000
mean0.556-0.565=-0.009
σ0.548-0.564=-0.016
min0.281-0.279=0.002
max1.378-1.411=-0.033
policies=20
mean1780.463-1780.453=0.010
σ0.339-0.355=-0.016
min1780.223-1780.214=0.009
max1780.963-1780.978=-0.015
mean780.000
σ0.000
min780.000
max780.000
mean2481.000-2471.000=10.000
σ0.000
min2481.000-2471.000=10.000
max2481.000-2471.000=10.000
mean2.763-2.776=-0.013
σ0.014-0.009=0.005
min2.750-2.767=-0.017
max2.782-2.787=-0.005
policies=200
mean17811.377-17811.521=-0.144
σ0.569-0.469=0.100
min17810.988-17811.245=-0.257
max17812.216-17812.222=-0.006
mean7800.000
σ0.000
min7800.000
max7800.000
mean2481.000-2471.000=10.000
σ0.000
min2481.000-2471.000=10.000
max2481.000-2471.000=10.000
mean27.862-27.917=-0.055
σ0.044-0.073=-0.029
min27.820-27.838=-0.018
max27.906-28.007=-0.102