Compare commits

Home / Compare c1cf511e .. e4183c87

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.913=0.001
σ0.367-0.367=-0.000
min53.786-53.777=0.009
max54.957-54.957=0.000
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.137-0.135=0.001
σ0.004-0.005=-0.000
min0.130-0.129=0.001
max0.143-0.141=0.002
cache=y
dps=1
iters=10
policies=100
mean43.141-43.140=0.001
σ0.007-0.006=0.000
min43.129-43.130=-0.001
max43.153-43.150=0.003
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.118-0.118=-0.000
σ0.004-0.005=-0.000
min0.113-0.113=0.001
max0.124-0.126=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.084-992.081=0.003
σ1.221-1.236=-0.014
min991.487-991.499=-0.012
max997.204-997.272=-0.069
mean1073.000-1072.200=0.800
σ324.571-324.413=0.158
min602.000
max1643.000-1644.000=-1.000
mean1.505-1.516=-0.011
σ0.070-0.084=-0.015
min1.442-1.368=0.075
max1.755-1.815=-0.060

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.674-285.677=-0.003
σ0.012-0.009=0.003
min285.655-285.662=-0.007
max285.685-285.683=0.002
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean0.376-0.377=-0.000
σ0.003-0.001=0.001
min0.373-0.375=-0.002
max0.379-0.378=0.002
iters=5
new-facts=1
prior-facts=6402
mean1285.637-1285.638=-0.002
σ0.134-0.133=0.001
min1285.572-1285.574=-0.003
max1285.876-1285.876=-0.000
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean1.897-1.884=0.013
σ0.067-0.056=0.011
min1.823-1.828=-0.005
max2.002-1.961=0.041
iters=5
new-facts=6402
prior-facts=1
mean1807.979-1807.983=-0.004
σ7.009-7.012=-0.003
min1804.615-1804.601=0.014
max1820.502-1820.510=-0.008
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean4.186-4.224=-0.038
σ0.157-0.212=-0.055
min3.973-3.947=0.026
max4.395-4.484=-0.089
iters=5
new-facts=6402
prior-facts=6402
mean2070.467-2070.463=0.004
σ0.011-0.008=0.003
min2070.460-2070.457=0.004
max2070.487-2070.477=0.009
mean1865.200-1850.400=14.800
σ200.147-172.998=27.149
min1643.000-1644.000=-1.000
max2096.000-2092.000=4.000
mean4.531-4.537=-0.007
σ0.062-0.191=-0.129
min4.471-4.386=0.084
max4.606-4.867=-0.261

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.189-1.219=-0.030
σ0.277-0.357=-0.080
min0.909-0.905=0.003
max1.640-1.823=-0.183

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.380-437.382=-0.002
σ572.364-572.361=0.003
min151.196-151.194=0.002
max1295.926-1295.924=0.002
mean90.250
σ8.500
min86.000
max103.000
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean0.538-0.500=0.038
σ0.564-0.491=0.073
min0.251-0.248=0.003
max1.383-1.236=0.147
policies=20
mean1512.216-1512.203=0.013
σ0.257-0.248=0.009
min1512.051-1512.056=-0.005
max1512.600-1512.574=0.026
mean860.000
σ0.000
min860.000
max860.000
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean2.545-2.538=0.007
σ0.016-0.007=0.008
min2.531-2.530=0.001
max2.567-2.547=0.019
policies=200
mean15129.638-15129.580=0.058
σ0.072-0.332=-0.259
min15129.542-15129.087=0.456
max15129.717-15129.800=-0.083
mean8600.000
σ0.000
min8600.000
max8600.000
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean25.689-25.776=-0.087
σ0.154-0.199=-0.045
min25.552-25.562=-0.010
max25.888-26.043=-0.155