Compare commits

Home / Compare b060f118 .. 40a66970

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-33.979=19.936
σ0.367-0.047=0.320
min53.779-33.952=19.827
max54.957-34.107=20.850
mean415.000-412.700=2.300
σ0.000-0.483=-0.483
min415.000-412.000=3.000
max415.000-413.000=2.000
mean0.139-0.084=0.054
σ0.004-0.003=0.000
min0.135-0.082=0.053
max0.146-0.092=0.054
cache=y
dps=1
iters=10
policies=100
mean43.141-23.316=19.824
σ0.007-0.003=0.004
min43.131-23.311=19.819
max43.155-23.321=19.834
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.120-0.064=0.056
σ0.003-0.003=0.000
min0.117-0.061=0.057
max0.126-0.071=0.056

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.809-1757.493=-765.684
σ1.232-0.365=0.867
min991.232-1756.920=-765.688
max996.989-1758.082=-761.093
mean1069.200-1662.000=-592.800
σ312.445-622.320=-309.875
min616.000-667.000=-51.000
max1642.000-2598.000=-956.000
mean1.514-2.383=-0.869
σ0.087-0.171=-0.085
min1.397-2.253=-0.856
max1.757-2.958=-1.201

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.411-326.646=-41.235
σ0.011-0.030=-0.019
min285.395-326.596=-41.202
max285.423-326.675=-41.252
mean1642.000-2598.000=-956.000
σ0.000
min1642.000-2598.000=-956.000
max1642.000-2598.000=-956.000
mean0.377-0.428=-0.051
σ0.007-0.004=0.002
min0.373-0.423=-0.051
max0.389-0.435=-0.046
iters=5
new-facts=1
prior-facts=6402
mean1285.371-1988.797=-703.425
σ0.126-0.014=0.112
min1285.311-1988.781=-703.470
max1285.596-1988.813=-703.217
mean1642.000-2598.000=-956.000
σ0.000
min1642.000-2598.000=-956.000
max1642.000-2598.000=-956.000
mean1.889-2.653=-0.764
σ0.140-0.186=-0.046
min1.718-2.389=-0.671
max2.074-2.896=-0.823
iters=5
new-facts=6402
prior-facts=1
mean1807.698-4813.365=-3005.667
σ7.039-7.937=-0.898
min1804.325-4809.531=-3005.206
max1820.277-4827.552=-3007.276
mean1642.000-2598.000=-956.000
σ0.000
min1642.000-2598.000=-956.000
max1642.000-2598.000=-956.000
mean4.187-8.782=-4.595
σ0.327-0.747=-0.420
min3.831-7.752=-3.920
max4.626-9.522=-4.896
iters=5
new-facts=6402
prior-facts=6402
mean2070.195-5001.123=-2930.928
σ0.016-0.153=-0.137
min2070.182-5000.852=-2930.671
max2070.222-5001.220=-2930.998
mean1852.400-2927.000=-1074.600
σ175.256-347.353=-172.096
min1642.000-2598.000=-956.000
max2096.000-3434.000=-1338.000
mean4.481-9.444=-4.964
σ0.127-0.576=-0.448
min4.395-8.509=-4.114
max4.701-9.870=-5.169

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.087-1.220=-0.133
σ0.219-0.358=-0.139
min0.887-0.942=-0.054
max1.404-1.834=-0.430

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.786-464.633=-27.847
σ572.357-574.780=-2.423
min150.605-177.240=-26.635
max1295.322-1326.803=-31.481
mean90.250-88.250=2.000
σ8.500
min86.000-84.000=2.000
max103.000-101.000=2.000
mean1642.000-2598.000=-956.000
σ0.000
min1642.000-2598.000=-956.000
max1642.000-2598.000=-956.000
mean0.514-0.542=-0.028
σ0.526-0.530=-0.005
min0.250-0.274=-0.024
max1.303-1.338=-0.035
policies=20
mean1506.274-1772.689=-266.415
σ0.232-0.354=-0.122
min1506.123-1772.453=-266.330
max1506.620-1773.215=-266.595
mean860.000-840.000=20.000
σ0.000
min860.000-840.000=20.000
max860.000-840.000=20.000
mean1642.000-2598.000=-956.000
σ0.000
min1642.000-2598.000=-956.000
max1642.000-2598.000=-956.000
mean2.516-2.739=-0.223
σ0.011-0.036=-0.025
min2.508-2.703=-0.195
max2.532-2.783=-0.252
policies=200
mean15070.319-17733.967=-2663.648
σ0.095-0.563=-0.468
min15070.244-17733.636=-2663.392
max15070.449-17734.804=-2664.355
mean8600.000-8400.000=200.000
σ0.000
min8600.000-8400.000=200.000
max8600.000-8400.000=200.000
mean1642.000-2598.000=-956.000
σ0.000
min1642.000-2598.000=-956.000
max1642.000-2598.000=-956.000
mean25.556-27.459=-1.903
σ0.146-0.150=-0.004
min25.428-27.249=-1.822
max25.757-27.570=-1.812