Compare commits

Home / Compare 516d5122 .. 0edaa861

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-35.618=-1.639
σ0.050-0.054=-0.004
min33.947-35.592=-1.645
max34.119-35.771=-1.652
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.084-0.083=0.001
σ0.003-0.004=-0.001
min0.082-0.077=0.005
max0.091-0.091=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.317-24.047=-0.730
σ0.003-0.003=-0.000
min23.314-24.044=-0.729
max23.324-24.053=-0.729
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.065-0.066=-0.001
σ0.003-0.004=-0.002
min0.063-0.061=0.003
max0.072-0.074=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.494-1756.489=1.005
σ0.365-0.366=-0.001
min1756.921-1755.914=1.007
max1758.080-1757.078=1.003
mean1647.200-1644.150=3.050
σ634.933-645.733=-10.801
min654.000-621.000=33.000
max2832.000-2726.000=106.000
mean2.377-2.361=0.016
σ0.110-0.120=-0.010
min2.281-2.234=0.047
max2.671-2.602=0.068

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.635-324.763=1.872
σ0.054-0.054=-0.000
min326.539-324.667=1.872
max326.668-324.794=1.874
mean2832.000-2726.000=106.000
σ0.000
min2832.000-2726.000=106.000
max2832.000-2726.000=106.000
mean0.423-0.428=-0.004
σ0.001-0.009=-0.008
min0.422-0.423=-0.001
max0.424-0.443=-0.019
iters=5
new-facts=1
prior-facts=6402
mean1988.804-1985.313=3.491
σ0.008-0.018=-0.009
min1988.792-1985.292=3.500
max1988.814-1985.332=3.481
mean2832.000-2726.000=106.000
σ0.000
min2832.000-2726.000=106.000
max2832.000-2726.000=106.000
mean2.703-2.673=0.030
σ0.105-0.096=0.010
min2.578-2.554=0.024
max2.831-2.750=0.081
iters=5
new-facts=6402
prior-facts=1
mean4813.663-4808.938=4.725
σ7.776-7.824=-0.049
min4810.133-4805.000=5.133
max4827.572-4822.917=4.655
mean2832.000-2726.000=106.000
σ0.000
min2832.000-2726.000=106.000
max2832.000-2726.000=106.000
mean8.991-8.751=0.240
σ0.405-0.790=-0.385
min8.602-7.774=0.828
max9.591-9.361=0.230
iters=5
new-facts=6402
prior-facts=6402
mean5001.211-4996.628=4.584
σ0.039-0.024=0.015
min5001.177-4996.601=4.577
max5001.274-4996.656=4.618
mean3054.000-3020.800=33.200
σ216.849-346.327=-129.478
min2832.000-2726.000=106.000
max3328.000-3533.000=-205.000
mean9.915-8.528=1.386
σ0.203-0.094=0.108
min9.641-8.422=1.219
max10.195-8.668=1.527

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.923-0.973=-0.050
σ0.008-0.064=-0.056
min0.915-0.917=-0.003
max0.935-1.044=-0.108

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.629-463.224=1.406
σ574.767-574.795=-0.028
min177.244-175.814=1.430
max1326.780-1325.416=1.364
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2832.000-2726.000=106.000
σ0.000
min2832.000-2726.000=106.000
max2832.000-2726.000=106.000
mean0.437-0.532=-0.095
σ0.307-0.516=-0.209
min0.279-0.271=0.007
max0.897-1.305=-0.408
policies=20
mean1772.723-1758.507=14.216
σ0.360-0.338=0.021
min1772.496-1758.295=14.201
max1773.259-1759.010=14.248
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2832.000-2726.000=106.000
σ0.000
min2832.000-2726.000=106.000
max2832.000-2726.000=106.000
mean2.794-2.705=0.089
σ0.008-0.010=-0.002
min2.788-2.696=0.093
max2.807-2.718=0.089
policies=200
mean17734.030-17592.100=141.930
σ0.398-0.447=-0.048
min17733.667-17591.849=141.818
max17734.598-17592.769=141.830
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2832.000-2726.000=106.000
σ0.000
min2832.000-2726.000=106.000
max2832.000-2726.000=106.000
mean27.776-27.297=0.479
σ0.392-0.079=0.313
min27.387-27.207=0.179
max28.181-27.387=0.794