Compare commits

Home / Compare e70d5b44 .. 1ea3a50f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.980=-0.001
σ0.050-0.050=0.001
min33.947-33.951=-0.004
max34.119-34.118=0.001
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.084-0.084=-0.000
σ0.003-0.003=0.000
min0.082-0.081=0.000
max0.091-0.090=0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.000
σ0.003-0.003=-0.000
min23.314-23.314=0.000
max23.324-23.324=-0.000
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.065-0.066=-0.001
σ0.003-0.002=0.000
min0.063-0.063=0.000
max0.072-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.494-1757.493=0.001
σ0.365-0.363=0.002
min1756.921-1756.922=-0.002
max1758.080-1758.081=-0.000
mean1647.200-1671.750=-24.550
σ634.933-643.795=-8.863
min654.000-677.000=-23.000
max2832.000-2650.000=182.000
mean2.377-2.378=-0.001
σ0.110-0.116=-0.005
min2.281-2.256=0.025
max2.671-2.728=-0.058

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.635-326.638=-0.003
σ0.054-0.050=0.004
min326.539-326.549=-0.010
max326.668-326.673=-0.005
mean2832.000-2650.000=182.000
σ0.000
min2832.000-2650.000=182.000
max2832.000-2650.000=182.000
mean0.423-0.428=-0.005
σ0.001-0.006=-0.005
min0.422-0.423=-0.000
max0.424-0.435=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1988.804-1988.807=-0.003
σ0.008-0.007=0.002
min1988.792-1988.796=-0.003
max1988.814-1988.813=0.001
mean2832.000-2650.000=182.000
σ0.000
min2832.000-2650.000=182.000
max2832.000-2650.000=182.000
mean2.703-2.702=0.002
σ0.105-0.086=0.019
min2.578-2.598=-0.019
max2.831-2.799=0.031
iters=5
new-facts=6402
prior-facts=1
mean4813.663-4813.427=0.236
σ7.776-7.872=-0.096
min4810.133-4809.065=1.068
max4827.572-4827.480=0.092
mean2832.000-2650.000=182.000
σ0.000
min2832.000-2650.000=182.000
max2832.000-2650.000=182.000
mean8.991-8.737=0.254
σ0.405-0.483=-0.077
min8.602-8.076=0.526
max9.591-9.161=0.430
iters=5
new-facts=6402
prior-facts=6402
mean5001.211-5001.207=0.004
σ0.039-0.046=-0.006
min5001.177-5001.158=0.019
max5001.274-5001.271=0.003
mean3054.000-3011.200=42.800
σ216.849-266.130=-49.281
min2832.000-2650.000=182.000
max3328.000-3353.000=-25.000
mean9.915-9.500=0.415
σ0.203-0.623=-0.421
min9.641-8.487=1.154
max10.195-10.165=0.031

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.923-1.187=-0.264
σ0.008-0.360=-0.353
min0.915-0.920=-0.005
max0.935-1.789=-0.853

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.629-464.634=-0.005
σ574.767-574.778=-0.011
min177.244-177.238=0.006
max1326.780-1326.802=-0.021
mean88.250
σ8.500
min84.000
max101.000
mean2832.000-2650.000=182.000
σ0.000
min2832.000-2650.000=182.000
max2832.000-2650.000=182.000
mean0.437-0.552=-0.115
σ0.307-0.558=-0.251
min0.279-0.270=0.009
max0.897-1.389=-0.492
policies=20
mean1772.723-1772.685=0.039
σ0.360-0.357=0.002
min1772.496-1772.444=0.051
max1773.259-1773.215=0.043
mean840.000
σ0.000
min840.000
max840.000
mean2832.000-2650.000=182.000
σ0.000
min2832.000-2650.000=182.000
max2832.000-2650.000=182.000
mean2.794-2.729=0.065
σ0.008-0.019=-0.011
min2.788-2.707=0.081
max2.807-2.752=0.054
policies=200
mean17734.030-17733.908=0.121
σ0.398-0.565=-0.166
min17733.667-17733.620=0.047
max17734.598-17734.755=-0.157
mean8400.000
σ0.000
min8400.000
max8400.000
mean2832.000-2650.000=182.000
σ0.000
min2832.000-2650.000=182.000
max2832.000-2650.000=182.000
mean27.776-27.585=0.191
σ0.392-0.081=0.311
min27.387-27.513=-0.126
max28.181-27.658=0.523