Compare commits

Home / Compare 9168a123 .. 41e13900

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.980=-0.001
σ0.048-0.050=-0.002
min33.950-33.951=-0.001
max34.113-34.118=-0.005
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.084-0.084=0.000
σ0.003-0.003=0.000
min0.082-0.081=0.000
max0.091-0.090=0.000
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.001
σ0.003-0.003=-0.000
min23.313-23.314=-0.001
max23.322-23.324=-0.003
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.062-0.066=-0.004
σ0.003-0.002=0.000
min0.060-0.063=-0.003
max0.068-0.072=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.494-1757.493=0.001
σ0.365-0.363=0.002
min1756.919-1756.922=-0.004
max1758.083-1758.081=0.003
mean1650.150-1671.750=-21.600
σ631.039-643.795=-12.756
min637.000-677.000=-40.000
max2836.000-2650.000=186.000
mean2.382-2.378=0.005
σ0.084-0.116=-0.032
min2.277-2.256=0.021
max2.597-2.728=-0.131

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.634-326.638=-0.004
σ0.054-0.050=0.004
min326.537-326.549=-0.012
max326.668-326.673=-0.006
mean2836.000-2650.000=186.000
σ0.000
min2836.000-2650.000=186.000
max2836.000-2650.000=186.000
mean0.432-0.428=0.004
σ0.009-0.006=0.003
min0.426-0.423=0.003
max0.446-0.435=0.011
iters=5
new-facts=1
prior-facts=6402
mean1988.810-1988.807=0.003
σ0.007-0.007=0.000
min1988.802-1988.796=0.006
max1988.818-1988.813=0.005
mean2836.000-2650.000=186.000
σ0.000
min2836.000-2650.000=186.000
max2836.000-2650.000=186.000
mean2.682-2.702=-0.019
σ0.141-0.086=0.054
min2.558-2.598=-0.039
max2.901-2.799=0.102
iters=5
new-facts=6402
prior-facts=1
mean4813.635-4813.427=0.208
σ7.727-7.872=-0.145
min4810.135-4809.065=1.070
max4827.457-4827.480=-0.023
mean2836.000-2650.000=186.000
σ0.000
min2836.000-2650.000=186.000
max2836.000-2650.000=186.000
mean8.724-8.737=-0.013
σ0.471-0.483=-0.012
min7.929-8.076=-0.147
max9.096-9.161=-0.065
iters=5
new-facts=6402
prior-facts=6402
mean5001.211-5001.207=0.003
σ0.025-0.046=-0.021
min5001.183-5001.158=0.025
max5001.241-5001.271=-0.030
mean3058.400-3011.200=47.200
σ229.052-266.130=-37.078
min2836.000-2650.000=186.000
max3390.000-3353.000=37.000
mean9.846-9.500=0.346
σ0.215-0.623=-0.409
min9.649-8.487=1.161
max10.156-10.165=-0.009

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.970-1.187=-0.217
σ0.070-0.360=-0.291
min0.909-0.920=-0.011
max1.052-1.789=-0.736

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.638-464.634=0.004
σ574.772-574.778=-0.006
min177.239-177.238=0.001
max1326.796-1326.802=-0.005
mean88.250
σ8.500
min84.000
max101.000
mean2836.000-2650.000=186.000
σ0.000
min2836.000-2650.000=186.000
max2836.000-2650.000=186.000
mean0.436-0.552=-0.116
σ0.305-0.558=-0.253
min0.282-0.270=0.013
max0.893-1.389=-0.496
policies=20
mean1772.709-1772.685=0.024
σ0.359-0.357=0.002
min1772.460-1772.444=0.016
max1773.240-1773.215=0.025
mean840.000
σ0.000
min840.000
max840.000
mean2836.000-2650.000=186.000
σ0.000
min2836.000-2650.000=186.000
max2836.000-2650.000=186.000
mean2.801-2.729=0.072
σ0.012-0.019=-0.008
min2.785-2.707=0.078
max2.814-2.752=0.061
policies=200
mean17734.124-17733.908=0.215
σ0.455-0.565=-0.109
min17733.849-17733.620=0.229
max17734.804-17734.755=0.048
mean8400.000
σ0.000
min8400.000
max8400.000
mean2836.000-2650.000=186.000
σ0.000
min2836.000-2650.000=186.000
max2836.000-2650.000=186.000
mean28.011-27.585=0.426
σ0.413-0.081=0.333
min27.629-27.513=0.116
max28.480-27.658=0.821