Compare commits

Home / Compare be5ceaa8 .. d9da2657

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.706-70.702=0.005
σ0.046-0.046=-0.000
min70.678-70.671=0.007
max70.834-70.829=0.005
mean411.600-416.600=-5.000
σ0.516
min411.000-416.000=-5.000
max412.000-417.000=-5.000
mean0.158-0.160=-0.003
σ0.003-0.005=-0.002
min0.155-0.150=0.005
max0.164-0.169=-0.005
cache=y
dps=1
iters=10
policies=100
mean21.412-21.409=0.004
σ0.004-0.002=0.002
min21.408-21.406=0.002
max21.419-21.411=0.008
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.063-0.063=0.000
σ0.004-0.003=0.000
min0.059-0.059=-0.000
max0.070-0.068=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.932-1754.932=0.000
σ0.362-0.359=0.002
min1754.362-1754.368=-0.006
max1755.523-1755.512=0.011
mean1668.400-1654.000=14.400
σ644.839-626.349=18.490
min665.000-627.000=38.000
max2747.000-2774.000=-27.000
mean2.756-2.834=-0.078
σ0.250-0.197=0.053
min2.260-2.142=0.118
max3.015-3.108=-0.093

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.785-272.757=0.028
σ0.006-0.005=0.001
min272.779-272.751=0.028
max272.793-272.761=0.032
mean2747.000-2774.000=-27.000
σ0.000
min2747.000-2774.000=-27.000
max2747.000-2774.000=-27.000
mean0.377-0.383=-0.006
σ0.001-0.010=-0.009
min0.376-0.376=-0.001
max0.378-0.400=-0.022
iters=5
new-facts=1
prior-facts=6402
mean1933.238-1933.172=0.066
σ0.022-0.011=0.011
min1933.220-1933.157=0.063
max1933.270-1933.187=0.083
mean2747.000-2774.000=-27.000
σ0.000
min2747.000-2774.000=-27.000
max2747.000-2774.000=-27.000
mean2.970-2.979=-0.009
σ0.290-0.081=0.209
min2.486-2.858=-0.373
max3.267-3.041=0.226
iters=5
new-facts=6402
prior-facts=1
mean4756.916-4756.871=0.046
σ7.596-7.331=0.266
min4753.398-4753.477=-0.079
max4770.504-4769.983=0.520
mean2747.000-2774.000=-27.000
σ0.000
min2747.000-2774.000=-27.000
max2747.000-2774.000=-27.000
mean8.749-8.238=0.511
σ0.412-0.420=-0.009
min8.200-7.730=0.470
max9.253-8.753=0.500
iters=5
new-facts=6402
prior-facts=6402
mean4944.239-4944.389=-0.150
σ0.203-0.021=0.182
min4944.076-4944.365=-0.288
max4944.472-4944.412=0.060
mean3003.400-3042.800=-39.400
σ297.229-328.841=-31.613
min2747.000-2774.000=-27.000
max3437.000-3536.000=-99.000
mean8.389-8.635=-0.246
σ0.076-0.265=-0.190
min8.331-8.419=-0.089
max8.522-8.961=-0.439

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.021-1.012=0.008
σ0.180-0.148=0.032
min0.910-0.918=-0.008
max1.328-1.259=0.069

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.308-468.345=-0.038
σ574.236-574.257=-0.021
min181.183-181.206=-0.023
max1329.662-1329.731=-0.069
mean88.250
σ8.500
min84.000
max101.000
mean2747.000-2774.000=-27.000
σ0.000
min2747.000-2774.000=-27.000
max2747.000-2774.000=-27.000
mean0.561-0.480=0.081
σ0.552-0.371=0.181
min0.282-0.291=-0.009
max1.389-1.036=0.352
policies=20
mean1812.139-1812.376=-0.237
σ0.317-0.390=-0.073
min1811.916-1812.106=-0.190
max1812.607-1812.951=-0.344
mean840.000
σ0.000
min840.000
max840.000
mean2747.000-2774.000=-27.000
σ0.000
min2747.000-2774.000=-27.000
max2747.000-2774.000=-27.000
mean2.812-2.888=-0.076
σ0.005-0.011=-0.005
min2.805-2.877=-0.072
max2.816-2.901=-0.084
policies=200
mean18128.813-18129.141=-0.328
σ0.573-0.449=0.125
min18128.036-18128.768=-0.732
max18129.402-18129.773=-0.372
mean8400.000
σ0.000
min8400.000
max8400.000
mean2747.000-2774.000=-27.000
σ0.000
min2747.000-2774.000=-27.000
max2747.000-2774.000=-27.000
mean28.342-28.503=-0.161
σ0.147-0.168=-0.021
min28.255-28.355=-0.100
max28.561-28.711=-0.150