Compare commits

Home / Compare d937ecfb .. 3a3b15e1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.780-70.780=0.000
σ0.054-0.052=0.002
min70.744-70.749=-0.005
max70.931-70.927=0.004
mean416.000
σ0.000
min416.000
max416.000
mean0.158-0.158=-0.001
σ0.004-0.004=-0.001
min0.151-0.152=-0.001
max0.162-0.166=-0.005
cache=y
dps=1
iters=10
policies=100
mean21.494-21.494=0.001
σ0.003-0.002=0.000
min21.491-21.490=0.001
max21.499-21.498=0.001
mean416.000
σ0.000
min416.000
max416.000
mean0.065-0.064=0.002
σ0.003-0.004=-0.001
min0.061-0.059=0.002
max0.073-0.069=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.880-1751.880=-0.000
σ0.361-0.361=0.000
min1751.311-1751.310=0.001
max1752.465-1752.467=-0.002
mean1640.600-1665.400=-24.800
σ630.266-627.395=2.872
min621.000-684.000=-63.000
max2786.000-2757.000=29.000
mean2.871-2.815=0.056
σ0.146-0.138=0.008
min2.647-2.435=0.212
max3.326-2.991=0.335

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.379-269.377=0.003
σ0.006-0.004=0.002
min269.370-269.373=-0.003
max269.387-269.382=0.006
mean2786.000-2757.000=29.000
σ0.000
min2786.000-2757.000=29.000
max2786.000-2757.000=29.000
mean0.377-0.376=0.001
σ0.003-0.005=-0.002
min0.375-0.371=0.004
max0.381-0.384=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1929.744-1929.752=-0.008
σ0.017-0.004=0.013
min1929.716-1929.747=-0.031
max1929.759-1929.755=0.004
mean2786.000-2757.000=29.000
σ0.000
min2786.000-2757.000=29.000
max2786.000-2757.000=29.000
mean3.108-3.083=0.025
σ0.173-0.104=0.070
min2.983-2.989=-0.006
max3.401-3.197=0.204
iters=5
new-facts=6402
prior-facts=1
mean4750.507-4750.378=0.128
σ0.856-0.931=-0.075
min4750.057-4749.631=0.426
max4752.035-4752.005=0.030
mean2786.000-2757.000=29.000
σ0.000
min2786.000-2757.000=29.000
max2786.000-2757.000=29.000
mean8.431-8.476=-0.045
σ0.442-0.459=-0.017
min7.695-7.809=-0.114
max8.883-8.925=-0.042
iters=5
new-facts=6402
prior-facts=6402
mean4940.909-4940.987=-0.078
σ0.155-0.015=0.140
min4940.634-4940.968=-0.333
max4940.998-4941.000=-0.002
mean3037.200-3042.800=-5.600
σ317.482-239.603=77.879
min2786.000-2757.000=29.000
max3525.000-3331.000=194.000
mean8.467-8.511=-0.044
σ0.082-0.123=-0.041
min8.400-8.373=0.027
max8.594-8.683=-0.089

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.010-0.993=0.016
σ0.156-0.142=0.014
min0.936-0.923=0.013
max1.289-1.247=0.043

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.710-462.699=0.011
σ574.967-574.941=0.026
min175.224-175.223=0.001
max1325.160-1325.111=0.049
mean86.250
σ8.500
min82.000
max99.000
mean2786.000-2757.000=29.000
σ0.000
min2786.000-2757.000=29.000
max2786.000-2757.000=29.000
mean0.555-0.562=-0.007
σ0.555-0.568=-0.013
min0.276-0.275=0.002
max1.388-1.414=-0.027
policies=20
mean1752.502-1752.491=0.012
σ0.361-0.354=0.006
min1752.279-1752.265=0.013
max1753.041-1753.020=0.022
mean820.000
σ0.000
min820.000
max820.000
mean2786.000-2757.000=29.000
σ0.000
min2786.000-2757.000=29.000
max2786.000-2757.000=29.000
mean2.745-2.730=0.015
σ0.039-0.015=0.023
min2.707-2.715=-0.008
max2.799-2.748=0.051
policies=200
mean17532.028-17532.226=-0.198
σ0.613-0.528=0.085
min17531.403-17531.864=-0.461
max17532.871-17533.002=-0.131
mean8200.000
σ0.000
min8200.000
max8200.000
mean2786.000-2757.000=29.000
σ0.000
min2786.000-2757.000=29.000
max2786.000-2757.000=29.000
mean27.479-27.581=-0.102
σ0.127-0.043=0.084
min27.357-27.535=-0.178
max27.658-27.637=0.021