Compare commits

Home / Compare 9e30c057 .. fe8322ca

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.702-70.703=-0.001
σ0.047-0.049=-0.002
min70.671-70.667=0.005
max70.831-70.838=-0.007
mean414.000
σ0.000
min414.000
max414.000
mean0.161-0.161=-0.001
σ0.004-0.003=0.000
min0.158-0.159=-0.001
max0.168-0.168=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.408-21.408=0.000
σ0.004-0.003=0.001
min21.405-21.401=0.004
max21.415-21.411=0.004
mean414.000-414.500=-0.500
σ0.000-0.527=-0.527
min414.000
max414.000-415.000=-1.000
mean0.065-0.063=0.002
σ0.002-0.004=-0.002
min0.063-0.059=0.005
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.929-1754.929=-0.001
σ0.360-0.362=-0.002
min1754.362-1754.357=0.005
max1755.510-1755.512=-0.001
mean1648.350-1660.650=-12.300
σ633.115-646.005=-12.890
min625.000-623.000=2.000
max2774.000-2779.000=-5.000
mean2.846-2.782=0.064
σ0.169-0.179=-0.011
min2.547-2.248=0.299
max3.190-2.978=0.212

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.756-272.757=-0.000
σ0.006-0.006=-0.000
min272.749-272.750=-0.001
max272.762-272.764=-0.002
mean2774.000-2779.000=-5.000
σ0.000
min2774.000-2779.000=-5.000
max2774.000-2779.000=-5.000
mean0.380-0.383=-0.003
σ0.002-0.008=-0.006
min0.379-0.378=0.001
max0.383-0.397=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1933.159-1933.168=-0.009
σ0.012-0.015=-0.003
min1933.146-1933.145=0.001
max1933.178-1933.181=-0.003
mean2774.000-2779.000=-5.000
σ0.000
min2774.000-2779.000=-5.000
max2774.000-2779.000=-5.000
mean3.094-3.057=0.037
σ0.117-0.054=0.063
min2.989-3.019=-0.029
max3.273-3.152=0.120
iters=5
new-facts=6402
prior-facts=1
mean4756.897-4756.923=-0.026
σ7.595-7.561=0.033
min4753.419-4753.485=-0.066
max4770.482-4770.449=0.034
mean2774.000-2779.000=-5.000
σ0.000
min2774.000-2779.000=-5.000
max2774.000-2779.000=-5.000
mean8.711-8.436=0.275
σ0.290-0.400=-0.109
min8.334-7.837=0.497
max9.101-8.909=0.192
iters=5
new-facts=6402
prior-facts=6402
mean4944.252-4944.325=-0.073
σ0.187-0.146=0.041
min4944.047-4944.065=-0.018
max4944.412-4944.406=0.006
mean2998.600-3038.200=-39.600
σ286.518-315.303=-28.784
min2774.000-2779.000=-5.000
max3434.000-3512.000=-78.000
mean8.393-8.496=-0.102
σ0.042-0.114=-0.072
min8.360-8.414=-0.054
max8.447-8.690=-0.242

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.111-1.003=0.108
σ0.272-0.134=0.137
min0.918-0.914=0.004
max1.502-1.220=0.281

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.343-468.339=0.005
σ574.266-574.257=0.010
min181.200-181.203=-0.002
max1329.743-1329.724=0.019
mean88.250
σ8.500
min84.000
max101.000
mean2774.000-2779.000=-5.000
σ0.000
min2774.000-2779.000=-5.000
max2774.000-2779.000=-5.000
mean0.445-0.446=-0.001
σ0.304-0.301=0.003
min0.290-0.291=-0.002
max0.900-0.896=0.004
policies=20
mean1812.374-1812.370=0.004
σ0.394-0.395=-0.001
min1812.102-1812.090=0.012
max1812.952-1812.948=0.004
mean840.000
σ0.000
min840.000
max840.000
mean2774.000-2779.000=-5.000
σ0.000
min2774.000-2779.000=-5.000
max2774.000-2779.000=-5.000
mean2.891-2.886=0.005
σ0.010-0.006=0.004
min2.879-2.877=0.002
max2.901-2.890=0.011
policies=200
mean18129.101-18129.090=0.011
σ0.442-0.526=-0.084
min18128.707-18128.626=0.080
max18129.713-18129.577=0.136
mean8400.000
σ0.000
min8400.000
max8400.000
mean2774.000-2779.000=-5.000
σ0.000
min2774.000-2779.000=-5.000
max2774.000-2779.000=-5.000
mean28.559-28.545=0.014
σ0.224-0.238=-0.014
min28.380-28.328=0.052
max28.877-28.884=-0.007