Compare commits

Home / Compare fb03b803 .. ea71d0fc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.375-31.040=39.335
σ0.056-0.050=0.007
min70.338-30.996=39.343
max70.531-31.177=39.355
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.159-0.079=0.079
σ0.005-0.003=0.002
min0.152-0.076=0.076
max0.165-0.085=0.080
cache=y
dps=1
iters=10
policies=100
mean21.142-21.142=0.000
σ0.002-0.003=-0.001
min21.138-21.138=0.000
max21.145-21.148=-0.003
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.064-0.063=0.001
σ0.003-0.005=-0.003
min0.060-0.058=0.003
max0.071-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.200-1751.412=0.788
σ0.361-0.361=0.001
min1751.627-1750.839=0.788
max1752.782-1751.977=0.806
mean1632.750-1639.300=-6.550
σ623.024-616.552=6.472
min617.000-626.000=-9.000
max2769.000-2474.000=295.000
mean2.846-2.850=-0.004
σ0.128-0.152=-0.023
min2.560-2.479=0.080
max3.001-3.056=-0.055

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.908-271.649=-1.741
σ0.008-0.009=-0.001
min269.895-271.640=-1.744
max269.915-271.659=-1.744
mean2769.000-2474.000=295.000
σ0.000
min2769.000-2474.000=295.000
max2769.000-2474.000=295.000
mean0.379-0.384=-0.005
σ0.005-0.003=0.002
min0.373-0.380=-0.008
max0.387-0.387=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1930.395-1932.107=-1.713
σ0.011-0.010=0.001
min1930.385-1932.095=-1.710
max1930.409-1932.118=-1.709
mean2769.000-2474.000=295.000
σ0.000
min2769.000-2474.000=295.000
max2769.000-2474.000=295.000
mean2.515-2.568=-0.054
σ0.122-0.110=0.012
min2.363-2.466=-0.104
max2.652-2.698=-0.046
iters=5
new-facts=6402
prior-facts=1
mean4750.780-4752.610=-1.831
σ0.910-0.881=0.029
min4750.112-4752.074=-1.963
max4752.380-4754.168=-1.788
mean2769.000-2474.000=295.000
σ0.000
min2769.000-2474.000=295.000
max2769.000-2474.000=295.000
mean8.437-8.401=0.036
σ0.594-0.521=0.073
min7.638-7.851=-0.214
max9.197-9.087=0.110
iters=5
new-facts=6402
prior-facts=6402
mean4941.331-4943.044=-1.713
σ0.084-0.071=0.012
min4941.261-4942.989=-1.728
max4941.433-4943.122=-1.689
mean3014.000-2965.800=48.200
σ233.310-427.085=-193.775
min2769.000-2474.000=295.000
max3320.000-3539.000=-219.000
mean8.570-8.458=0.112
σ0.218-0.117=0.101
min8.393-8.325=0.067
max8.899-8.630=0.269

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.116-1.807=-0.692
σ0.256-0.104=0.151
min0.934-1.708=-0.775
max1.555-1.941=-0.386

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.923-465.113=0.809
σ575.792-575.753=0.039
min178.021-177.234=0.787
max1329.611-1328.743=0.868
mean81.750-79.750=2.000
σ7.500
min78.000-76.000=2.000
max93.000-91.000=2.000
mean2769.000-2474.000=295.000
σ0.000
min2769.000-2474.000=295.000
max2769.000-2474.000=295.000
mean0.575-0.572=0.003
σ0.572-0.577=-0.005
min0.284-0.278=0.005
max1.433-1.437=-0.004
policies=20
mean1780.456-1772.587=7.869
σ0.355-0.335=0.020
min1780.219-1772.361=7.858
max1780.984-1773.085=7.899
mean780.000-760.000=20.000
σ0.000
min780.000-760.000=20.000
max780.000-760.000=20.000
mean2769.000-2474.000=295.000
σ0.000
min2769.000-2474.000=295.000
max2769.000-2474.000=295.000
mean2.769-2.765=0.004
σ0.022-0.037=-0.014
min2.747-2.726=0.021
max2.797-2.805=-0.008
policies=200
mean17811.312-17732.377=78.934
σ0.484-0.578=-0.094
min17811.022-17732.022=79.000
max17812.033-17733.232=78.801
mean7800.000-7600.000=200.000
σ0.000
min7800.000-7600.000=200.000
max7800.000-7600.000=200.000
mean2769.000-2474.000=295.000
σ0.000
min2769.000-2474.000=295.000
max2769.000-2474.000=295.000
mean27.799-27.766=0.033
σ0.104-0.102=0.002
min27.702-27.691=0.011
max27.938-27.912=0.026