Compare commits

Home / Compare fe0274e1 .. 5265c765

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.773-35.799=-5.026
σ0.046-0.109=-0.062
min30.749-35.751=-5.001
max30.904-36.106=-5.203
mean411.000-417.000=-6.000
σ0.000
min411.000-417.000=-6.000
max411.000-417.000=-6.000
mean0.079-0.077=0.001
σ0.003-0.005=-0.001
min0.076-0.074=0.002
max0.086-0.085=0.000
cache=y
dps=1
iters=10
policies=100
mean21.060-26.065=-5.005
σ0.003-0.003=-0.001
min21.057-26.061=-5.004
max21.065-26.071=-5.006
mean411.000-417.000=-6.000
σ0.000
min411.000-417.000=-6.000
max411.000-417.000=-6.000
mean0.064-0.061=0.004
σ0.003-0.003=-0.001
min0.062-0.056=0.006
max0.070-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.235-1755.921=-4.686
σ0.364-0.365=-0.001
min1750.671-1755.349=-4.678
max1751.827-1756.496=-4.669
mean1661.900-1669.700=-7.800
σ627.285-635.039=-7.753
min685.000-669.000=16.000
max2769.000-2632.000=137.000
mean2.844-2.804=0.039
σ0.129-0.194=-0.065
min2.439-2.200=0.239
max3.060-3.025=0.036

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean267.614-277.193=-9.579
σ17.779-0.005=17.774
min235.810-277.187=-41.377
max275.570-277.198=-1.629
mean2769.000-2632.000=137.000
σ0.000
min2769.000-2632.000=137.000
max2769.000-2632.000=137.000
mean0.380-0.393=-0.013
σ0.031-0.002=0.029
min0.326-0.390=-0.064
max0.399-0.394=0.004
iters=5
new-facts=1
prior-facts=6402
mean2168.085-2174.418=-6.333
σ0.015-0.050=-0.035
min2168.067-2174.342=-6.275
max2168.103-2174.480=-6.377
mean2769.000-2632.000=137.000
σ0.000
min2769.000-2632.000=137.000
max2769.000-2632.000=137.000
mean2.935-2.891=0.044
σ0.097-0.151=-0.054
min2.810-2.756=0.054
max3.053-3.099=-0.047
iters=5
new-facts=6402
prior-facts=1
mean5047.909-5052.602=-4.692
σ0.878-0.973=-0.096
min5047.334-5052.014=-4.680
max5049.444-5054.335=-4.891
mean2769.000-2632.000=137.000
σ0.000
min2769.000-2632.000=137.000
max2769.000-2632.000=137.000
mean8.903-8.818=0.084
σ0.507-0.599=-0.092
min8.196-7.991=0.204
max9.405-9.464=-0.059
iters=5
new-facts=6402
prior-facts=6402
mean5178.975-5188.428=-9.453
σ0.200-0.089=0.111
min5178.651-5188.352=-9.702
max5179.159-5188.528=-9.369
mean3302.400-3200.000=102.400
σ394.037-475.163=-81.125
min2769.000-2632.000=137.000
max3674.000-3834.000=-160.000
mean9.873-8.729=1.145
σ0.212-0.181=0.031
min9.534-8.626=0.907
max10.106-9.050=1.056

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.056-1.263=-0.208
σ0.184-0.338=-0.153
min0.944-0.938=0.006
max1.373-1.790=-0.418

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.203-464.863=-1.660
σ572.662-572.669=-0.007
min176.869-178.526=-1.657
max1322.197-1323.867=-1.670
mean77.500-79.500=-2.000
σ7.000
min74.000-76.000=-2.000
max88.000-90.000=-2.000
mean2769.000-2632.000=137.000
σ0.000
min2769.000-2632.000=137.000
max2769.000-2632.000=137.000
mean0.440-0.567=-0.126
σ0.305-0.567=-0.262
min0.286-0.281=0.005
max0.897-1.417=-0.519
policies=20
mean1768.972-1785.469=-16.497
σ0.302-0.343=-0.041
min1768.762-1785.243=-16.481
max1769.421-1785.979=-16.558
mean740.000-760.000=-20.000
σ0.000
min740.000-760.000=-20.000
max740.000-760.000=-20.000
mean2769.000-2632.000=137.000
σ0.000
min2769.000-2632.000=137.000
max2769.000-2632.000=137.000
mean2.772-2.786=-0.014
σ0.080-0.016=0.064
min2.714-2.774=-0.060
max2.890-2.810=0.080
policies=200
mean17696.272-17861.220=-164.948
σ0.488-0.534=-0.046
min17696.005-17860.918=-164.913
max17697.004-17862.020=-165.016
mean7400.000-7600.000=-200.000
σ0.000
min7400.000-7600.000=-200.000
max7400.000-7600.000=-200.000
mean2769.000-2632.000=137.000
σ0.000
min2769.000-2632.000=137.000
max2769.000-2632.000=137.000
mean27.577-28.253=-0.675
σ0.148-0.127=0.021
min27.413-28.143=-0.731
max27.762-28.395=-0.634