Compare commits

Home / Compare 852925e9 .. 635b4fb0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.770-35.794=-5.025
σ0.050-0.108=-0.059
min30.743-35.740=-4.997
max30.909-36.099=-5.190
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.076-0.076=-0.000
σ0.004-0.004=0.000
min0.071-0.073=-0.002
max0.082-0.083=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.061-26.064=-5.002
σ0.002-0.004=-0.002
min21.057-26.056=-4.999
max21.064-26.069=-5.004
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.063-0.060=0.004
σ0.003-0.003=-0.001
min0.061-0.056=0.005
max0.071-0.068=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.420-1756.107=-4.687
σ0.361-0.366=-0.005
min1750.847-1755.537=-4.690
max1751.986-1756.698=-4.712
mean1655.400-1657.800=-2.400
σ635.048-631.468=3.581
min687.000-668.000=19.000
max2769.000-2608.000=161.000
mean2.735-2.794=-0.059
σ0.194-0.216=-0.022
min2.367-2.211=0.156
max2.931-3.153=-0.222

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.762-277.387=-1.625
σ0.008-0.005=0.003
min275.754-277.380=-1.626
max275.771-277.392=-1.621
mean2769.000-2608.000=161.000
σ0.000
min2769.000-2608.000=161.000
max2769.000-2608.000=161.000
mean0.399-0.396=0.003
σ0.007-0.007=-0.000
min0.390-0.392=-0.002
max0.405-0.408=-0.004
iters=5
new-facts=1
prior-facts=6402
mean2168.287-2174.629=-6.342
σ0.021-0.025=-0.005
min2168.252-2174.606=-6.355
max2168.302-2174.672=-6.370
mean2769.000-2608.000=161.000
σ0.000
min2769.000-2608.000=161.000
max2769.000-2608.000=161.000
mean2.977-2.851=0.126
σ0.162-0.170=-0.008
min2.741-2.760=-0.018
max3.158-3.154=0.004
iters=5
new-facts=6402
prior-facts=1
mean5048.106-5052.588=-4.482
σ0.930-0.417=0.513
min5047.582-5052.300=-4.718
max5049.758-5053.316=-3.558
mean2769.000-2608.000=161.000
σ0.000
min2769.000-2608.000=161.000
max2769.000-2608.000=161.000
mean8.934-8.571=0.363
σ0.434-0.633=-0.198
min8.308-8.041=0.267
max9.496-9.636=-0.140
iters=5
new-facts=6402
prior-facts=6402
mean5179.248-5188.608=-9.360
σ0.082-0.091=-0.009
min5179.160-5188.533=-9.373
max5179.352-5188.712=-9.360
mean3249.800-3226.800=23.000
σ362.670-536.736=-174.067
min2769.000-2608.000=161.000
max3725.000-3984.000=-259.000
mean10.022-8.757=1.265
σ0.301-0.221=0.080
min9.553-8.609=0.944
max10.300-9.147=1.153

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.005-1.333=-0.328
σ0.132-0.416=-0.284
min0.944-0.940=0.004
max1.242-1.833=-0.591

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.577-465.225=-1.648
σ572.659-572.662=-0.003
min177.238-178.891=-1.654
max1322.566-1324.219=-1.653
mean79.750-81.750=-2.000
σ7.500
min76.000-78.000=-2.000
max91.000-93.000=-2.000
mean2769.000-2608.000=161.000
σ0.000
min2769.000-2608.000=161.000
max2769.000-2608.000=161.000
mean0.438-0.542=-0.104
σ0.306-0.519=-0.213
min0.281-0.280=0.002
max0.897-1.320=-0.423
policies=20
mean1772.648-1789.147=-16.499
σ0.344-0.365=-0.021
min1772.416-1788.936=-16.520
max1773.157-1789.692=-16.535
mean760.000-780.000=-20.000
σ0.000
min760.000-780.000=-20.000
max760.000-780.000=-20.000
mean2769.000-2608.000=161.000
σ0.000
min2769.000-2608.000=161.000
max2769.000-2608.000=161.000
mean2.814-2.800=0.014
σ0.078-0.021=0.057
min2.734-2.772=-0.038
max2.918-2.821=0.097
policies=200
mean17732.925-17898.246=-165.321
σ0.549-0.405=0.144
min17732.477-17898.017=-165.540
max17733.719-17898.852=-165.133
mean7600.000-7800.000=-200.000
σ0.000
min7600.000-7800.000=-200.000
max7600.000-7800.000=-200.000
mean2769.000-2608.000=161.000
σ0.000
min2769.000-2608.000=161.000
max2769.000-2608.000=161.000
mean27.748-28.324=-0.575
σ0.177-0.095=0.082
min27.516-28.192=-0.675
max27.919-28.417=-0.498