Compare commits

Home / Compare e09c95a8 .. 2a5ceaf9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-30.769=39.605
σ0.058-0.048=0.010
min70.332-30.725=39.607
max70.536-30.899=39.637
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.156-0.078=0.078
σ0.004-0.004=0.000
min0.151-0.072=0.079
max0.163-0.085=0.078
cache=y
dps=1
iters=10
policies=100
mean21.141-21.060=0.082
σ0.003-0.002=0.000
min21.137-21.057=0.081
max21.146-21.063=0.082
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.060-0.061=-0.001
σ0.003-0.004=-0.001
min0.058-0.057=0.001
max0.068-0.070=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.199-1751.421=0.778
σ0.362-0.362=-0.000
min1751.629-1750.849=0.780
max1752.782-1751.997=0.785
mean1653.200-1666.050=-12.850
σ615.867-639.940=-24.072
min645.000-678.000=-33.000
max2488.000-2697.000=-209.000
mean2.781-2.865=-0.083
σ0.168-0.134=0.035
min2.327-2.490=-0.163
max3.025-3.064=-0.039

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.912-275.758=-5.846
σ0.006-0.010=-0.004
min269.902-275.744=-5.842
max269.918-275.768=-5.850
mean2488.000-2697.000=-209.000
σ0.000
min2488.000-2697.000=-209.000
max2488.000-2697.000=-209.000
mean0.381-0.404=-0.023
σ0.010-0.009=0.000
min0.371-0.397=-0.026
max0.391-0.415=-0.024
iters=5
new-facts=1
prior-facts=6402
mean1930.398-2168.288=-237.890
σ0.008-0.002=0.006
min1930.391-2168.285=-237.894
max1930.410-2168.291=-237.881
mean2488.000-2697.000=-209.000
σ0.000
min2488.000-2697.000=-209.000
max2488.000-2697.000=-209.000
mean2.524-2.912=-0.387
σ0.104-0.173=-0.070
min2.440-2.632=-0.192
max2.699-3.059=-0.360
iters=5
new-facts=6402
prior-facts=1
mean4750.846-5048.002=-297.156
σ0.842-1.024=-0.182
min4750.323-5046.975=-296.652
max4752.343-5049.723=-297.380
mean2488.000-2697.000=-209.000
σ0.000
min2488.000-2697.000=-209.000
max2488.000-2697.000=-209.000
mean8.642-8.599=0.043
σ0.568-0.408=0.159
min7.697-8.058=-0.362
max9.046-9.023=0.023
iters=5
new-facts=6402
prior-facts=6402
mean4941.335-5179.089=-237.754
σ0.088-0.286=-0.199
min4941.259-5178.586=-237.327
max4941.434-5179.306=-237.872
mean2987.200-3239.600=-252.400
σ281.327-398.563=-117.236
min2600.000-2697.000=-97.000
max3320.000-3748.000=-428.000
mean8.542-9.697=-1.155
σ0.090-0.653=-0.563
min8.461-8.688=-0.227
max8.681-10.439=-1.758

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.718-1.092=0.626
σ0.135-0.194=-0.058
min1.524-0.951=0.573
max1.836-1.344=0.492

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.903-463.573=2.330
σ575.756-572.663=3.094
min178.022-177.235=0.787
max1329.537-1322.567=6.970
mean81.750-79.750=2.000
σ7.500
min78.000-76.000=2.000
max93.000-91.000=2.000
mean2488.000-2697.000=-209.000
σ0.000
min2488.000-2697.000=-209.000
max2488.000-2697.000=-209.000
mean0.555-0.561=-0.006
σ0.552-0.567=-0.015
min0.277-0.274=0.003
max1.382-1.411=-0.029
policies=20
mean1780.453-1772.609=7.845
σ0.353-0.341=0.013
min1780.215-1772.380=7.835
max1780.978-1773.114=7.863
mean780.000-760.000=20.000
σ0.000
min780.000-760.000=20.000
max780.000-760.000=20.000
mean2488.000-2697.000=-209.000
σ0.000
min2488.000-2697.000=-209.000
max2488.000-2697.000=-209.000
mean2.769-2.757=0.013
σ0.039-0.010=0.029
min2.740-2.745=-0.005
max2.827-2.769=0.058
policies=200
mean17811.185-17732.938=78.247
σ0.572-0.561=0.011
min17810.846-17732.555=78.292
max17812.041-17733.753=78.289
mean7800.000-7600.000=200.000
σ0.000
min7800.000-7600.000=200.000
max7800.000-7600.000=200.000
mean2488.000-2697.000=-209.000
σ0.000
min2488.000-2697.000=-209.000
max2488.000-2697.000=-209.000
mean27.796-27.793=0.003
σ0.081-0.141=-0.060
min27.695-27.653=0.042
max27.892-27.976=-0.085