Compare commits

Home / Compare afe46789 .. fa23ec72

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.793=0.006
σ0.108-0.107=0.001
min35.749-35.744=0.004
max36.103-36.095=0.008
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.075-0.076=-0.001
σ0.002-0.003=-0.001
min0.073-0.074=-0.000
max0.081-0.082=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.066-26.064=0.002
σ0.003-0.003=-0.000
min26.062-26.057=0.005
max26.070-26.068=0.002
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.061-0.059=0.003
σ0.002-0.003=-0.001
min0.060-0.056=0.004
max0.068-0.065=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.235-1752.890=-1.655
σ0.361-0.362=-0.001
min1750.669-1752.320=-1.651
max1751.806-1753.469=-1.663
mean1658.150-1659.500=-1.350
σ644.382-622.356=22.026
min631.000-670.000=-39.000
max2858.000-2654.000=204.000
mean2.836-2.862=-0.025
σ0.121-0.090=0.030
min2.534-2.598=-0.065
max3.006-2.990=0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.547-277.176=-1.629
σ0.011-0.011=-0.000
min275.533-277.162=-1.628
max275.561-277.189=-1.628
mean2858.000-2654.000=204.000
σ0.000
min2858.000-2654.000=204.000
max2858.000-2654.000=204.000
mean0.403-0.398=0.005
σ0.005-0.008=-0.004
min0.400-0.391=0.009
max0.411-0.408=0.003
iters=5
new-facts=1
prior-facts=6402
mean2168.102-2169.694=-1.592
σ0.008-0.022=-0.014
min2168.094-2169.666=-1.572
max2168.114-2169.727=-1.613
mean2858.000-2654.000=204.000
σ0.000
min2858.000-2654.000=204.000
max2858.000-2654.000=204.000
mean2.940-2.834=0.106
σ0.219-0.138=0.081
min2.660-2.754=-0.094
max3.235-3.080=0.155
iters=5
new-facts=6402
prior-facts=1
mean5047.913-5049.222=-1.310
σ0.943-1.324=-0.380
min5047.452-5047.784=-0.332
max5049.598-5051.358=-1.759
mean2858.000-2654.000=204.000
σ0.000
min2858.000-2654.000=204.000
max2858.000-2654.000=204.000
mean8.885-9.003=-0.119
σ0.602-0.671=-0.069
min8.051-8.115=-0.065
max9.728-9.831=-0.103
iters=5
new-facts=6402
prior-facts=6402
mean5179.050-5180.662=-1.612
σ0.089-0.085=0.005
min5178.949-5180.599=-1.650
max5179.150-5180.761=-1.611
mean3258.200-3215.000=43.200
σ326.164-482.920=-156.756
min2858.000-2654.000=204.000
max3701.000-3867.000=-166.000
mean9.787-8.785=1.002
σ0.639-0.181=0.458
min8.658-8.656=0.002
max10.241-9.095=1.146

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.060-1.185=-0.125
σ0.129-0.379=-0.250
min0.938-0.946=-0.008
max1.259-1.819=-0.560

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.208-464.858=-1.650
σ572.649-572.668=-0.020
min176.874-178.520=-1.647
max1322.181-1323.860=-1.680
mean77.500-79.500=-2.000
σ7.000
min74.000-76.000=-2.000
max88.000-90.000=-2.000
mean2858.000-2654.000=204.000
σ0.000
min2858.000-2654.000=204.000
max2858.000-2654.000=204.000
mean0.439-0.550=-0.111
σ0.302-0.523=-0.220
min0.283-0.285=-0.002
max0.892-1.334=-0.441
policies=20
mean1769.011-1785.464=-16.453
σ0.347-0.348=-0.001
min1768.782-1785.236=-16.454
max1769.524-1785.981=-16.457
mean740.000-760.000=-20.000
σ0.000
min740.000-760.000=-20.000
max740.000-760.000=-20.000
mean2858.000-2654.000=204.000
σ0.000
min2858.000-2654.000=204.000
max2858.000-2654.000=204.000
mean2.836-2.794=0.042
σ0.015-0.018=-0.004
min2.819-2.777=0.042
max2.854-2.820=0.034
policies=200
mean17696.190-17861.459=-165.269
σ0.387-0.520=-0.134
min17695.866-17861.063=-165.198
max17696.751-17862.225=-165.474
mean7400.000-7600.000=-200.000
σ0.000
min7400.000-7600.000=-200.000
max7400.000-7600.000=-200.000
mean2858.000-2654.000=204.000
σ0.000
min2858.000-2654.000=204.000
max2858.000-2654.000=204.000
mean28.213-28.235=-0.021
σ0.510-0.219=0.292
min27.657-28.044=-0.386
max28.777-28.487=0.289