Compare commits

Home / Compare 280c24c5 .. cd1dea7d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.958-30.958=0.000
σ0.049-0.051=-0.002
min30.921-30.915=0.006
max31.094-31.098=-0.004
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.080-0.075=0.005
σ0.004-0.005=-0.001
min0.076-0.070=0.006
max0.085-0.083=0.002
cache=y
dps=1
iters=10
policies=100
mean21.060-21.060=0.000
σ0.003-0.003=-0.001
min21.055-21.053=0.003
max21.064-21.063=0.001
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.061-0.061=0.001
σ0.003-0.003=-0.000
min0.058-0.057=0.001
max0.067-0.067=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.413-1751.411=0.003
σ0.361-0.362=-0.002
min1750.844-1750.844=-0.000
max1751.989-1751.982=0.008
mean1642.300-1658.050=-15.750
σ617.236-622.914=-5.679
min670.000-635.000=35.000
max2554.000-2506.000=48.000
mean2.846-2.773=0.074
σ0.121-0.216=-0.095
min2.591-2.172=0.419
max3.079-3.174=-0.095

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.073-279.071=0.002
σ0.008-0.011=-0.002
min279.064-279.060=0.004
max279.085-279.084=0.001
mean2554.000-2506.000=48.000
σ0.000
min2554.000-2506.000=48.000
max2554.000-2506.000=48.000
mean0.392-0.388=0.004
σ0.005-0.002=0.004
min0.386-0.386=-0.000
max0.398-0.390=0.008
iters=5
new-facts=1
prior-facts=6402
mean1939.511-1939.513=-0.002
σ0.008-0.008=-0.000
min1939.498-1939.501=-0.003
max1939.518-1939.520=-0.002
mean2554.000-2506.000=48.000
σ0.000
min2554.000-2506.000=48.000
max2554.000-2506.000=48.000
mean3.039-3.086=-0.048
σ0.054-0.104=-0.049
min3.003-3.008=-0.005
max3.134-3.228=-0.094
iters=5
new-facts=6402
prior-facts=1
mean4760.070-4760.063=0.007
σ0.857-0.849=0.008
min4759.559-4759.590=-0.030
max4761.592-4761.571=0.020
mean2554.000-2506.000=48.000
σ0.000
min2554.000-2506.000=48.000
max2554.000-2506.000=48.000
mean8.190-8.643=-0.453
σ0.565-0.759=-0.194
min7.713-7.676=0.037
max9.164-9.513=-0.349
iters=5
new-facts=6402
prior-facts=6402
mean4950.469-4950.469=-0.000
σ0.083-0.086=-0.003
min4950.401-4950.404=-0.003
max4950.571-4950.563=0.007
mean2961.800-3037.800=-76.000
σ393.388-300.734=92.654
min2554.000-2616.000=-62.000
max3516.000-3418.000=98.000
mean8.521-8.611=-0.090
σ0.278-0.192=0.086
min8.324-8.316=0.008
max9.008-8.789=0.218

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.587-1.665=-0.078
σ0.233-0.183=0.050
min1.221-1.401=-0.180
max1.786-1.918=-0.132

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.336-463.333=0.003
σ572.201-572.198=0.003
min177.232-177.232=0.000
max1321.638-1321.630=0.008
mean79.750
σ7.500
min76.000
max91.000
mean2554.000-2506.000=48.000
σ0.000
min2554.000-2506.000=48.000
max2554.000-2506.000=48.000
mean0.572-0.566=0.005
σ0.578-0.569=0.010
min0.276-0.274=0.002
max1.439-1.419=0.020
policies=20
mean1772.590-1772.555=0.036
σ0.325-0.327=-0.002
min1772.373-1772.356=0.017
max1773.073-1773.042=0.031
mean760.000
σ0.000
min760.000
max760.000
mean2554.000-2506.000=48.000
σ0.000
min2554.000-2506.000=48.000
max2554.000-2506.000=48.000
mean2.737-2.738=-0.001
σ0.013-0.009=0.004
min2.718-2.730=-0.012
max2.748-2.750=-0.002
policies=200
mean17732.440-17732.405=0.035
σ0.408-0.572=-0.163
min17732.197-17732.019=0.178
max17733.051-17733.237=-0.186
mean7600.000
σ0.000
min7600.000
max7600.000
mean2554.000-2506.000=48.000
σ0.000
min2554.000-2506.000=48.000
max2554.000-2506.000=48.000
mean27.640-27.604=0.036
σ0.163-0.077=0.086
min27.463-27.498=-0.035
max27.809-27.679=0.130