Compare commits

Home / Compare ce7f5a2c .. a7bd28ca

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.795-35.795=-0.000
σ0.108-0.109=-0.000
min35.753-35.747=0.006
max36.103-36.103=-0.001
mean411.200-413.000=-1.800
σ0.422-0.000=0.422
min411.000-413.000=-2.000
max412.000-413.000=-1.000
mean0.073-0.075=-0.003
σ0.004-0.006=-0.001
min0.069-0.069=-0.000
max0.080-0.085=-0.005
cache=y
dps=1
iters=10
policies=100
mean26.065-26.066=-0.001
σ0.003-0.003=0.000
min26.058-26.062=-0.005
max26.068-26.071=-0.004
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.060-0.062=-0.002
σ0.002-0.003=-0.001
min0.056-0.060=-0.004
max0.064-0.069=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.236-1751.236=0.000
σ0.363-0.362=0.001
min1750.664-1750.672=-0.009
max1751.828-1751.807=0.021
mean1650.700-1659.600=-8.900
σ642.695-621.593=21.102
min625.000-631.000=-6.000
max2841.000-2505.000=336.000
mean2.799-2.788=0.011
σ0.175-0.226=-0.051
min2.270-2.109=0.162
max2.997-2.988=0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.566-275.567=-0.001
σ0.006-0.006=-0.000
min275.556-275.559=-0.003
max275.572-275.573=-0.001
mean2841.000-2505.000=336.000
σ0.000
min2841.000-2505.000=336.000
max2841.000-2505.000=336.000
mean0.401-0.389=0.013
σ0.008-0.006=0.002
min0.395-0.385=0.010
max0.414-0.398=0.016
iters=5
new-facts=1
prior-facts=6402
mean2168.090-2168.082=0.008
σ0.014-0.022=-0.008
min2168.070-2168.051=0.019
max2168.109-2168.106=0.003
mean2841.000-2505.000=336.000
σ0.000
min2841.000-2505.000=336.000
max2841.000-2505.000=336.000
mean2.873-3.039=-0.166
σ0.171-0.167=0.003
min2.662-2.794=-0.133
max3.072-3.173=-0.102
iters=5
new-facts=6402
prior-facts=1
mean5047.784-5047.683=0.101
σ0.997-1.116=-0.119
min5046.851-5046.442=0.409
max5049.479-5049.494=-0.015
mean2841.000-2505.000=336.000
σ0.000
min2841.000-2505.000=336.000
max2841.000-2505.000=336.000
mean8.854-8.873=-0.019
σ0.500-0.360=0.140
min8.085-8.507=-0.422
max9.424-9.419=0.005
iters=5
new-facts=6402
prior-facts=6402
mean5178.973-5179.039=-0.066
σ0.204-0.089=0.115
min5178.642-5178.964=-0.321
max5179.155-5179.151=0.004
mean3284.800-3259.200=25.600
σ408.374-346.335=62.039
min2841.000-2748.000=93.000
max3862.000-3649.000=213.000
mean9.715-9.581=0.134
σ0.619-0.553=0.066
min8.700-8.685=0.016
max10.176-10.086=0.090

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.037-1.724=-0.687
σ0.134-0.168=-0.034
min0.946-1.425=-0.479
max1.251-1.816=-0.566

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.207-463.197=0.011
σ572.650-572.654=-0.005
min176.870-176.866=0.004
max1322.182-1322.178=0.004
mean77.500
σ7.000
min74.000
max88.000
mean2841.000-2505.000=336.000
σ0.000
min2841.000-2505.000=336.000
max2841.000-2505.000=336.000
mean0.439-0.562=-0.123
σ0.305-0.568=-0.263
min0.284-0.275=0.010
max0.897-1.413=-0.516
policies=20
mean1769.007-1768.970=0.037
σ0.329-0.334=-0.004
min1768.785-1768.763=0.023
max1769.494-1769.467=0.027
mean740.000
σ0.000
min740.000
max740.000
mean2841.000-2505.000=336.000
σ0.000
min2841.000-2505.000=336.000
max2841.000-2505.000=336.000
mean2.824-2.740=0.084
σ0.003-0.029=-0.026
min2.820-2.716=0.104
max2.827-2.781=0.046
policies=200
mean17696.177-17696.131=0.047
σ0.397-0.425=-0.028
min17695.813-17695.792=0.021
max17696.742-17696.751=-0.009
mean7400.000
σ0.000
min7400.000
max7400.000
mean2841.000-2505.000=336.000
σ0.000
min2841.000-2505.000=336.000
max2841.000-2505.000=336.000
mean27.979-27.572=0.407
σ0.523-0.158=0.365
min27.470-27.423=0.048
max28.587-27.751=0.836