Compare commits

Home / Compare 85098e11 .. fdbb0665

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.719-36.728=-0.009
σ0.689-0.608=0.081
min35.905-35.941=-0.036
max37.531-37.212=0.320
mean3974.000-3834.000=140.000
σ0.000
min3974.000-3834.000=140.000
max3974.000-3834.000=140.000
mean0.072-0.075=-0.003
σ0.003-0.003=-0.000
min0.070-0.070=-0.000
max0.079-0.081=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.711-26.713=-0.001
σ0.646-0.876=-0.229
min26.205-26.210=-0.005
max27.466-28.716=-1.249
mean3974.000-3834.000=140.000
σ0.000
min3974.000-3834.000=140.000
max3974.000-3834.000=140.000
mean0.057-0.061=-0.004
σ0.001-0.002=-0.001
min0.056-0.058=-0.002
max0.060-0.065=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.367-1756.367=-0.000
σ0.372-0.374=-0.001
min1755.793-1755.792=0.001
max1756.965-1756.970=-0.005
mean1663.650-1650.050=13.600
σ646.076-631.352=14.725
min626.000-629.000=-3.000
max2855.000-2811.000=44.000
mean2.269-2.260=0.008
σ0.124-0.085=0.039
min2.141-2.155=-0.014
max2.715-2.446=0.269

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.696-278.699=-0.002
σ0.011-0.012=-0.000
min278.687-278.683=0.003
max278.715-278.713=0.002
mean2855.000-2811.000=44.000
σ0.000
min2855.000-2811.000=44.000
max2855.000-2811.000=44.000
mean0.418-0.419=-0.001
σ0.002-0.001=0.002
min0.415-0.418=-0.003
max0.422-0.420=0.002
iters=5
new-facts=1
prior-facts=6402
mean2268.872-2268.874=-0.002
σ0.007-0.006=0.000
min2268.861-2268.867=-0.005
max2268.880-2268.883=-0.003
mean2855.000-2811.000=44.000
σ0.000
min2855.000-2811.000=44.000
max2855.000-2811.000=44.000
mean2.914-3.196=-0.282
σ0.152-0.179=-0.028
min2.720-2.946=-0.226
max3.140-3.452=-0.313
iters=5
new-facts=6402
prior-facts=1
mean4952.126-4952.369=-0.244
σ0.952-0.774=0.177
min4951.393-4951.933=-0.540
max4953.723-4953.750=-0.027
mean2855.000-2811.000=44.000
σ0.000
min2855.000-2811.000=44.000
max2855.000-2811.000=44.000
mean7.786-7.878=-0.092
σ0.219-0.246=-0.027
min7.625-7.665=-0.040
max8.148-8.217=-0.070
iters=5
new-facts=6402
prior-facts=6402
mean5167.073-5167.072=0.001
σ0.010-0.006=0.004
min5167.065-5167.067=-0.003
max5167.088-5167.083=0.005
mean3401.400-3376.600=24.800
σ433.487-472.392=-38.904
min2855.000-2811.000=44.000
max3974.000-3834.000=140.000
mean9.201-9.109=0.092
σ0.309-0.056=0.252
min8.814-9.058=-0.245
max9.556-9.194=0.362

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.145-1.413=-0.268
σ0.252-0.373=-0.121
min0.938-0.936=0.002
max1.536-1.853=-0.316

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.257-460.260=-0.003
σ572.607-572.608=-0.001
min173.951-173.955=-0.003
max1319.167-1319.172=-0.005
mean79.500
σ7.000
min76.000
max90.000
mean436.000-430.500=5.500
σ0.000-1.000=-1.000
min436.000-430.000=6.000
max436.000-432.000=4.000
mean0.555-0.565=-0.010
σ0.562-0.581=-0.018
min0.266-0.266=0.000
max1.398-1.436=-0.037
policies=20
mean1740.030-1740.038=-0.008
σ0.332-0.323=0.009
min1739.784-1739.811=-0.027
max1740.516-1740.514=0.002
mean760.000
σ0.000
min760.000
max760.000
mean445.750-445.250=0.500
σ9.605-11.615=-2.011
min436.000-432.000=4.000
max454.000-455.000=-1.000
mean2.660-2.669=-0.009
σ0.013-0.015=-0.002
min2.650-2.658=-0.008
max2.677-2.690=-0.013
policies=200
mean17409.596-17409.693=-0.096
σ0.033-0.126=-0.093
min17409.555-17409.558=-0.003
max17409.635-17409.803=-0.168
mean7600.000
σ0.000
min7600.000
max7600.000
mean487.750-490.250=-2.500
σ0.957-2.986=-2.029
min487.000-486.000=1.000
max489.000-493.000=-4.000
mean26.957-26.869=0.088
σ0.086-0.096=-0.010
min26.852-26.775=0.076
max27.036-26.991=0.045