Compare commits

Home / Compare 21b6ec8b .. ca1242a8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.769=-0.000
σ0.051-0.050=0.001
min30.745-30.745=0.001
max30.914-30.911=0.003
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.080-0.071=0.009
σ0.003-0.002=0.001
min0.078-0.069=0.009
max0.087-0.078=0.009
cache=y
dps=1
iters=10
policies=100
mean21.062-21.060=0.003
σ0.002-0.002=-0.000
min21.059-21.056=0.004
max21.067-21.065=0.002
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.065-0.059=0.006
σ0.002-0.003=-0.001
min0.063-0.057=0.006
max0.070-0.067=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.234-1751.235=-0.001
σ0.360-0.361=-0.001
min1750.663-1750.665=-0.001
max1751.828-1751.822=0.007
mean1648.750-1635.850=12.900
σ620.113-614.917=5.197
min681.000-625.000=56.000
max2643.000-2468.000=175.000
mean2.806-2.817=-0.011
σ0.169-0.132=0.037
min2.188-2.472=-0.284
max3.039-3.004=0.035

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.574-275.568=0.005
σ0.007-0.009=-0.001
min275.565-275.559=0.006
max275.581-275.578=0.002
mean2643.000-2468.000=175.000
σ0.000
min2643.000-2468.000=175.000
max2643.000-2468.000=175.000
mean0.407-0.404=0.003
σ0.009-0.010=-0.001
min0.396-0.395=0.001
max0.414-0.415=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2168.091-2168.102=-0.011
σ0.016-0.004=0.012
min2168.074-2168.097=-0.023
max2168.109-2168.105=0.003
mean2643.000-2468.000=175.000
σ0.000
min2643.000-2468.000=175.000
max2643.000-2468.000=175.000
mean2.935-3.002=-0.067
σ0.157-0.222=-0.065
min2.755-2.688=0.068
max3.080-3.215=-0.135
iters=5
new-facts=6402
prior-facts=1
mean5047.926-5047.788=0.138
σ0.893-0.976=-0.083
min5047.341-5047.059=0.281
max5049.508-5049.486=0.023
mean2643.000-2468.000=175.000
σ0.000
min2643.000-2468.000=175.000
max2643.000-2468.000=175.000
mean8.809-8.890=-0.081
σ0.422-0.486=-0.064
min8.252-8.128=0.124
max9.384-9.352=0.032
iters=5
new-facts=6402
prior-facts=6402
mean5179.039-5178.971=0.068
σ0.082-0.215=-0.133
min5178.962-5178.619=0.342
max5179.133-5179.155=-0.021
mean3208.800-3220.600=-11.800
σ347.036-386.759=-39.723
min2717.000-2681.000=36.000
max3631.000-3708.000=-77.000
mean9.894-9.575=0.318
σ0.173-0.427=-0.253
min9.634-8.951=0.683
max10.071-10.150=-0.079

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.203-1.715=-0.512
σ0.314-0.118=0.196
min0.949-1.527=-0.578
max1.706-1.848=-0.142

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.206-463.199=0.007
σ572.664-572.654=0.011
min176.868-176.867=0.001
max1322.202-1322.179=0.023
mean77.500
σ7.000
min74.000
max88.000
mean2643.000-2468.000=175.000
σ0.000
min2643.000-2468.000=175.000
max2643.000-2468.000=175.000
mean0.548-0.562=-0.014
σ0.527-0.563=-0.036
min0.280-0.274=0.006
max1.338-1.407=-0.069
policies=20
mean1768.974-1768.965=0.009
σ0.324-0.332=-0.008
min1768.771-1768.760=0.011
max1769.456-1769.460=-0.003
mean740.000
σ0.000
min740.000
max740.000
mean2643.000-2468.000=175.000
σ0.000
min2643.000-2468.000=175.000
max2643.000-2468.000=175.000
mean2.730-2.732=-0.002
σ0.012-0.019=-0.007
min2.718-2.708=0.010
max2.743-2.754=-0.011
policies=200
mean17696.250-17696.275=-0.025
σ0.473-0.532=-0.058
min17695.982-17696.004=-0.022
max17696.959-17697.073=-0.114
mean7400.000
σ0.000
min7400.000
max7400.000
mean2643.000-2468.000=175.000
σ0.000
min2643.000-2468.000=175.000
max2643.000-2468.000=175.000
mean27.584-27.550=0.034
σ0.071-0.203=-0.132
min27.502-27.398=0.104
max27.674-27.847=-0.173