Compare commits

Home / Compare 7434c8ca .. 4dfec2f0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.798=0.000
σ0.109-0.106=0.002
min35.751-35.754=-0.003
max36.106-36.100=0.006
mean415.000-414.800=0.200
σ0.000-0.422=-0.422
min415.000-414.000=1.000
max415.000
mean0.076-0.074=0.002
σ0.003-0.004=-0.001
min0.073-0.069=0.004
max0.082-0.082=0.000
cache=y
dps=1
iters=10
policies=100
mean26.064-26.064=-0.000
σ0.005-0.003=0.002
min26.058-26.058=0.000
max26.073-26.070=0.003
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.060-0.061=-0.001
σ0.004-0.002=0.002
min0.056-0.060=-0.004
max0.069-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.923-1755.923=0.000
σ0.365-0.368=-0.002
min1755.345-1755.346=-0.001
max1756.510-1756.522=-0.012
mean1661.900-1665.800=-3.900
σ626.013-627.668=-1.655
min667.000-674.000=-7.000
max2599.000-2662.000=-63.000
mean2.811-2.761=0.050
σ0.103-0.212=-0.109
min2.537-2.290=0.247
max2.953-3.044=-0.091

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.196-277.197=-0.001
σ0.005-0.004=0.001
min277.191-277.191=0.001
max277.203-277.200=0.003
mean2599.000-2662.000=-63.000
σ0.000
min2599.000-2662.000=-63.000
max2599.000-2662.000=-63.000
mean0.404-0.400=0.003
σ0.007-0.001=0.006
min0.396-0.399=-0.002
max0.414-0.402=0.012
iters=5
new-facts=1
prior-facts=6402
mean2174.436-2174.446=-0.010
σ0.006-0.020=-0.014
min2174.427-2174.427=-0.000
max2174.442-2174.479=-0.038
mean2599.000-2662.000=-63.000
σ0.000
min2599.000-2662.000=-63.000
max2599.000-2662.000=-63.000
mean2.988-2.929=0.058
σ0.218-0.126=0.092
min2.758-2.787=-0.029
max3.283-3.042=0.241
iters=5
new-facts=6402
prior-facts=1
mean5052.639-5052.595=0.044
σ0.960-0.974=-0.014
min5052.098-5052.030=0.068
max5054.345-5054.330=0.015
mean2599.000-2662.000=-63.000
σ0.000
min2599.000-2662.000=-63.000
max2599.000-2662.000=-63.000
mean8.552-8.790=-0.238
σ0.580-0.499=0.080
min7.916-8.283=-0.367
max9.411-9.562=-0.151
iters=5
new-facts=6402
prior-facts=6402
mean5188.426-5188.429=-0.003
σ0.085-0.093=-0.008
min5188.359-5188.358=0.001
max5188.522-5188.534=-0.012
mean3276.000-3232.600=43.400
σ432.241-364.611=67.630
min2674.000-2704.000=-30.000
max3674.000-3687.000=-13.000
mean8.850-9.015=-0.165
σ0.239-0.371=-0.132
min8.581-8.702=-0.121
max9.237-9.620=-0.383

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.425-1.144=0.281
σ0.397-0.230=0.168
min0.945-0.946=-0.002
max1.837-1.490=0.347

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.850-464.863=-0.013
σ572.649-572.669=-0.019
min178.523-178.525=-0.002
max1323.824-1323.867=-0.042
mean79.500
σ7.000
min76.000
max90.000
mean2599.000-2662.000=-63.000
σ0.000
min2599.000-2662.000=-63.000
max2599.000-2662.000=-63.000
mean0.553-0.542=0.011
σ0.529-0.517=0.011
min0.284-0.282=0.002
max1.346-1.318=0.028
policies=20
mean1785.478-1785.483=-0.005
σ0.347-0.340=0.007
min1785.262-1785.264=-0.002
max1785.995-1785.989=0.006
mean760.000
σ0.000
min760.000
max760.000
mean2599.000-2662.000=-63.000
σ0.000
min2599.000-2662.000=-63.000
max2599.000-2662.000=-63.000
mean2.768-2.788=-0.019
σ0.022-0.023=-0.001
min2.749-2.775=-0.026
max2.799-2.822=-0.023
policies=200
mean17861.550-17861.518=0.032
σ0.453-0.514=-0.061
min17861.280-17861.215=0.065
max17862.228-17862.284=-0.056
mean7600.000
σ0.000
min7600.000
max7600.000
mean2599.000-2662.000=-63.000
σ0.000
min2599.000-2662.000=-63.000
max2599.000-2662.000=-63.000
mean28.030-28.068=-0.038
σ0.104-0.162=-0.058
min27.909-27.883=0.026
max28.155-28.221=-0.066