Compare commits

Home / Compare bee3e126 .. 1984fc59

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.780-70.782=-0.002
σ0.050-0.051=-0.002
min70.747-70.753=-0.006
max70.920-70.927=-0.007
mean417.000-415.400=1.600
σ0.000-0.516=-0.516
min417.000-415.000=2.000
max417.000-416.000=1.000
mean0.158-0.160=-0.002
σ0.005-0.006=-0.000
min0.149-0.152=-0.003
max0.165-0.168=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.494-21.494=0.000
σ0.004-0.002=0.002
min21.487-21.490=-0.003
max21.499-21.496=0.003
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.065-0.063=0.002
σ0.003-0.003=-0.001
min0.063-0.059=0.004
max0.073-0.068=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.880-1751.880=-0.001
σ0.358-0.360=-0.001
min1751.309-1751.317=-0.008
max1752.465-1752.470=-0.004
mean1648.900-1637.400=11.500
σ609.384-629.634=-20.250
min643.000-621.000=22.000
max2467.000-2774.000=-307.000
mean2.834-2.822=0.013
σ0.147-0.200=-0.053
min2.462-2.250=0.212
max3.115-3.142=-0.027

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.383-269.381=0.001
σ0.009-0.006=0.003
min269.372-269.375=-0.004
max269.395-269.389=0.006
mean2467.000-2774.000=-307.000
σ0.000
min2467.000-2774.000=-307.000
max2467.000-2774.000=-307.000
mean0.381-0.378=0.003
σ0.009-0.004=0.005
min0.374-0.374=0.000
max0.394-0.384=0.010
iters=5
new-facts=1
prior-facts=6402
mean1929.745-1929.752=-0.007
σ0.007-0.008=-0.001
min1929.738-1929.746=-0.008
max1929.754-1929.766=-0.011
mean2467.000-2774.000=-307.000
σ0.000
min2467.000-2774.000=-307.000
max2467.000-2774.000=-307.000
mean2.859-3.051=-0.191
σ0.206-0.137=0.069
min2.538-2.857=-0.319
max3.031-3.226=-0.195
iters=5
new-facts=6402
prior-facts=1
mean4750.512-4750.526=-0.013
σ0.836-0.837=-0.002
min4750.074-4750.025=0.048
max4752.005-4752.014=-0.009
mean2467.000-2774.000=-307.000
σ0.000
min2467.000-2774.000=-307.000
max2467.000-2774.000=-307.000
mean8.417-8.328=0.090
σ0.377-0.469=-0.092
min7.891-7.664=0.227
max8.898-8.962=-0.064
iters=5
new-facts=6402
prior-facts=6402
mean4940.989-4940.983=0.007
σ0.013-0.020=-0.007
min4940.975-4940.949=0.026
max4941.004-4941.000=0.004
mean2952.600-3035.200=-82.600
σ328.552-259.901=68.650
min2467.000-2774.000=-307.000
max3349.000-3400.000=-51.000
mean8.457-8.538=-0.081
σ0.138-0.138=0.001
min8.300-8.384=-0.083
max8.678-8.669=0.009

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.777-0.990=0.787
σ0.114-0.136=-0.022
min1.630-0.914=0.716
max1.907-1.233=0.674

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.684-462.705=-0.021
σ574.922-574.966=-0.044
min175.217-175.221=-0.004
max1325.068-1325.155=-0.087
mean86.250
σ8.500
min82.000
max99.000
mean2467.000-2774.000=-307.000
σ0.000
min2467.000-2774.000=-307.000
max2467.000-2774.000=-307.000
mean0.541-0.564=-0.023
σ0.518-0.575=-0.057
min0.277-0.274=0.002
max1.318-1.427=-0.108
policies=20
mean1752.486-1752.496=-0.010
σ0.361-0.374=-0.013
min1752.255-1752.250=0.005
max1753.024-1753.053=-0.029
mean820.000
σ0.000
min820.000
max820.000
mean2467.000-2774.000=-307.000
σ0.000
min2467.000-2774.000=-307.000
max2467.000-2774.000=-307.000
mean2.722-2.742=-0.020
σ0.016-0.016=-0.000
min2.705-2.726=-0.021
max2.740-2.760=-0.020
policies=200
mean17532.206-17532.312=-0.106
σ0.450-0.483=-0.033
min17531.824-17532.055=-0.231
max17532.857-17533.036=-0.180
mean8200.000
σ0.000
min8200.000
max8200.000
mean2467.000-2774.000=-307.000
σ0.000
min2467.000-2774.000=-307.000
max2467.000-2774.000=-307.000
mean27.594-27.523=0.070
σ0.091-0.075=0.015
min27.525-27.457=0.068
max27.726-27.629=0.096