Compare commits

Home / Compare 122bb49a .. 03c9dc57

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.704-53.704=0.000
σ0.363-0.365=-0.002
min53.571-53.566=0.005
max54.738-54.742=-0.005
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.138-0.136=0.002
σ0.004-0.005=-0.001
min0.133-0.127=0.006
max0.145-0.142=0.003
cache=y
dps=1
iters=10
policies=100
mean42.978-42.977=0.001
σ0.005-0.005=-0.000
min42.971-42.971=-0.000
max42.986-42.988=-0.002
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.119-0.118=0.002
σ0.003-0.004=-0.002
min0.115-0.113=0.002
max0.125-0.126=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean994.904-994.902=0.001
σ1.166-1.202=-0.035
min994.358-994.363=-0.005
max999.795-999.946=-0.151
mean1080.600-1061.350=19.250
σ333.473-323.131=10.342
min597.000-561.000=36.000
max1638.000-1625.000=13.000
mean1.440-1.454=-0.014
σ0.076-0.078=-0.002
min1.381-1.390=-0.009
max1.715-1.651=0.063

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.312-297.314=-0.002
σ0.012-0.008=0.003
min297.295-297.307=-0.012
max297.326-297.328=-0.002
mean1638.000-1625.000=13.000
σ0.000
min1638.000-1625.000=13.000
max1638.000-1625.000=13.000
mean0.392-0.394=-0.002
σ0.006-0.007=-0.000
min0.386-0.387=-0.001
max0.400-0.402=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1298.673-1298.661=0.012
σ0.083-0.025=0.058
min1298.528-1298.625=-0.097
max1298.729-1298.690=0.039
mean1638.000-1625.000=13.000
σ0.000
min1638.000-1625.000=13.000
max1638.000-1625.000=13.000
mean1.889-1.883=0.006
σ0.064-0.050=0.014
min1.823-1.833=-0.010
max1.985-1.964=0.020
iters=5
new-facts=6402
prior-facts=1
mean1718.874-1718.875=-0.001
σ6.889-6.934=-0.045
min1715.695-1715.648=0.048
max1731.194-1731.275=-0.081
mean1638.000-1625.000=13.000
σ0.000
min1638.000-1625.000=13.000
max1638.000-1625.000=13.000
mean2.978-2.959=0.019
σ0.207-0.443=-0.236
min2.806-2.533=0.273
max3.301-3.687=-0.386
iters=5
new-facts=6402
prior-facts=6402
mean1981.589-1981.621=-0.032
σ0.041-0.016=0.024
min1981.516-1981.602=-0.086
max1981.609-1981.640=-0.031
mean1850.600-1880.600=-30.000
σ207.390-194.444=12.947
min1638.000-1625.000=13.000
max2098.000-2087.000=11.000
mean3.184-3.258=-0.074
σ0.077-0.093=-0.016
min3.108-3.143=-0.035
max3.303-3.345=-0.042

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.271-1.198=0.073
σ0.347-0.277=0.070
min0.909-0.916=-0.007
max1.627-1.648=-0.022

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.374-440.371=0.003
σ572.879-572.883=-0.004
min153.927-153.927=0.001
max1299.693-1299.696=-0.003
mean94.250
σ8.500
min90.000
max107.000
mean1638.000-1625.000=13.000
σ0.000
min1638.000-1625.000=13.000
max1638.000-1625.000=13.000
mean0.548-0.542=0.006
σ0.564-0.573=-0.008
min0.264-0.254=0.009
max1.394-1.401=-0.007
policies=20
mean1539.520-1539.512=0.008
σ0.316-0.298=0.017
min1539.317-1539.325=-0.007
max1539.990-1539.956=0.033
mean900.000
σ0.000
min900.000
max900.000
mean1638.000-1625.000=13.000
σ0.000
min1638.000-1625.000=13.000
max1638.000-1625.000=13.000
mean2.584-2.558=0.026
σ0.041-0.010=0.031
min2.546-2.548=-0.002
max2.642-2.569=0.073
policies=200
mean15403.070-15403.078=-0.008
σ0.101-0.057=0.044
min15402.953-15403.026=-0.073
max15403.196-15403.159=0.037
mean9000.000
σ0.000
min9000.000
max9000.000
mean1638.000-1625.000=13.000
σ0.000
min1638.000-1625.000=13.000
max1638.000-1625.000=13.000
mean25.980-25.983=-0.003
σ0.164-0.211=-0.047
min25.823-25.817=0.006
max26.190-26.259=-0.069