Compare commits

Home / Compare 7a7ea898 .. 0bc90aa5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.710-53.709=0.001
σ0.365-0.364=0.001
min53.574-53.580=-0.006
max54.747-54.743=0.004
mean417.000
σ0.000
min417.000
max417.000
mean0.138-0.139=-0.001
σ0.005-0.004=0.001
min0.131-0.135=-0.004
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean42.978-42.977=0.000
σ0.006-0.006=0.000
min42.966-42.969=-0.003
max42.988-42.988=0.000
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.118-0.120=-0.002
σ0.005-0.005=-0.000
min0.113-0.114=-0.001
max0.127-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean995.220-995.212=0.007
σ1.190-1.224=-0.034
min994.686-994.625=0.061
max1000.214-1000.345=-0.131
mean1053.450-1056.150=-2.700
σ308.627-306.963=1.663
min596.000-622.000=-26.000
max1509.000-1520.000=-11.000
mean1.496-1.519=-0.023
σ0.138-0.128=0.010
min1.379-1.398=-0.019
max1.997-1.874=0.122

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.321-297.310=0.011
σ0.004-0.014=-0.011
min297.315-297.285=0.030
max297.324-297.322=0.002
mean1509.000-1520.000=-11.000
σ0.000
min1509.000-1520.000=-11.000
max1509.000-1520.000=-11.000
mean0.387-0.386=0.001
σ0.002-0.006=-0.004
min0.384-0.381=0.003
max0.390-0.395=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1299.015-1298.997=0.018
σ0.094-0.086=0.009
min1298.848-1298.845=0.003
max1299.070-1299.052=0.018
mean1509.000-1520.000=-11.000
σ0.000
min1509.000-1520.000=-11.000
max1509.000-1520.000=-11.000
mean2.034-1.890=0.144
σ0.240-0.045=0.194
min1.834-1.816=0.018
max2.426-1.936=0.490
iters=5
new-facts=6402
prior-facts=1
mean1719.185-1719.176=0.009
σ6.943-6.886=0.057
min1715.967-1715.996=-0.029
max1731.602-1731.491=0.111
mean1509.000-1520.000=-11.000
σ0.000
min1509.000-1520.000=-11.000
max1509.000-1520.000=-11.000
mean3.102-3.024=0.078
σ0.426-0.194=0.232
min2.763-2.855=-0.092
max3.805-3.344=0.461
iters=5
new-facts=6402
prior-facts=6402
mean1981.929-1981.954=-0.026
σ0.037-0.011=0.026
min1981.867-1981.946=-0.078
max1981.966-1981.973=-0.007
mean1799.800-1797.600=2.200
σ238.393-242.211=-3.818
min1524.000-1520.000=4.000
max2134.000-2104.000=30.000
mean3.286-3.163=0.123
σ0.417-0.077=0.340
min2.922-3.032=-0.110
max4.004-3.237=0.767

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.513-1.497=0.016
σ0.320-0.243=0.077
min1.115-1.237=-0.122
max1.798-1.806=-0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.451-440.455=-0.004
σ573.029-573.030=-0.001
min153.932-153.933=-0.001
max1299.994-1300.000=-0.005
mean94.250
σ8.500
min90.000
max107.000
mean1509.000-1520.000=-11.000
σ0.000
min1509.000-1520.000=-11.000
max1509.000-1520.000=-11.000
mean0.558-0.560=-0.002
σ0.596-0.608=-0.012
min0.254-0.255=-0.001
max1.453-1.473=-0.020
policies=20
mean1539.560-1539.590=-0.030
σ0.255-0.295=-0.041
min1539.389-1539.391=-0.003
max1539.937-1540.029=-0.091
mean900.000
σ0.000
min900.000
max900.000
mean1509.000-1520.000=-11.000
σ0.000
min1509.000-1520.000=-11.000
max1509.000-1520.000=-11.000
mean2.580-2.548=0.032
σ0.038-0.016=0.022
min2.537-2.525=0.012
max2.630-2.563=0.067
policies=200
mean15404.082-15404.135=-0.054
σ0.099-0.052=0.047
min15403.968-15404.083=-0.115
max15404.201-15404.196=0.005
mean9000.000
σ0.000
min9000.000
max9000.000
mean1509.000-1520.000=-11.000
σ0.000
min1509.000-1520.000=-11.000
max1509.000-1520.000=-11.000
mean26.086-25.944=0.142
σ0.180-0.087=0.093
min25.928-25.865=0.063
max26.263-26.067=0.196