Compare commits

Home / Compare 2f20ca12 .. 8e6ccb16

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.974=-0.001
σ0.108-0.107=0.000
min35.928-35.925=0.002
max36.279-36.278=0.000
mean411.000-412.000=-1.000
σ0.000
min411.000-412.000=-1.000
max411.000-412.000=-1.000
mean0.077-0.078=-0.001
σ0.004-0.004=-0.001
min0.074-0.075=-0.001
max0.083-0.085=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.208-26.209=-0.000
σ0.004-0.004=0.001
min26.203-26.202=0.001
max26.216-26.215=0.001
mean411.000-412.000=-1.000
σ0.000
min411.000-412.000=-1.000
max411.000-412.000=-1.000
mean0.060-0.060=0.000
σ0.003-0.004=-0.000
min0.058-0.057=0.001
max0.070-0.069=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.364-1758.363=0.001
σ0.373-0.371=0.002
min1757.787-1757.787=-0.000
max1758.964-1758.961=0.003
mean1655.350-1641.900=13.450
σ623.951-623.160=0.791
min683.000-670.000=13.000
max2766.000-2764.000=2.000
mean2.379-2.388=-0.009
σ0.106-0.096=0.010
min2.162-2.276=-0.113
max2.595-2.612=-0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.510-279.512=-0.003
σ0.007-0.006=0.001
min279.501-279.504=-0.003
max279.518-279.518=0.000
mean2766.000-2764.000=2.000
σ0.000
min2766.000-2764.000=2.000
max2766.000-2764.000=2.000
mean0.412-0.409=0.003
σ0.006-0.007=-0.001
min0.406-0.404=0.003
max0.419-0.420=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2178.444-2178.434=0.010
σ0.007-0.018=-0.011
min2178.438-2178.402=0.036
max2178.456-2178.449=0.008
mean2766.000-2764.000=2.000
σ0.000
min2766.000-2764.000=2.000
max2766.000-2764.000=2.000
mean3.307-3.351=-0.044
σ0.099-0.084=0.015
min3.218-3.262=-0.044
max3.477-3.467=0.009
iters=5
new-facts=6402
prior-facts=1
mean5056.261-5056.257=0.004
σ1.085-1.093=-0.008
min5055.361-5055.170=0.191
max5058.142-5058.097=0.045
mean2766.000-2764.000=2.000
σ0.000
min2766.000-2764.000=2.000
max2766.000-2764.000=2.000
mean8.874-9.160=-0.286
σ0.673-0.514=0.159
min8.028-8.258=-0.230
max9.572-9.529=0.043
iters=5
new-facts=6402
prior-facts=6402
mean5193.754-5193.668=0.086
σ0.093-0.140=-0.047
min5193.679-5193.466=0.212
max5193.859-5193.858=0.001
mean3227.400-3287.400=-60.000
σ359.140-451.052=-91.912
min2838.000-2764.000=74.000
max3769.000-3913.000=-144.000
mean8.725-8.969=-0.244
σ0.128-0.081=0.048
min8.566-8.914=-0.347
max8.912-9.108=-0.196

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.031-1.007=0.024
σ0.141-0.140=0.000
min0.940-0.943=-0.003
max1.263-1.258=0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.481-465.486=-0.006
σ572.658-572.678=-0.019
min179.145-179.140=0.005
max1324.469-1324.503=-0.035
mean79.500
σ7.000
min76.000
max90.000
mean2766.000-2764.000=2.000
σ0.000
min2766.000-2764.000=2.000
max2766.000-2764.000=2.000
mean0.480-0.480=0.000
σ0.400-0.401=-0.001
min0.277-0.275=0.002
max1.081-1.082=-0.001
policies=20
mean1791.697-1791.667=0.030
σ0.327-0.342=-0.015
min1791.508-1791.449=0.059
max1792.185-1792.176=0.010
mean760.000
σ0.000
min760.000
max760.000
mean2766.000-2764.000=2.000
σ0.000
min2766.000-2764.000=2.000
max2766.000-2764.000=2.000
mean2.792-2.799=-0.006
σ0.027-0.016=0.011
min2.775-2.781=-0.006
max2.833-2.820=0.013
policies=200
mean17923.371-17923.466=-0.095
σ0.587-0.545=0.042
min17922.973-17923.087=-0.114
max17924.235-17924.274=-0.039
mean7600.000
σ0.000
min7600.000
max7600.000
mean2766.000-2764.000=2.000
σ0.000
min2766.000-2764.000=2.000
max2766.000-2764.000=2.000
mean28.178-28.185=-0.007
σ0.120-0.110=0.010
min28.009-28.039=-0.030
max28.294-28.289=0.005