Compare commits

Home / Compare 4425a89e .. 5559cafb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.706-53.704=0.002
σ0.364-0.365=-0.001
min53.571-53.566=0.005
max54.741-54.742=-0.002
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.139-0.136=0.003
σ0.004-0.005=-0.001
min0.136-0.127=0.009
max0.149-0.142=0.007
cache=y
dps=1
iters=10
policies=100
mean42.978-42.977=0.000
σ0.004-0.005=-0.001
min42.968-42.971=-0.003
max42.983-42.988=-0.005
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.117-0.118=-0.000
σ0.005-0.004=0.000
min0.113-0.113=-0.000
max0.126-0.126=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean994.892-994.902=-0.010
σ1.208-1.202=0.007
min994.347-994.363=-0.016
max999.955-999.946=0.010
mean1059.500-1061.350=-1.850
σ320.121-323.131=-3.011
min596.000-561.000=35.000
max1630.000-1625.000=5.000
mean1.447-1.454=-0.007
σ0.073-0.078=-0.006
min1.381-1.390=-0.008
max1.712-1.651=0.061

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.313-297.314=-0.001
σ0.006-0.008=-0.002
min297.304-297.307=-0.003
max297.320-297.328=-0.008
mean1630.000-1625.000=5.000
σ0.000
min1630.000-1625.000=5.000
max1630.000-1625.000=5.000
mean0.391-0.394=-0.003
σ0.006-0.007=-0.000
min0.385-0.387=-0.002
max0.398-0.402=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1298.661-1298.661=0.001
σ0.088-0.025=0.063
min1298.506-1298.625=-0.120
max1298.714-1298.690=0.025
mean1630.000-1625.000=5.000
σ0.000
min1630.000-1625.000=5.000
max1630.000-1625.000=5.000
mean1.955-1.883=0.072
σ0.067-0.050=0.017
min1.846-1.833=0.013
max2.018-1.964=0.053
iters=5
new-facts=6402
prior-facts=1
mean1718.881-1718.875=0.005
σ6.874-6.934=-0.060
min1715.682-1715.648=0.034
max1731.174-1731.275=-0.101
mean1630.000-1625.000=5.000
σ0.000
min1630.000-1625.000=5.000
max1630.000-1625.000=5.000
mean2.870-2.959=-0.089
σ0.231-0.443=-0.212
min2.602-2.533=0.069
max3.216-3.687=-0.471
iters=5
new-facts=6402
prior-facts=6402
mean1981.589-1981.621=-0.032
σ0.031-0.016=0.014
min1981.538-1981.602=-0.064
max1981.612-1981.640=-0.027
mean1826.200-1880.600=-54.400
σ150.384-194.444=-44.060
min1630.000-1625.000=5.000
max1960.000-2087.000=-127.000
mean3.161-3.258=-0.097
σ0.063-0.093=-0.030
min3.089-3.143=-0.054
max3.237-3.345=-0.108

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.278-1.198=0.080
σ0.388-0.277=0.111
min0.914-0.916=-0.003
max1.847-1.648=0.198

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.373-440.371=0.002
σ572.880-572.883=-0.003
min153.922-153.927=-0.004
max1299.693-1299.696=-0.003
mean94.250
σ8.500
min90.000
max107.000
mean1630.000-1625.000=5.000
σ0.000
min1630.000-1625.000=5.000
max1630.000-1625.000=5.000
mean0.555-0.542=0.013
σ0.577-0.573=0.004
min0.259-0.254=0.004
max1.420-1.401=0.019
policies=20
mean1539.510-1539.512=-0.002
σ0.290-0.298=-0.008
min1539.322-1539.325=-0.003
max1539.942-1539.956=-0.015
mean900.000
σ0.000
min900.000
max900.000
mean1630.000-1625.000=5.000
σ0.000
min1630.000-1625.000=5.000
max1630.000-1625.000=5.000
mean2.550-2.558=-0.008
σ0.013-0.010=0.003
min2.535-2.548=-0.013
max2.566-2.569=-0.003
policies=200
mean15403.198-15403.078=0.120
σ0.064-0.057=0.007
min15403.103-15403.026=0.077
max15403.235-15403.159=0.077
mean9000.000
σ0.000
min9000.000
max9000.000
mean1630.000-1625.000=5.000
σ0.000
min1630.000-1625.000=5.000
max1630.000-1625.000=5.000
mean26.005-25.983=0.022
σ0.182-0.211=-0.029
min25.849-25.817=0.031
max26.237-26.259=-0.022