Compare commits

Home / Compare 219e4762 .. 5d73bff6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.798=0.000
σ0.105-0.107=-0.002
min35.750-35.751=-0.001
max36.095-36.100=-0.005
mean415.800-414.000=1.800
σ0.422-0.000=0.422
min415.000-414.000=1.000
max416.000-414.000=2.000
mean0.076-0.076=-0.000
σ0.003-0.003=0.000
min0.073-0.073=-0.000
max0.082-0.082=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.065-26.065=0.000
σ0.004-0.002=0.001
min26.060-26.061=-0.002
max26.072-26.069=0.003
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.061-0.061=-0.000
σ0.003-0.003=-0.001
min0.059-0.060=-0.000
max0.068-0.070=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.924-1755.924=0.000
σ0.366-0.364=0.002
min1755.350-1755.352=-0.002
max1756.502-1756.518=-0.016
mean1663.600-1662.150=1.450
σ629.930-626.681=3.249
min674.000-668.000=6.000
max2698.000-2602.000=96.000
mean2.801-2.789=0.013
σ0.170-0.146=0.024
min2.436-2.468=-0.032
max3.197-2.949=0.248

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.198-277.197=0.001
σ0.003-0.004=-0.001
min277.192-277.191=0.002
max277.200-277.201=-0.001
mean2698.000-2602.000=96.000
σ0.000
min2698.000-2602.000=96.000
max2698.000-2602.000=96.000
mean0.403-0.404=-0.001
σ0.002-0.008=-0.006
min0.402-0.398=0.004
max0.407-0.419=-0.012
iters=5
new-facts=1
prior-facts=6402
mean2174.425-2174.428=-0.003
σ0.009-0.007=0.002
min2174.416-2174.417=-0.001
max2174.436-2174.435=0.001
mean2698.000-2602.000=96.000
σ0.000
min2698.000-2602.000=96.000
max2698.000-2602.000=96.000
mean3.017-3.030=-0.013
σ0.161-0.164=-0.003
min2.767-2.780=-0.013
max3.163-3.187=-0.024
iters=5
new-facts=6402
prior-facts=1
mean5052.479-5052.642=-0.163
σ1.068-0.980=0.088
min5051.664-5052.052=-0.388
max5054.346-5054.382=-0.036
mean2698.000-2602.000=96.000
σ0.000
min2698.000-2602.000=96.000
max2698.000-2602.000=96.000
mean8.871-8.628=0.243
σ0.552-0.621=-0.069
min8.085-8.158=-0.073
max9.464-9.610=-0.146
iters=5
new-facts=6402
prior-facts=6402
mean5188.212-5188.424=-0.212
σ0.139-0.088=0.051
min5188.017-5188.353=-0.336
max5188.358-5188.524=-0.166
mean3235.600-3222.200=13.400
σ387.207-388.531=-1.324
min2698.000-2684.000=14.000
max3725.000-3712.000=13.000
mean8.927-8.812=0.115
σ0.350-0.287=0.062
min8.655-8.509=0.147
max9.532-9.253=0.280

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.086-1.264=-0.178
σ0.147-0.266=-0.119
min0.943-0.943=0.001
max1.257-1.596=-0.339

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.853-464.855=-0.002
σ572.660-572.659=0.001
min178.521-178.521=-0.001
max1323.844-1323.843=0.000
mean79.500
σ7.000
min76.000
max90.000
mean2698.000-2602.000=96.000
σ0.000
min2698.000-2602.000=96.000
max2698.000-2602.000=96.000
mean0.534-0.569=-0.035
σ0.500-0.568=-0.069
min0.279-0.280=-0.001
max1.283-1.421=-0.138
policies=20
mean1785.484-1785.462=0.022
σ0.353-0.352=0.001
min1785.245-1785.229=0.016
max1786.008-1785.985=0.023
mean760.000
σ0.000
min760.000
max760.000
mean2698.000-2602.000=96.000
σ0.000
min2698.000-2602.000=96.000
max2698.000-2602.000=96.000
mean2.778-2.781=-0.002
σ0.015-0.020=-0.005
min2.763-2.767=-0.004
max2.795-2.811=-0.016
policies=200
mean17861.410-17861.507=-0.097
σ0.476-0.529=-0.053
min17861.046-17861.130=-0.084
max17862.100-17862.290=-0.190
mean7600.000
σ0.000
min7600.000
max7600.000
mean2698.000-2602.000=96.000
σ0.000
min2698.000-2602.000=96.000
max2698.000-2602.000=96.000
mean28.127-28.025=0.102
σ0.157-0.130=0.027
min27.986-27.899=0.087
max28.302-28.150=0.152