Compare commits

Home / Compare 04fd69b6 .. 3d7ace94

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.702-36.708=-0.005
σ0.620-0.614=0.005
min35.907-35.904=0.003
max37.399-37.185=0.214
mean425.100-423.800=1.300
σ0.316-0.422=-0.105
min425.000-423.000=2.000
max426.000-424.000=2.000
mean0.076-0.074=0.002
σ0.004-0.005=-0.002
min0.074-0.070=0.003
max0.083-0.085=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.699-26.699=0.001
σ0.647-0.647=-0.001
min26.195-26.192=0.002
max27.454-27.455=-0.001
mean426.000-424.000=2.000
σ0.000
min426.000-424.000=2.000
max426.000-424.000=2.000
mean0.061-0.061=0.000
σ0.002-0.002=-0.000
min0.059-0.059=-0.000
max0.066-0.067=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.288-1756.286=0.002
σ0.368-0.369=-0.001
min1755.715-1755.712=0.003
max1756.882-1756.879=0.003
mean1667.150-1688.450=-21.300
σ629.783-638.325=-8.542
min621.000-689.000=-68.000
max2732.000-2705.000=27.000
mean2.353-2.337=0.017
σ0.118-0.056=0.061
min2.254-2.263=-0.009
max2.793-2.437=0.356

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.792-278.791=0.001
σ0.007-0.005=0.002
min278.785-278.787=-0.001
max278.802-278.799=0.003
mean2732.000-2705.000=27.000
σ0.000
min2732.000-2705.000=27.000
max2732.000-2705.000=27.000
mean0.411-0.408=0.003
σ0.006-0.005=0.001
min0.406-0.404=0.002
max0.419-0.417=0.003
iters=5
new-facts=1
prior-facts=6402
mean2268.856-2268.857=-0.001
σ0.009-0.008=0.001
min2268.849-2268.848=0.001
max2268.871-2268.867=0.004
mean2732.000-2705.000=27.000
σ0.000
min2732.000-2705.000=27.000
max2732.000-2705.000=27.000
mean3.061-3.053=0.008
σ0.216-0.154=0.061
min2.853-2.901=-0.048
max3.339-3.234=0.105
iters=5
new-facts=6402
prior-facts=1
mean4954.015-4954.248=-0.233
σ1.125-0.915=0.210
min4952.796-4953.632=-0.836
max4955.859-4955.864=-0.005
mean2732.000-2705.000=27.000
σ0.000
min2732.000-2705.000=27.000
max2732.000-2705.000=27.000
mean8.009-8.013=-0.004
σ0.383-0.411=-0.027
min7.678-7.730=-0.052
max8.666-8.728=-0.062
iters=5
new-facts=6402
prior-facts=6402
mean5168.801-5168.795=0.006
σ0.095-0.096=-0.001
min5168.697-5168.689=0.008
max5168.913-5168.894=0.019
mean3480.200-3324.800=155.400
σ507.847-400.169=107.678
min2851.000-2930.000=-79.000
max4181.000-3730.000=451.000
mean9.521-9.168=0.354
σ0.578-0.611=-0.033
min9.112-8.584=0.528
max10.540-10.039=0.501

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.054-1.116=-0.061
σ0.125-0.192=-0.067
min0.941-0.928=0.013
max1.251-1.349=-0.098

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.803-459.801=0.003
σ571.585-571.587=-0.002
min174.000-173.995=0.005
max1317.181-1317.182=-0.001
mean79.500
σ7.000
min76.000
max90.000
mean2732.000-2705.000=27.000
σ0.000
min2732.000-2705.000=27.000
max2732.000-2705.000=27.000
mean0.538-0.548=-0.011
σ0.542-0.558=-0.015
min0.263-0.268=-0.005
max1.351-1.385=-0.034
policies=20
mean1740.302-1740.268=0.034
σ0.309-0.311=-0.002
min1740.091-1740.049=0.042
max1740.761-1740.729=0.032
mean760.000
σ0.000
min760.000
max760.000
mean2732.000-2705.000=27.000
σ0.000
min2732.000-2705.000=27.000
max2732.000-2705.000=27.000
mean2.695-2.682=0.013
σ0.010-0.011=-0.001
min2.680-2.667=0.013
max2.705-2.695=0.009
policies=200
mean17409.674-17409.503=0.171
σ0.558-0.454=0.104
min17409.335-17409.121=0.214
max17410.509-17410.162=0.347
mean7600.000
σ0.000
min7600.000
max7600.000
mean2732.000-2705.000=27.000
σ0.000
min2732.000-2705.000=27.000
max2732.000-2705.000=27.000
mean26.901-26.944=-0.043
σ0.062-0.161=-0.099
min26.826-26.726=0.100
max26.971-27.111=-0.140