Compare commits

Home / Compare dc9be6ba .. f3ec967c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-30.959=0.081
σ0.050-0.049=0.001
min31.003-30.918=0.085
max31.181-31.094=0.086
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.077-0.079=-0.002
σ0.005-0.003=0.001
min0.071-0.076=-0.005
max0.086-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean21.143-21.062=0.081
σ0.003-0.002=0.001
min21.139-21.058=0.081
max21.148-21.065=0.083
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.065-0.063=0.001
σ0.002-0.002=-0.000
min0.063-0.062=0.002
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.410=0.001
σ0.362-0.362=-0.001
min1750.839-1750.841=-0.003
max1751.992-1751.993=-0.001
mean1652.950-1638.950=14.000
σ646.928-618.851=28.077
min649.000-650.000=-1.000
max2853.000-2475.000=378.000
mean2.835-2.765=0.070
σ0.173-0.192=-0.019
min2.284-2.321=-0.037
max3.228-3.204=0.023

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.405-273.402=0.003
σ0.008-0.014=-0.005
min273.392-273.387=0.005
max273.413-273.416=-0.003
mean2853.000-2475.000=378.000
σ0.000
min2853.000-2475.000=378.000
max2853.000-2475.000=378.000
mean0.400-0.384=0.016
σ0.013-0.008=0.005
min0.383-0.376=0.007
max0.416-0.395=0.020
iters=5
new-facts=1
prior-facts=6402
mean1933.839-1933.844=-0.005
σ0.013-0.007=0.005
min1933.825-1933.835=-0.009
max1933.852-1933.854=-0.001
mean2853.000-2475.000=378.000
σ0.000
min2853.000-2475.000=378.000
max2853.000-2475.000=378.000
mean2.871-3.109=-0.239
σ0.213-0.133=0.079
min2.620-2.976=-0.356
max3.092-3.285=-0.194
iters=5
new-facts=6402
prior-facts=1
mean4754.168-4754.366=-0.199
σ1.009-0.844=0.165
min4753.378-4753.769=-0.391
max4755.914-4755.846=0.069
mean2853.000-2475.000=378.000
σ0.000
min2853.000-2475.000=378.000
max2853.000-2475.000=378.000
mean8.142-8.812=-0.670
σ0.560-0.889=-0.329
min7.704-7.769=-0.065
max9.009-10.152=-1.143
iters=5
new-facts=6402
prior-facts=6402
mean4944.791-4944.730=0.061
σ0.079-0.206=-0.127
min4944.711-4944.388=0.323
max4944.882-4944.900=-0.018
mean3067.000-2988.200=78.800
σ289.804-357.623=-67.819
min2853.000-2530.000=323.000
max3519.000-3332.000=187.000
mean8.436-8.627=-0.191
σ0.124-0.161=-0.037
min8.297-8.401=-0.104
max8.618-8.835=-0.217

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.059-1.801=-0.742
σ0.129-0.081=0.048
min0.941-1.697=-0.757
max1.260-1.904=-0.644

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.339-463.330=0.009
σ572.194-572.194=0.000
min177.241-177.231=0.010
max1321.630-1321.620=0.010
mean79.750
σ7.500
min76.000
max91.000
mean2853.000-2475.000=378.000
σ0.000
min2853.000-2475.000=378.000
max2853.000-2475.000=378.000
mean0.439-0.541=-0.103
σ0.307-0.532=-0.225
min0.283-0.271=0.012
max0.899-1.339=-0.440
policies=20
mean1772.629-1772.574=0.055
σ0.335-0.332=0.003
min1772.382-1772.351=0.031
max1773.118-1773.066=0.052
mean760.000
σ0.000
min760.000
max760.000
mean2853.000-2475.000=378.000
σ0.000
min2853.000-2475.000=378.000
max2853.000-2475.000=378.000
mean2.853-2.739=0.114
σ0.007-0.014=-0.007
min2.848-2.722=0.125
max2.863-2.753=0.110
policies=200
mean17732.536-17732.234=0.302
σ0.389-0.488=-0.099
min17732.316-17731.857=0.459
max17733.119-17732.936=0.184
mean7600.000
σ0.000
min7600.000
max7600.000
mean2853.000-2475.000=378.000
σ0.000
min2853.000-2475.000=378.000
max2853.000-2475.000=378.000
mean28.363-27.641=0.722
σ0.463-0.107=0.356
min27.832-27.507=0.325
max28.803-27.766=1.037