Compare commits

Home / Compare 27dd937c .. 8dfc0283

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.782=-0.000
σ0.046-0.045=0.000
min70.754-70.753=0.001
max70.909-70.908=0.001
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.159-0.159=-0.000
σ0.005-0.005=-0.000
min0.152-0.150=0.002
max0.167-0.166=0.001
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=-0.000
σ0.002-0.003=-0.001
min21.488-21.487=0.001
max21.495-21.496=-0.001
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.065-0.063=0.002
σ0.003-0.003=-0.000
min0.063-0.059=0.004
max0.072-0.068=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.092-1754.093=-0.002
σ0.360-0.360=-0.000
min1753.529-1753.531=-0.002
max1754.673-1754.676=-0.003
mean1660.100-1642.800=17.300
σ625.754-603.571=22.183
min669.000-643.000=26.000
max2671.000-2454.000=217.000
mean2.812-2.807=0.005
σ0.084-0.208=-0.123
min2.668-2.257=0.411
max2.950-3.154=-0.204

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.955-271.955=-0.000
σ0.008-0.006=0.002
min271.948-271.949=-0.001
max271.968-271.961=0.007
mean2671.000-2454.000=217.000
σ0.000
min2671.000-2454.000=217.000
max2671.000-2454.000=217.000
mean0.382-0.381=0.000
σ0.009-0.001=0.008
min0.377-0.380=-0.003
max0.397-0.382=0.015
iters=5
new-facts=1
prior-facts=6402
mean1932.316-1932.322=-0.006
σ0.007-0.008=-0.001
min1932.306-1932.313=-0.007
max1932.325-1932.334=-0.009
mean2671.000-2454.000=217.000
σ0.000
min2671.000-2454.000=217.000
max2671.000-2454.000=217.000
mean3.027-3.008=0.019
σ0.071-0.090=-0.019
min2.937-2.856=0.081
max3.099-3.080=0.019
iters=5
new-facts=6402
prior-facts=1
mean4752.969-4753.100=-0.131
σ0.957-0.876=0.081
min4752.116-4752.628=-0.512
max4754.617-4754.658=-0.041
mean2671.000-2454.000=217.000
σ0.000
min2671.000-2454.000=217.000
max2671.000-2454.000=217.000
mean8.682-8.643=0.040
σ0.226-0.377=-0.151
min8.386-8.034=0.352
max8.912-8.977=-0.065
iters=5
new-facts=6402
prior-facts=6402
mean4943.557-4943.487=0.070
σ0.016-0.148=-0.132
min4943.539-4943.224=0.314
max4943.571-4943.568=0.003
mean2961.800-3004.200=-42.400
σ247.323-279.022=-31.699
min2671.000-2615.000=56.000
max3317.000-3313.000=4.000
mean8.442-8.565=-0.123
σ0.093-0.118=-0.026
min8.337-8.403=-0.067
max8.566-8.709=-0.143

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.191-1.734=-0.543
σ0.333-0.085=0.247
min0.927-1.673=-0.746
max1.738-1.874=-0.136

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.641-468.635=0.006
σ574.901-574.881=0.020
min181.184-181.190=-0.006
max1330.992-1330.957=0.036
mean88.250
σ8.500
min84.000
max101.000
mean2671.000-2454.000=217.000
σ0.000
min2671.000-2454.000=217.000
max2671.000-2454.000=217.000
mean0.563-0.559=0.004
σ0.546-0.537=0.009
min0.284-0.288=-0.005
max1.382-1.365=0.017
policies=20
mean1812.172-1812.198=-0.026
σ0.381-0.388=-0.007
min1811.918-1811.943=-0.025
max1812.736-1812.772=-0.036
mean840.000
σ0.000
min840.000
max840.000
mean2671.000-2454.000=217.000
σ0.000
min2671.000-2454.000=217.000
max2671.000-2454.000=217.000
mean2.837-2.829=0.007
σ0.018-0.013=0.006
min2.813-2.817=-0.004
max2.857-2.841=0.016
policies=200
mean18129.080-18129.209=-0.129
σ0.406-0.498=-0.093
min18128.795-18128.919=-0.124
max18129.673-18129.955=-0.282
mean8400.000
σ0.000
min8400.000
max8400.000
mean2671.000-2454.000=217.000
σ0.000
min2671.000-2454.000=217.000
max2671.000-2454.000=217.000
mean28.592-28.487=0.104
σ0.095-0.076=0.019
min28.488-28.400=0.088
max28.697-28.563=0.134