Compare commits

Home / Compare 33a14ad8 .. 02c50a44

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.959-30.958=0.000
σ0.051-0.050=0.001
min30.921-30.923=-0.002
max31.101-31.097=0.003
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.079-0.078=0.001
σ0.003-0.003=0.001
min0.076-0.076=0.000
max0.084-0.085=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.061-21.060=0.001
σ0.003-0.002=0.001
min21.057-21.056=0.001
max21.066-21.063=0.003
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.061-0.059=0.002
σ0.003-0.003=0.000
min0.058-0.057=0.001
max0.066-0.065=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.410-1751.409=0.002
σ0.361-0.365=-0.004
min1750.839-1750.851=-0.011
max1751.976-1751.982=-0.007
mean1641.350-1655.800=-14.450
σ617.141-646.746=-29.604
min655.000-641.000=14.000
max2477.000-2851.000=-374.000
mean2.839-2.821=0.018
σ0.124-0.127=-0.004
min2.605-2.526=0.079
max3.216-3.037=0.179

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.072-279.055=0.017
σ0.008-0.017=-0.008
min279.062-279.038=0.024
max279.084-279.074=0.010
mean2477.000-2851.000=-374.000
σ0.000
min2477.000-2851.000=-374.000
max2477.000-2851.000=-374.000
mean0.390-0.389=0.001
σ0.007-0.005=0.001
min0.382-0.385=-0.002
max0.397-0.398=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1939.517-1939.511=0.006
σ0.016-0.006=0.010
min1939.503-1939.501=0.002
max1939.544-1939.517=0.027
mean2477.000-2851.000=-374.000
σ0.000
min2477.000-2851.000=-374.000
max2477.000-2851.000=-374.000
mean2.952-3.071=-0.120
σ0.271-0.078=0.193
min2.506-3.002=-0.497
max3.204-3.195=0.009
iters=5
new-facts=6402
prior-facts=1
mean4760.073-4759.954=0.119
σ0.794-0.984=-0.190
min4759.663-4759.043=0.620
max4761.487-4761.629=-0.142
mean2477.000-2851.000=-374.000
σ0.000
min2477.000-2851.000=-374.000
max2477.000-2851.000=-374.000
mean8.112-8.240=-0.128
σ0.284-0.629=-0.345
min7.809-7.827=-0.018
max8.576-9.327=-0.751
iters=5
new-facts=6402
prior-facts=6402
mean4950.466-4950.391=0.075
σ0.088-0.125=-0.036
min4950.389-4950.207=0.181
max4950.570-4950.559=0.011
mean2943.200-3047.600=-104.400
σ390.611-268.336=122.275
min2477.000-2851.000=-374.000
max3461.000-3456.000=5.000
mean8.511-8.429=0.082
σ0.199-0.045=0.154
min8.396-8.359=0.037
max8.860-8.473=0.386

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.812-1.052=0.760
σ0.143-0.117=0.026
min1.598-0.940=0.658
max1.979-1.225=0.753

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.333-463.342=-0.010
σ572.193-572.195=-0.002
min177.234-177.238=-0.003
max1321.622-1321.634=-0.013
mean79.750
σ7.500
min76.000
max91.000
mean2477.000-2851.000=-374.000
σ0.000
min2477.000-2851.000=-374.000
max2477.000-2851.000=-374.000
mean0.555-0.435=0.120
σ0.554-0.304=0.250
min0.273-0.280=-0.007
max1.385-0.891=0.494
policies=20
mean1772.585-1772.629=-0.044
σ0.329-0.330=-0.001
min1772.355-1772.395=-0.041
max1773.071-1773.114=-0.043
mean760.000
σ0.000
min760.000
max760.000
mean2477.000-2851.000=-374.000
σ0.000
min2477.000-2851.000=-374.000
max2477.000-2851.000=-374.000
mean2.728-2.840=-0.112
σ0.019-0.013=0.006
min2.709-2.828=-0.119
max2.747-2.854=-0.107
policies=200
mean17732.532-17732.547=-0.015
σ0.485-0.420=0.065
min17732.267-17732.225=0.042
max17733.259-17733.164=0.094
mean7600.000
σ0.000
min7600.000
max7600.000
mean2477.000-2851.000=-374.000
σ0.000
min2477.000-2851.000=-374.000
max2477.000-2851.000=-374.000
mean27.781-28.110=-0.328
σ0.188-0.579=-0.392
min27.614-27.551=0.063
max28.002-28.731=-0.728