Compare commits

Home / Compare 3b4bbfa4 .. 98299545

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.783-70.781=0.002
σ0.046-0.052=-0.006
min70.751-70.750=0.000
max70.908-70.926=-0.018
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.160-0.159=0.001
σ0.003-0.005=-0.002
min0.157-0.151=0.006
max0.165-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.492-21.493=-0.001
σ0.002-0.002=-0.000
min21.489-21.489=-0.000
max21.495-21.496=-0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.065-0.064=0.001
σ0.002-0.004=-0.002
min0.064-0.059=0.005
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1751.882=2.211
σ0.360-0.362=-0.002
min1753.536-1751.315=2.221
max1754.663-1752.467=2.196
mean1632.150-1632.850=-0.700
σ609.989-623.812=-13.823
min638.000-620.000=18.000
max2455.000-2764.000=-309.000
mean2.856-2.756=0.101
σ0.204-0.246=-0.042
min2.197-2.174=0.023
max3.193-3.273=-0.080

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.597-269.382=2.215
σ0.008-0.005=0.004
min271.585-269.376=2.209
max271.606-269.389=2.218
mean2455.000-2764.000=-309.000
σ0.000
min2455.000-2764.000=-309.000
max2455.000-2764.000=-309.000
mean0.384-0.373=0.011
σ0.005-0.004=0.001
min0.380-0.370=0.009
max0.391-0.381=0.010
iters=5
new-facts=1
prior-facts=6402
mean1931.999-1929.764=2.235
σ0.008-0.012=-0.003
min1931.987-1929.751=2.236
max1932.008-1929.783=2.225
mean2455.000-2764.000=-309.000
σ0.000
min2455.000-2764.000=-309.000
max2455.000-2764.000=-309.000
mean2.537-2.815=-0.278
σ0.086-0.271=-0.185
min2.470-2.467=0.002
max2.654-3.115=-0.460
iters=5
new-facts=6402
prior-facts=1
mean4752.724-4750.582=2.142
σ0.850-0.835=0.016
min4752.280-4750.122=2.158
max4754.244-4752.069=2.175
mean2455.000-2764.000=-309.000
σ0.000
min2455.000-2764.000=-309.000
max2455.000-2764.000=-309.000
mean8.561-8.040=0.520
σ0.211-0.371=-0.160
min8.373-7.683=0.690
max8.900-8.568=0.332
iters=5
new-facts=6402
prior-facts=6402
mean4943.122-4940.924=2.198
σ0.148-0.152=-0.003
min4942.859-4940.654=2.205
max4943.222-4941.010=2.213
mean3006.800-3019.600=-12.800
σ303.023-291.884=11.139
min2597.000-2764.000=-167.000
max3388.000-3437.000=-49.000
mean8.526-8.585=-0.058
σ0.075-0.302=-0.227
min8.426-8.373=0.053
max8.613-9.096=-0.483

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.806-1.028=0.777
σ0.089-0.134=-0.045
min1.709-0.939=0.770
max1.930-1.246=0.685

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.626-462.711=5.915
σ574.922-574.953=-0.031
min181.161-175.223=5.938
max1331.009-1325.140=5.869
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2455.000-2764.000=-309.000
σ0.000
min2455.000-2764.000=-309.000
max2455.000-2764.000=-309.000
mean0.556-0.536=0.020
σ0.520-0.521=-0.001
min0.291-0.275=0.016
max1.336-1.318=0.018
policies=20
mean1811.949-1752.511=59.438
σ0.408-0.343=0.065
min1811.672-1752.300=59.372
max1812.547-1753.024=59.523
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2455.000-2764.000=-309.000
σ0.000
min2455.000-2764.000=-309.000
max2455.000-2764.000=-309.000
mean2.855-2.713=0.142
σ0.011-0.022=-0.011
min2.847-2.691=0.156
max2.870-2.742=0.129
policies=200
mean18126.692-17532.266=594.426
σ0.426-0.352=0.074
min18126.413-17532.074=594.339
max18127.328-17532.794=594.534
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2455.000-2764.000=-309.000
σ0.000
min2455.000-2764.000=-309.000
max2455.000-2764.000=-309.000
mean28.761-27.503=1.258
σ0.077-0.188=-0.111
min28.649-27.341=1.308
max28.817-27.729=1.088