Compare commits

Home / Compare 2e51daf7 .. 3998a5b4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.770-30.769=0.002
σ0.046-0.046=0.000
min30.734-30.733=0.001
max30.896-30.896=0.000
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.079-0.076=0.002
σ0.003-0.004=-0.001
min0.076-0.070=0.006
max0.085-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean21.060-21.061=-0.000
σ0.003-0.002=0.000
min21.056-21.058=-0.001
max21.064-21.064=0.000
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.062-0.064=-0.002
σ0.004-0.002=0.001
min0.058-0.062=-0.005
max0.069-0.071=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.418-1751.421=-0.002
σ0.361-0.363=-0.002
min1750.848-1750.848=0.000
max1752.006-1752.000=0.006
mean1659.950-1660.550=-0.600
σ620.430-631.808=-11.378
min661.000-681.000=-20.000
max2497.000-2689.000=-192.000
mean2.800-2.860=-0.060
σ0.211-0.109=0.102
min2.189-2.646=-0.458
max3.085-3.022=0.063

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.757-275.755=0.002
σ0.008-0.011=-0.003
min275.748-275.741=0.008
max275.766-275.767=-0.001
mean2497.000-2689.000=-192.000
σ0.000
min2497.000-2689.000=-192.000
max2497.000-2689.000=-192.000
mean0.403-0.405=-0.002
σ0.009-0.009=-0.000
min0.398-0.398=-0.001
max0.418-0.418=0.000
iters=5
new-facts=1
prior-facts=6402
mean2168.274-2168.286=-0.012
σ0.017-0.006=0.011
min2168.251-2168.277=-0.026
max2168.290-2168.291=-0.002
mean2497.000-2689.000=-192.000
σ0.000
min2497.000-2689.000=-192.000
max2497.000-2689.000=-192.000
mean2.977-2.975=0.002
σ0.123-0.217=-0.094
min2.810-2.682=0.128
max3.117-3.258=-0.141
iters=5
new-facts=6402
prior-facts=1
mean5047.866-5048.149=-0.283
σ1.184-0.916=0.268
min5046.413-5047.544=-1.131
max5049.709-5049.774=-0.065
mean2497.000-2689.000=-192.000
σ0.000
min2497.000-2689.000=-192.000
max2497.000-2689.000=-192.000
mean8.901-8.761=0.140
σ0.480-0.539=-0.059
min8.139-8.061=0.078
max9.456-9.301=0.155
iters=5
new-facts=6402
prior-facts=6402
mean5179.246-5179.229=0.016
σ0.083-0.076=0.007
min5179.176-5179.143=0.033
max5179.360-5179.310=0.050
mean3271.400-3227.400=44.000
σ379.796-389.684=-9.888
min2734.000-2702.000=32.000
max3728.000-3736.000=-8.000
mean10.129-9.771=0.358
σ0.453-0.657=-0.204
min9.579-8.728=0.850
max10.837-10.438=0.399

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.756-1.126=0.630
σ0.135-0.196=-0.060
min1.517-0.948=0.569
max1.843-1.398=0.446

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.563-463.578=-0.015
σ572.650-572.675=-0.026
min177.238-177.237=0.001
max1322.538-1322.591=-0.053
mean79.750
σ7.500
min76.000
max91.000
mean2497.000-2689.000=-192.000
σ0.000
min2497.000-2689.000=-192.000
max2497.000-2689.000=-192.000
mean0.541-0.546=-0.005
σ0.533-0.540=-0.007
min0.273-0.274=-0.001
max1.341-1.357=-0.016
policies=20
mean1772.610-1772.631=-0.022
σ0.329-0.341=-0.012
min1772.400-1772.389=0.011
max1773.099-1773.136=-0.037
mean760.000
σ0.000
min760.000
max760.000
mean2497.000-2689.000=-192.000
σ0.000
min2497.000-2689.000=-192.000
max2497.000-2689.000=-192.000
mean2.741-2.747=-0.006
σ0.015-0.012=0.003
min2.721-2.736=-0.015
max2.755-2.763=-0.008
policies=200
mean17733.022-17733.064=-0.042
σ0.498-0.458=0.040
min17732.626-17732.751=-0.125
max17733.750-17733.742=0.008
mean7600.000
σ0.000
min7600.000
max7600.000
mean2497.000-2689.000=-192.000
σ0.000
min2497.000-2689.000=-192.000
max2497.000-2689.000=-192.000
mean27.726-27.774=-0.048
σ0.135-0.186=-0.051
min27.583-27.603=-0.020
max27.855-28.038=-0.183