Compare commits

Home / Compare 4b4fe623 .. fa4f53d5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.979=0.001
σ0.048-0.047=0.001
min33.953-33.949=0.004
max34.111-34.108=0.003
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.082-0.084=-0.002
σ0.005-0.003=0.002
min0.077-0.082=-0.005
max0.091-0.090=0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.000
σ0.002-0.002=0.000
min23.313-23.312=0.001
max23.321-23.320=0.001
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.067-0.063=0.004
σ0.003-0.003=0.000
min0.064-0.059=0.005
max0.074-0.068=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1719.565-1757.494=-37.929
σ169.728-0.366=169.362
min998.471-1756.922=-758.451
max1758.078-1758.085=-0.007
mean1604.950-1644.850=-39.900
σ627.060-625.068=1.992
min654.000-634.000=20.000
max2617.000-2834.000=-217.000
mean2.357-2.368=-0.011
σ0.247-0.096=0.152
min1.441-2.262=-0.821
max2.750-2.678=0.072

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.636-326.642=-0.006
σ0.053-0.050=0.003
min326.541-326.552=-0.011
max326.667-326.672=-0.005
mean2617.000-2834.000=-217.000
σ0.000
min2617.000-2834.000=-217.000
max2617.000-2834.000=-217.000
mean0.427-0.424=0.003
σ0.004-0.001=0.003
min0.423-0.422=0.001
max0.432-0.425=0.007
iters=5
new-facts=1
prior-facts=6402
mean1988.801-1988.802=-0.001
σ0.013-0.010=0.003
min1988.784-1988.791=-0.007
max1988.814-1988.814=-0.000
mean2617.000-2834.000=-217.000
σ0.000
min2617.000-2834.000=-217.000
max2617.000-2834.000=-217.000
mean2.779-2.691=0.088
σ0.163-0.082=0.081
min2.664-2.603=0.061
max3.044-2.784=0.260
iters=5
new-facts=6402
prior-facts=1
mean4813.682-4813.521=0.161
σ7.767-7.807=-0.040
min4810.127-4809.608=0.518
max4827.575-4827.479=0.096
mean2617.000-2834.000=-217.000
σ0.000
min2617.000-2834.000=-217.000
max2617.000-2834.000=-217.000
mean8.617-8.812=-0.195
σ0.770-0.289=0.481
min7.744-8.533=-0.789
max9.637-9.176=0.460
iters=5
new-facts=6402
prior-facts=6402
mean5001.126-5001.134=-0.008
σ0.177-0.152=0.025
min5000.813-5000.864=-0.051
max5001.228-5001.225=0.002
mean2984.800-3047.400=-62.600
σ404.790-208.495=196.295
min2617.000-2834.000=-217.000
max3557.000-3311.000=246.000
mean9.729-9.824=-0.095
σ0.211-0.134=0.077
min9.411-9.628=-0.218
max9.994-9.976=0.018

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.033-0.992=0.042
σ0.189-0.069=0.120
min0.908-0.907=0.001
max1.358-1.044=0.313

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.635-464.631=0.004
σ574.786-574.777=0.009
min177.237-177.234=0.003
max1326.814-1326.796=0.017
mean88.250
σ8.500
min84.000
max101.000
mean2617.000-2834.000=-217.000
σ0.000
min2617.000-2834.000=-217.000
max2617.000-2834.000=-217.000
mean0.527-0.460=0.067
σ0.503-0.350=0.153
min0.273-0.278=-0.004
max1.282-0.985=0.297
policies=20
mean1772.690-1772.708=-0.018
σ0.355-0.364=-0.009
min1772.451-1772.457=-0.006
max1773.216-1773.246=-0.030
mean840.000
σ0.000
min840.000
max840.000
mean2617.000-2834.000=-217.000
σ0.000
min2617.000-2834.000=-217.000
max2617.000-2834.000=-217.000
mean2.744-2.797=-0.053
σ0.013-0.006=0.007
min2.732-2.790=-0.058
max2.756-2.804=-0.048
policies=200
mean17733.938-17734.000=-0.061
σ0.502-0.372=0.131
min17733.582-17733.619=-0.038
max17734.673-17734.511=0.163
mean8400.000
σ0.000
min8400.000
max8400.000
mean2617.000-2834.000=-217.000
σ0.000
min2617.000-2834.000=-217.000
max2617.000-2834.000=-217.000
mean27.512-28.001=-0.489
σ0.121-0.484=-0.363
min27.351-27.583=-0.232
max27.631-28.591=-0.960