Compare commits

Home / Compare 1287e7e1 .. 57b9d6b3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.772-30.773=-0.001
σ0.049-0.046=0.002
min30.743-30.750=-0.007
max30.909-30.903=0.006
mean415.000-411.900=3.100
σ0.000-0.316=-0.316
min415.000-411.000=4.000
max415.000-412.000=3.000
mean0.074-0.076=-0.001
σ0.005-0.005=0.000
min0.070-0.069=0.001
max0.085-0.084=0.000
cache=y
dps=1
iters=10
policies=100
mean21.059-21.059=0.000
σ0.003-0.003=0.000
min21.055-21.054=0.001
max21.063-21.064=-0.002
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.063-0.063=0.000
σ0.004-0.002=0.002
min0.059-0.062=-0.003
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.237-1751.235=0.003
σ0.364-0.362=0.001
min1750.670-1750.668=0.002
max1751.821-1751.822=-0.001
mean1665.900-1659.300=6.600
σ636.535-638.400=-1.865
min681.000-689.000=-8.000
max2704.000-2775.000=-71.000
mean2.873-2.790=0.083
σ0.131-0.162=-0.031
min2.540-2.365=0.175
max3.032-2.994=0.038

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.564-275.570=-0.006
σ0.007-0.004=0.004
min275.557-275.566=-0.009
max275.576-275.575=0.002
mean2704.000-2775.000=-71.000
σ0.000
min2704.000-2775.000=-71.000
max2704.000-2775.000=-71.000
mean0.393-0.392=0.002
σ0.010-0.008=0.002
min0.385-0.382=0.004
max0.404-0.399=0.005
iters=5
new-facts=1
prior-facts=6402
mean2168.091-2168.089=0.002
σ0.008-0.020=-0.012
min2168.077-2168.070=0.007
max2168.098-2168.114=-0.016
mean2704.000-2775.000=-71.000
σ0.000
min2704.000-2775.000=-71.000
max2704.000-2775.000=-71.000
mean3.024-2.980=0.044
σ0.196-0.139=0.056
min2.779-2.752=0.028
max3.225-3.093=0.132
iters=5
new-facts=6402
prior-facts=1
mean5047.785-5047.892=-0.107
σ1.014-0.882=0.132
min5046.920-5047.340=-0.420
max5049.540-5049.449=0.091
mean2704.000-2775.000=-71.000
σ0.000
min2704.000-2775.000=-71.000
max2704.000-2775.000=-71.000
mean8.766-8.843=-0.077
σ0.300-0.479=-0.179
min8.351-8.083=0.268
max9.152-9.295=-0.144
iters=5
new-facts=6402
prior-facts=6402
mean5179.041-5179.055=-0.014
σ0.077-0.089=-0.012
min5178.968-5178.968=0.000
max5179.129-5179.150=-0.022
mean3220.600-3326.400=-105.800
σ379.642-393.420=-13.778
min2704.000-2775.000=-71.000
max3700.000-3684.000=16.000
mean9.884-10.120=-0.236
σ0.389-0.331=0.057
min9.433-9.665=-0.232
max10.466-10.566=-0.100

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.086-1.030=0.056
σ0.133-0.157=-0.024
min0.957-0.932=0.025
max1.265-1.295=-0.030

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.207-463.203=0.004
σ572.661-572.651=0.010
min176.873-176.876=-0.003
max1322.198-1322.179=0.019
mean77.500
σ7.000
min74.000
max88.000
mean2704.000-2775.000=-71.000
σ0.000
min2704.000-2775.000=-71.000
max2704.000-2775.000=-71.000
mean0.548-0.440=0.108
σ0.544-0.301=0.242
min0.271-0.287=-0.016
max1.364-0.892=0.472
policies=20
mean1768.971-1768.983=-0.013
σ0.338-0.348=-0.009
min1768.757-1768.767=-0.010
max1769.476-1769.501=-0.025
mean740.000
σ0.000
min740.000
max740.000
mean2704.000-2775.000=-71.000
σ0.000
min2704.000-2775.000=-71.000
max2704.000-2775.000=-71.000
mean2.755-2.790=-0.035
σ0.017-0.079=-0.062
min2.740-2.727=0.013
max2.778-2.901=-0.123
policies=200
mean17696.241-17696.243=-0.002
σ0.507-0.498=0.009
min17695.930-17695.970=-0.040
max17696.995-17696.990=0.006
mean7400.000
σ0.000
min7400.000
max7400.000
mean2704.000-2775.000=-71.000
σ0.000
min2704.000-2775.000=-71.000
max2704.000-2775.000=-71.000
mean27.688-27.590=0.098
σ0.142-0.188=-0.046
min27.501-27.402=0.098
max27.801-27.827=-0.026