Compare commits

Home / Compare 037238d7 .. b1c0a4ab

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.990=-0.018
σ0.104-0.103=0.001
min35.926-35.949=-0.022
max36.269-36.282=-0.014
mean415.000-4180.000=-3765.000
σ0.000
min415.000-4180.000=-3765.000
max415.000-4180.000=-3765.000
mean0.075-0.076=-0.000
σ0.005-0.001=0.004
min0.070-0.075=-0.005
max0.085-0.077=0.008
cache=y
dps=1
iters=10
policies=100
mean26.208-26.215=-0.007
σ0.004-0.003=0.001
min26.201-26.210=-0.009
max26.213-26.220=-0.007
mean415.000-4180.000=-3765.000
σ0.000
min415.000-4180.000=-3765.000
max415.000-4180.000=-3765.000
mean0.061-0.060=0.001
σ0.003-0.000=0.003
min0.059-0.060=-0.000
max0.070-0.061=0.009

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.365-1756.370=1.995
σ0.370-0.374=-0.004
min1757.787-1755.791=1.996
max1758.963-1756.967=1.997
mean1660.250-1660.200=0.050
σ624.261-637.117=-12.856
min688.000-619.000=69.000
max2768.000-2693.000=75.000
mean2.390-2.301=0.089
σ0.109-0.181=-0.072
min2.276-2.121=0.155
max2.608-2.772=-0.164

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.511-278.698=0.813
σ0.009-0.013=-0.004
min279.499-278.689=0.810
max279.519-278.720=0.799
mean2768.000-2693.000=75.000
σ0.000
min2768.000-2693.000=75.000
max2768.000-2693.000=75.000
mean0.411-0.419=-0.008
σ0.007-0.001=0.006
min0.405-0.418=-0.012
max0.421-0.420=0.000
iters=5
new-facts=1
prior-facts=6402
mean2178.425-2268.871=-90.446
σ0.037-0.006=0.032
min2178.359-2268.865=-90.506
max2178.449-2268.878=-90.429
mean2768.000-2693.000=75.000
σ0.000
min2768.000-2693.000=75.000
max2768.000-2693.000=75.000
mean3.389-3.093=0.296
σ0.117-0.219=-0.102
min3.268-2.883=0.384
max3.530-3.411=0.120
iters=5
new-facts=6402
prior-facts=1
mean5056.357-4952.078=104.280
σ0.973-0.909=0.064
min5055.766-4951.145=104.621
max5058.083-4953.599=104.484
mean2768.000-2693.000=75.000
σ0.000
min2768.000-2693.000=75.000
max2768.000-2693.000=75.000
mean9.034-8.077=0.957
σ0.490-0.237=0.254
min8.168-7.858=0.309
max9.359-8.346=1.013
iters=5
new-facts=6402
prior-facts=6402
mean5193.674-5166.848=26.826
σ0.125-0.162=-0.037
min5193.505-5166.560=26.945
max5193.857-5166.939=26.918
mean3276.200-3467.000=-190.800
σ460.996-509.392=-48.396
min2768.000-2834.000=-66.000
max3914.000-4180.000=-266.000
mean8.976-9.280=-0.305
σ0.099-0.511=-0.413
min8.861-8.481=0.380
max9.094-9.727=-0.633

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.956-1.061=-0.105
σ0.014-0.126=-0.112
min0.947-0.946=0.000
max0.979-1.252=-0.273

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.474-460.262=5.212
σ572.659-572.607=0.051
min179.143-173.957=5.187
max1324.461-1319.173=5.289
mean79.500
σ7.000
min76.000
max90.000
mean2768.000-436.000=2332.000
σ0.000
min2768.000-436.000=2332.000
max2768.000-436.000=2332.000
mean0.484-0.554=-0.070
σ0.403-0.553=-0.150
min0.280-0.275=0.005
max1.089-1.383=-0.294
policies=20
mean1791.705-1740.078=51.627
σ0.330-0.333=-0.002
min1791.511-1739.839=51.672
max1792.197-1740.567=51.630
mean760.000
σ0.000
min760.000
max760.000
mean2768.000-447.000=2321.000
σ0.000-10.520=-10.520
min2768.000-436.000=2332.000
max2768.000-456.000=2312.000
mean2.804-2.673=0.131
σ0.008-0.016=-0.007
min2.797-2.652=0.145
max2.814-2.687=0.127
policies=200
mean17923.387-17410.021=513.366
σ0.564-0.063=0.501
min17923.065-17409.970=513.095
max17924.230-17410.112=514.118
mean7600.000
σ0.000
min7600.000
max7600.000
mean2768.000-491.250=2276.750
σ0.000-2.500=-2.500
min2768.000-488.000=2280.000
max2768.000-494.000=2274.000
mean28.250-26.856=1.394
σ0.112-0.156=-0.044
min28.141-26.709=1.431
max28.367-27.067=1.300