Compare commits

Home / Compare 422c5df6 .. 8685a814

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.975=0.004
σ0.049-0.051=-0.002
min33.951-33.946=0.005
max34.116-34.118=-0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.083-0.070=0.013
σ0.004-0.008=-0.004
min0.075-0.059=0.016
max0.090-0.085=0.005
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=-0.000
σ0.004-0.003=0.001
min23.313-23.313=0.000
max23.324-23.322=0.003
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.065-0.061=0.004
σ0.002-0.007=-0.005
min0.063-0.051=0.013
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.429-1757.303=0.126
σ0.365-0.365=0.000
min1756.857-1756.729=0.128
max1758.026-1757.889=0.137
mean1647.950-1663.550=-15.600
σ624.114-627.323=-3.210
min638.000-668.000=-30.000
max2831.000-2612.000=219.000
mean2.342-2.368=-0.026
σ0.097-0.104=-0.007
min2.223-2.267=-0.044
max2.649-2.655=-0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.574-326.419=0.155
σ0.050-0.050=0.000
min326.486-326.331=0.155
max326.612-326.450=0.161
mean2831.000-2612.000=219.000
σ0.000
min2831.000-2612.000=219.000
max2831.000-2612.000=219.000
mean0.425-0.423=0.002
σ0.005-0.001=0.003
min0.422-0.421=0.000
max0.431-0.425=0.006
iters=5
new-facts=1
prior-facts=6402
mean1988.735-1988.610=0.125
σ0.021-0.006=0.015
min1988.701-1988.605=0.096
max1988.755-1988.620=0.135
mean2831.000-2612.000=219.000
σ0.000
min2831.000-2612.000=219.000
max2831.000-2612.000=219.000
mean2.645-2.759=-0.114
σ0.100-0.145=-0.045
min2.518-2.620=-0.102
max2.748-2.973=-0.225
iters=5
new-facts=6402
prior-facts=1
mean4813.480-4813.271=0.209
σ7.497-7.841=-0.344
min4810.074-4809.443=0.631
max4826.891-4827.290=-0.399
mean2831.000-2612.000=219.000
σ0.000
min2831.000-2612.000=219.000
max2831.000-2612.000=219.000
mean8.722-8.337=0.385
σ0.384-0.626=-0.241
min8.320-7.875=0.445
max9.244-9.296=-0.052
iters=5
new-facts=6402
prior-facts=6402
mean5001.152-5000.862=0.290
σ0.021-0.183=-0.162
min5001.122-5000.657=0.466
max5001.179-5001.026=0.153
mean3030.200-2987.600=42.600
σ203.727-399.314=-195.587
min2831.000-2612.000=219.000
max3313.000-3552.000=-239.000
mean10.001-9.197=0.804
σ0.302-0.615=-0.313
min9.769-8.573=1.196
max10.362-9.851=0.511

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.947-1.323=-0.376
σ0.062-0.351=-0.289
min0.893-1.038=-0.145
max1.052-1.869=-0.817

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.564-464.430=0.133
σ574.767-574.779=-0.012
min177.174-177.039=0.135
max1326.714-1326.599=0.115
mean88.250
σ8.500
min84.000
max101.000
mean2831.000-2612.000=219.000
σ0.000
min2831.000-2612.000=219.000
max2831.000-2612.000=219.000
mean0.432-0.553=-0.121
σ0.307-0.558=-0.251
min0.270-0.267=0.003
max0.892-1.389=-0.497
policies=20
mean1772.072-1770.753=1.319
σ0.355-0.350=0.005
min1771.841-1770.521=1.321
max1772.600-1771.273=1.327
mean840.000
σ0.000
min840.000
max840.000
mean2831.000-2612.000=219.000
σ0.000
min2831.000-2612.000=219.000
max2831.000-2612.000=219.000
mean2.779-2.728=0.051
σ0.004-0.010=-0.006
min2.776-2.714=0.062
max2.784-2.738=0.046
policies=200
mean17727.544-17714.929=12.615
σ0.415-0.539=-0.124
min17727.143-17714.648=12.495
max17728.116-17715.737=12.379
mean8400.000
σ0.000
min8400.000
max8400.000
mean2831.000-2612.000=219.000
σ0.000
min2831.000-2612.000=219.000
max2831.000-2612.000=219.000
mean27.893-27.406=0.487
σ0.297-0.121=0.176
min27.605-27.292=0.313
max28.262-27.544=0.718