Compare commits

Home / Compare 641dab75 .. ff62cbbd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.772-30.773=-0.001
σ0.049-0.046=0.002
min30.743-30.754=-0.011
max30.909-30.905=0.004
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.074-0.077=-0.003
σ0.005-0.003=0.002
min0.070-0.071=-0.001
max0.085-0.085=0.000
cache=y
dps=1
iters=10
policies=100
mean21.059-21.059=0.000
σ0.003-0.003=0.000
min21.055-21.054=0.000
max21.063-21.063=-0.000
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.063-0.064=-0.000
σ0.004-0.002=0.002
min0.059-0.062=-0.003
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.237-1751.236=0.002
σ0.364-0.363=0.001
min1750.670-1750.671=-0.001
max1751.821-1751.815=0.006
mean1665.900-1651.650=14.250
σ636.535-645.486=-8.951
min681.000-648.000=33.000
max2704.000-2843.000=-139.000
mean2.873-2.805=0.068
σ0.131-0.204=-0.073
min2.540-2.361=0.179
max3.032-3.233=-0.201

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.564-275.565=-0.001
σ0.007-0.006=0.002
min275.557-275.559=-0.001
max275.576-275.573=0.004
mean2704.000-2843.000=-139.000
σ0.000
min2704.000-2843.000=-139.000
max2704.000-2843.000=-139.000
mean0.393-0.387=0.007
σ0.010-0.002=0.008
min0.385-0.384=0.001
max0.404-0.389=0.015
iters=5
new-facts=1
prior-facts=6402
mean2168.091-2168.090=0.000
σ0.008-0.022=-0.014
min2168.077-2168.059=0.018
max2168.098-2168.117=-0.019
mean2704.000-2843.000=-139.000
σ0.000
min2704.000-2843.000=-139.000
max2704.000-2843.000=-139.000
mean3.024-2.844=0.180
σ0.196-0.129=0.066
min2.779-2.673=0.107
max3.225-2.995=0.230
iters=5
new-facts=6402
prior-facts=1
mean5047.785-5047.949=-0.164
σ1.014-0.923=0.091
min5046.920-5047.372=-0.452
max5049.540-5049.590=-0.051
mean2704.000-2843.000=-139.000
σ0.000
min2704.000-2843.000=-139.000
max2704.000-2843.000=-139.000
mean8.766-8.872=-0.106
σ0.300-0.641=-0.341
min8.351-8.091=0.260
max9.152-9.533=-0.382
iters=5
new-facts=6402
prior-facts=6402
mean5179.041-5179.048=-0.007
σ0.077-0.095=-0.018
min5178.968-5178.958=0.010
max5179.129-5179.154=-0.025
mean3220.600-3283.000=-62.400
σ379.642-392.859=-13.218
min2704.000-2843.000=-139.000
max3700.000-3848.000=-148.000
mean9.884-9.712=0.172
σ0.389-0.588=-0.199
min9.433-8.795=0.637
max10.466-10.177=0.289

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.086-1.098=-0.012
σ0.133-0.217=-0.083
min0.957-0.972=-0.015
max1.265-1.475=-0.209

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.207-463.203=0.004
σ572.661-572.650=0.011
min176.873-176.870=0.003
max1322.198-1322.178=0.020
mean77.500
σ7.000
min74.000
max88.000
mean2704.000-2843.000=-139.000
σ0.000
min2704.000-2843.000=-139.000
max2704.000-2843.000=-139.000
mean0.548-0.439=0.109
σ0.544-0.313=0.231
min0.271-0.275=-0.004
max1.364-0.908=0.455
policies=20
mean1768.971-1768.973=-0.003
σ0.338-0.346=-0.008
min1768.757-1768.734=0.023
max1769.476-1769.484=-0.008
mean740.000
σ0.000
min740.000
max740.000
mean2704.000-2843.000=-139.000
σ0.000
min2704.000-2843.000=-139.000
max2704.000-2843.000=-139.000
mean2.755-2.850=-0.096
σ0.017-0.017=0.000
min2.740-2.829=-0.089
max2.778-2.871=-0.093
policies=200
mean17696.241-17696.042=0.198
σ0.507-0.488=0.020
min17695.930-17695.732=0.198
max17696.995-17696.765=0.231
mean7400.000
σ0.000
min7400.000
max7400.000
mean2704.000-2843.000=-139.000
σ0.000
min2704.000-2843.000=-139.000
max2704.000-2843.000=-139.000
mean27.688-28.156=-0.468
σ0.142-0.531=-0.389
min27.501-27.502=-0.001
max27.801-28.646=-0.845