Compare commits

Home / Compare 549c7d1c .. a1ddbe0a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.772-30.773=-0.000
σ0.049-0.046=0.002
min30.743-30.749=-0.006
max30.909-30.904=0.005
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.074-0.079=-0.005
σ0.005-0.003=0.002
min0.070-0.076=-0.006
max0.085-0.086=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.059-21.060=-0.001
σ0.003-0.003=0.000
min21.055-21.057=-0.003
max21.063-21.065=-0.002
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.063-0.064=-0.001
σ0.004-0.003=0.001
min0.059-0.062=-0.003
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.237-1751.235=0.003
σ0.364-0.364=-0.000
min1750.670-1750.671=-0.001
max1751.821-1751.827=-0.006
mean1665.900-1661.900=4.000
σ636.535-627.285=9.250
min681.000-685.000=-4.000
max2704.000-2769.000=-65.000
mean2.873-2.844=0.029
σ0.131-0.129=0.002
min2.540-2.439=0.101
max3.032-3.060=-0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.564-267.614=7.950
σ0.007-17.779=-17.772
min275.557-235.810=39.747
max275.576-275.570=0.007
mean2704.000-2769.000=-65.000
σ0.000
min2704.000-2769.000=-65.000
max2704.000-2769.000=-65.000
mean0.393-0.380=0.013
σ0.010-0.031=-0.021
min0.385-0.326=0.060
max0.404-0.399=0.006
iters=5
new-facts=1
prior-facts=6402
mean2168.091-2168.085=0.006
σ0.008-0.015=-0.006
min2168.077-2168.067=0.010
max2168.098-2168.103=-0.004
mean2704.000-2769.000=-65.000
σ0.000
min2704.000-2769.000=-65.000
max2704.000-2769.000=-65.000
mean3.024-2.935=0.090
σ0.196-0.097=0.098
min2.779-2.810=-0.031
max3.225-3.053=0.172
iters=5
new-facts=6402
prior-facts=1
mean5047.785-5047.909=-0.124
σ1.014-0.878=0.136
min5046.920-5047.334=-0.414
max5049.540-5049.444=0.096
mean2704.000-2769.000=-65.000
σ0.000
min2704.000-2769.000=-65.000
max2704.000-2769.000=-65.000
mean8.766-8.903=-0.137
σ0.300-0.507=-0.207
min8.351-8.196=0.155
max9.152-9.405=-0.253
iters=5
new-facts=6402
prior-facts=6402
mean5179.041-5178.975=0.066
σ0.077-0.200=-0.123
min5178.968-5178.651=0.318
max5179.129-5179.159=-0.030
mean3220.600-3302.400=-81.800
σ379.642-394.037=-14.396
min2704.000-2769.000=-65.000
max3700.000-3674.000=26.000
mean9.884-9.873=0.011
σ0.389-0.212=0.177
min9.433-9.534=-0.101
max10.466-10.106=0.360

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.086-1.056=0.030
σ0.133-0.184=-0.051
min0.957-0.944=0.013
max1.265-1.373=-0.107

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.207-463.203=0.004
σ572.661-572.662=-0.002
min176.873-176.869=0.003
max1322.198-1322.197=0.001
mean77.500
σ7.000
min74.000
max88.000
mean2704.000-2769.000=-65.000
σ0.000
min2704.000-2769.000=-65.000
max2704.000-2769.000=-65.000
mean0.548-0.440=0.108
σ0.544-0.305=0.239
min0.271-0.286=-0.014
max1.364-0.897=0.466
policies=20
mean1768.971-1768.972=-0.002
σ0.338-0.302=0.036
min1768.757-1768.762=-0.006
max1769.476-1769.421=0.055
mean740.000
σ0.000
min740.000
max740.000
mean2704.000-2769.000=-65.000
σ0.000
min2704.000-2769.000=-65.000
max2704.000-2769.000=-65.000
mean2.755-2.772=-0.017
σ0.017-0.080=-0.063
min2.740-2.714=0.026
max2.778-2.890=-0.112
policies=200
mean17696.241-17696.272=-0.031
σ0.507-0.488=0.019
min17695.930-17696.005=-0.075
max17696.995-17697.004=-0.008
mean7400.000
σ0.000
min7400.000
max7400.000
mean2704.000-2769.000=-65.000
σ0.000
min2704.000-2769.000=-65.000
max2704.000-2769.000=-65.000
mean27.688-27.577=0.111
σ0.142-0.148=-0.006
min27.501-27.413=0.088
max27.801-27.762=0.039