Compare commits

Home / Compare f32b7749 .. 7dcb74b8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.770-30.773=-0.003
σ0.048-0.045=0.002
min30.727-30.751=-0.025
max30.900-30.902=-0.002
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.078-0.078=0.000
σ0.003-0.003=0.000
min0.076-0.075=0.001
max0.084-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean21.060-21.059=0.001
σ0.002-0.003=-0.001
min21.058-21.053=0.004
max21.064-21.062=0.002
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.063-0.061=0.002
σ0.002-0.003=-0.001
min0.062-0.057=0.005
max0.069-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.420-1751.237=0.183
σ0.361-0.366=-0.005
min1750.850-1750.669=0.182
max1752.000-1751.826=0.173
mean1664.450-1636.450=28.000
σ639.360-614.984=24.375
min681.000-626.000=55.000
max2695.000-2470.000=225.000
mean2.812-2.803=0.009
σ0.178-0.193=-0.016
min2.293-2.261=0.032
max3.023-3.057=-0.034

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.755-275.566=0.189
σ0.008-0.003=0.005
min275.745-275.562=0.183
max275.765-275.570=0.196
mean2695.000-2470.000=225.000
σ0.000
min2695.000-2470.000=225.000
max2695.000-2470.000=225.000
mean0.404-0.393=0.012
σ0.011-0.010=0.002
min0.395-0.384=0.011
max0.418-0.405=0.013
iters=5
new-facts=1
prior-facts=6402
mean2168.279-2168.094=0.185
σ0.015-0.009=0.006
min2168.258-2168.083=0.175
max2168.297-2168.104=0.193
mean2695.000-2470.000=225.000
σ0.000
min2695.000-2470.000=225.000
max2695.000-2470.000=225.000
mean2.997-3.016=-0.019
σ0.144-0.179=-0.035
min2.757-2.784=-0.027
max3.114-3.278=-0.165
iters=5
new-facts=6402
prior-facts=1
mean5048.106-5047.903=0.203
σ0.943-0.919=0.024
min5047.601-5047.336=0.265
max5049.790-5049.538=0.252
mean2695.000-2470.000=225.000
σ0.000
min2695.000-2470.000=225.000
max2695.000-2470.000=225.000
mean8.940-9.038=-0.098
σ0.261-0.507=-0.246
min8.589-8.202=0.387
max9.319-9.518=-0.198
iters=5
new-facts=6402
prior-facts=6402
mean5179.239-5178.979=0.260
σ0.091-0.187=-0.095
min5179.143-5178.669=0.473
max5179.344-5179.128=0.216
mean3232.600-3224.000=8.600
σ392.878-390.293=2.584
min2701.000-2663.000=38.000
max3741.000-3688.000=53.000
mean9.632-9.932=-0.299
σ0.775-0.219=0.556
min8.589-9.558=-0.969
max10.604-10.102=0.501

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.076-1.749=-0.673
σ0.172-0.118=0.055
min0.948-1.576=-0.627
max1.286-1.898=-0.611

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.574-463.196=0.378
σ572.665-572.646=0.019
min177.240-176.873=0.367
max1322.571-1322.165=0.406
mean79.750-77.500=2.250
σ7.500-7.000=0.500
min76.000-74.000=2.000
max91.000-88.000=3.000
mean2695.000-2470.000=225.000
σ0.000
min2695.000-2470.000=225.000
max2695.000-2470.000=225.000
mean0.545-0.540=0.005
σ0.539-0.533=0.006
min0.274-0.271=0.002
max1.353-1.340=0.013
policies=20
mean1772.641-1768.956=3.685
σ0.325-0.329=-0.004
min1772.421-1768.748=3.673
max1773.124-1769.447=3.677
mean760.000-740.000=20.000
σ0.000
min760.000-740.000=20.000
max760.000-740.000=20.000
mean2695.000-2470.000=225.000
σ0.000
min2695.000-2470.000=225.000
max2695.000-2470.000=225.000
mean2.751-2.738=0.013
σ0.023-0.024=-0.002
min2.729-2.704=0.025
max2.782-2.760=0.022
policies=200
mean17732.898-17696.240=36.658
σ0.598-0.515=0.084
min17732.502-17695.958=36.545
max17733.776-17697.011=36.765
mean7600.000-7400.000=200.000
σ0.000
min7600.000-7400.000=200.000
max7600.000-7400.000=200.000
mean2695.000-2470.000=225.000
σ0.000
min2695.000-2470.000=225.000
max2695.000-2470.000=225.000
mean27.681-27.592=0.089
σ0.102-0.143=-0.041
min27.610-27.443=0.168
max27.831-27.755=0.076