Compare commits

Home / Compare b2594c0b .. bfb7fe61

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.770-30.769=0.000
σ0.046-0.048=-0.002
min30.731-30.729=0.002
max30.896-30.903=-0.007
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.076-0.078=-0.001
σ0.003-0.003=0.001
min0.070-0.076=-0.005
max0.084-0.085=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.061-21.060=0.000
σ0.002-0.004=-0.002
min21.058-21.056=0.002
max21.064-21.066=-0.002
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.062-0.063=-0.001
σ0.004-0.002=0.001
min0.056-0.062=-0.006
max0.069-0.070=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.419-1751.419=-0.000
σ0.361-0.361=0.001
min1750.853-1750.850=0.003
max1752.006-1752.005=0.000
mean1656.300-1648.650=7.650
σ646.090-622.103=23.987
min641.000-679.000=-38.000
max2848.000-2647.000=201.000
mean2.831-2.827=0.004
σ0.198-0.226=-0.028
min2.310-2.165=0.145
max3.223-3.329=-0.106

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.726-275.753=-0.026
σ0.002-0.010=-0.007
min275.723-275.742=-0.020
max275.728-275.765=-0.037
mean2848.000-2647.000=201.000
σ0.000
min2848.000-2647.000=201.000
max2848.000-2647.000=201.000
mean0.396-0.395=0.002
σ0.009-0.009=-0.000
min0.387-0.387=-0.000
max0.406-0.407=-0.002
iters=5
new-facts=1
prior-facts=6402
mean2168.288-2168.280=0.007
σ0.009-0.005=0.003
min2168.278-2168.272=0.006
max2168.301-2168.286=0.015
mean2848.000-2647.000=201.000
σ0.000
min2848.000-2647.000=201.000
max2848.000-2647.000=201.000
mean2.929-2.909=0.020
σ0.157-0.166=-0.009
min2.744-2.701=0.043
max3.079-3.056=0.023
iters=5
new-facts=6402
prior-facts=1
mean5048.000-5048.117=-0.117
σ0.683-0.939=-0.256
min5047.541-5047.558=-0.017
max5049.210-5049.789=-0.579
mean2848.000-2647.000=201.000
σ0.000
min2848.000-2647.000=201.000
max2848.000-2647.000=201.000
mean8.916-8.858=0.059
σ0.639-0.526=0.114
min8.052-8.086=-0.034
max9.699-9.364=0.335
iters=5
new-facts=6402
prior-facts=6402
mean5179.020-5179.239=-0.219
σ0.158-0.081=0.077
min5178.835-5179.162=-0.327
max5179.199-5179.341=-0.142
mean3253.600-3225.400=28.200
σ343.871-389.844=-45.973
min2848.000-2699.000=149.000
max3735.000-3733.000=2.000
mean9.628-9.920=-0.292
σ0.759-0.361=0.398
min8.737-9.468=-0.731
max10.413-10.309=0.104

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.118-1.172=-0.054
σ0.243-0.367=-0.124
min0.945-0.932=0.013
max1.536-1.787=-0.251

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.574-463.575=-0.001
σ572.661-572.670=-0.009
min177.234-177.237=-0.002
max1322.566-1322.581=-0.015
mean79.750
σ7.500
min76.000
max91.000
mean2848.000-2647.000=201.000
σ0.000
min2848.000-2647.000=201.000
max2848.000-2647.000=201.000
mean0.438-0.560=-0.123
σ0.306-0.558=-0.252
min0.281-0.274=0.008
max0.897-1.397=-0.500
policies=20
mean1772.673-1772.628=0.045
σ0.343-0.311=0.033
min1772.415-1772.431=-0.016
max1773.175-1773.092=0.084
mean760.000
σ0.000
min760.000
max760.000
mean2848.000-2647.000=201.000
σ0.000
min2848.000-2647.000=201.000
max2848.000-2647.000=201.000
mean2.831-2.739=0.091
σ0.021-0.017=0.004
min2.800-2.721=0.079
max2.845-2.757=0.088
policies=200
mean17733.084-17732.933=0.151
σ0.420-0.588=-0.168
min17732.818-17732.543=0.276
max17733.709-17733.803=-0.094
mean7600.000
σ0.000
min7600.000
max7600.000
mean2848.000-2647.000=201.000
σ0.000
min2848.000-2647.000=201.000
max2848.000-2647.000=201.000
mean28.137-27.720=0.417
σ0.464-0.136=0.328
min27.672-27.551=0.121
max28.562-27.861=0.701