Compare commits

Home / Compare db464776 .. eb8f9945

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.957-35.956=0.000
σ0.101-0.102=-0.001
min35.911-35.913=-0.003
max36.243-36.246=-0.003
mean413.900-414.000=-0.100
σ0.316-0.000=0.316
min413.000-414.000=-1.000
max414.000
mean0.078-0.076=0.001
σ0.004-0.004=0.000
min0.075-0.073=0.001
max0.084-0.085=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.203-26.204=-0.001
σ0.003-0.005=-0.001
min26.198-26.198=-0.000
max26.208-26.212=-0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.061-0.061=0.000
σ0.003-0.003=0.000
min0.059-0.059=-0.000
max0.069-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.305-1756.303=0.002
σ0.369-0.368=0.001
min1755.730-1755.730=-0.000
max1756.899-1756.899=0.000
mean1678.850-1656.900=21.950
σ638.420-626.850=11.569
min679.000-611.000=68.000
max2697.000-2641.000=56.000
mean2.330-2.387=-0.057
σ0.065-0.183=-0.118
min2.248-2.259=-0.011
max2.442-3.111=-0.669

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.824-278.826=-0.001
σ0.004-0.005=-0.000
min278.822-278.820=0.001
max278.832-278.830=0.002
mean2697.000-2641.000=56.000
σ0.000
min2697.000-2641.000=56.000
max2697.000-2641.000=56.000
mean0.412-0.411=0.001
σ0.006-0.004=0.001
min0.407-0.407=-0.000
max0.419-0.418=0.000
iters=5
new-facts=1
prior-facts=6402
mean2268.882-2268.885=-0.003
σ0.018-0.021=-0.003
min2268.868-2268.849=0.018
max2268.914-2268.901=0.013
mean2697.000-2641.000=56.000
σ0.000
min2697.000-2641.000=56.000
max2697.000-2641.000=56.000
mean3.134-2.904=0.229
σ0.205-0.078=0.127
min2.913-2.847=0.067
max3.392-3.041=0.351
iters=5
new-facts=6402
prior-facts=1
mean4954.170-4954.274=-0.105
σ1.022-0.885=0.137
min4953.353-4953.779=-0.425
max4955.945-4955.849=0.096
mean2697.000-2641.000=56.000
σ0.000
min2697.000-2641.000=56.000
max2697.000-2641.000=56.000
mean8.068-7.946=0.122
σ0.420-0.275=0.144
min7.665-7.632=0.033
max8.708-8.279=0.430
iters=5
new-facts=6402
prior-facts=6402
mean5168.826-5168.827=-0.000
σ0.088-0.095=-0.007
min5168.729-5168.720=0.009
max5168.903-5168.901=0.002
mean3341.200-3399.400=-58.200
σ396.533-463.511=-66.977
min2947.000-2814.000=133.000
max3740.000-4023.000=-283.000
mean9.223-9.402=-0.179
σ0.216-0.237=-0.022
min8.976-9.146=-0.170
max9.537-9.708=-0.171

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.993-1.053=-0.061
σ0.093-0.100=-0.007
min0.941-0.940=0.001
max1.157-1.190=-0.033

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.351-460.355=-0.004
σ572.653-572.652=0.001
min174.022-174.020=0.002
max1319.331-1319.333=-0.002
mean79.500
σ7.000
min76.000
max90.000
mean2697.000-2641.000=56.000
σ0.000
min2697.000-2641.000=56.000
max2697.000-2641.000=56.000
mean0.539-0.547=-0.009
σ0.548-0.551=-0.003
min0.263-0.267=-0.004
max1.361-1.375=-0.013
policies=20
mean1740.436-1740.427=0.009
σ0.313-0.307=0.006
min1740.251-1740.228=0.024
max1740.904-1740.884=0.021
mean760.000
σ0.000
min760.000
max760.000
mean2697.000-2641.000=56.000
σ0.000
min2697.000-2641.000=56.000
max2697.000-2641.000=56.000
mean2.690-2.674=0.016
σ0.027-0.015=0.012
min2.657-2.653=0.005
max2.716-2.685=0.031
policies=200
mean17411.261-17411.123=0.138
σ0.424-0.482=-0.057
min17411.004-17410.728=0.276
max17411.896-17411.821=0.075
mean7600.000
σ0.000
min7600.000
max7600.000
mean2697.000-2641.000=56.000
σ0.000
min2697.000-2641.000=56.000
max2697.000-2641.000=56.000
mean26.988-26.938=0.051
σ0.112-0.053=0.060
min26.874-26.898=-0.024
max27.118-27.013=0.105