Compare commits

Home / Compare 04f047d4 .. c14d1610

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.973=0.000
σ0.106-0.106=-0.000
min35.926-35.924=0.002
max36.274-36.274=-0.001
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.076-0.075=0.001
σ0.004-0.004=0.000
min0.072-0.070=0.001
max0.084-0.082=0.002
cache=y
dps=1
iters=10
policies=100
mean26.209-26.208=0.000
σ0.003-0.004=-0.001
min26.204-26.204=0.000
max26.213-26.218=-0.005
mean412.000-414.900=-2.900
σ0.000-0.316=-0.316
min412.000-414.000=-2.000
max412.000-415.000=-3.000
mean0.061-0.060=0.001
σ0.003-0.003=0.001
min0.057-0.057=-0.001
max0.070-0.067=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.364-1758.365=-0.001
σ0.373-0.372=0.000
min1757.786-1757.787=-0.002
max1758.959-1758.962=-0.002
mean1660.850-1658.450=2.400
σ631.203-624.120=7.083
min685.000-687.000=-2.000
max2810.000-2767.000=43.000
mean2.415-2.416=-0.000
σ0.087-0.091=-0.003
min2.316-2.317=-0.001
max2.579-2.635=-0.056

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.510-279.508=0.002
σ0.005-0.007=-0.002
min279.503-279.498=0.005
max279.514-279.515=-0.001
mean2810.000-2767.000=43.000
σ0.000
min2810.000-2767.000=43.000
max2810.000-2767.000=43.000
mean0.408-0.409=-0.001
σ0.003-0.001=0.002
min0.403-0.408=-0.004
max0.411-0.411=0.000
iters=5
new-facts=1
prior-facts=6402
mean2178.450-2178.448=0.002
σ0.015-0.012=0.003
min2178.433-2178.437=-0.004
max2178.473-2178.468=0.005
mean2810.000-2767.000=43.000
σ0.000
min2810.000-2767.000=43.000
max2810.000-2767.000=43.000
mean3.381-3.490=-0.110
σ0.284-0.145=0.139
min2.906-3.332=-0.426
max3.590-3.696=-0.106
iters=5
new-facts=6402
prior-facts=1
mean5056.396-5056.384=0.012
σ1.025-1.039=-0.014
min5055.788-5055.784=0.004
max5058.220-5058.222=-0.002
mean2810.000-2767.000=43.000
σ0.000
min2810.000-2767.000=43.000
max2810.000-2767.000=43.000
mean8.752-8.893=-0.141
σ0.729-0.675=0.054
min8.115-8.205=-0.090
max9.922-9.896=0.026
iters=5
new-facts=6402
prior-facts=6402
mean5193.668-5193.762=-0.093
σ0.248-0.092=0.156
min5193.254-5193.691=-0.437
max5193.862-5193.865=-0.003
mean3305.600-3289.200=16.400
σ380.056-396.219=-16.162
min2810.000-2767.000=43.000
max3668.000-3671.000=-3.000
mean9.087-9.096=-0.009
σ0.393-0.334=0.059
min8.793-8.761=0.032
max9.762-9.606=0.156

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.945-0.973=-0.028
σ0.014-0.058=-0.044
min0.938-0.938=-0.001
max0.970-1.074=-0.105

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.482-465.478=0.004
σ572.657-572.662=-0.005
min179.143-179.141=0.002
max1324.468-1324.471=-0.004
mean79.500
σ7.000
min76.000
max90.000
mean2810.000-2767.000=43.000
σ0.000
min2810.000-2767.000=43.000
max2810.000-2767.000=43.000
mean0.443-0.483=-0.040
σ0.300-0.401=-0.102
min0.293-0.279=0.014
max0.893-1.085=-0.193
policies=20
mean1791.709-1791.703=0.006
σ0.352-0.331=0.021
min1791.474-1791.510=-0.036
max1792.228-1792.195=0.033
mean760.000
σ0.000
min760.000
max760.000
mean2810.000-2767.000=43.000
σ0.000
min2810.000-2767.000=43.000
max2810.000-2767.000=43.000
mean2.882-2.820=0.062
σ0.108-0.021=0.087
min2.785-2.806=-0.021
max3.023-2.850=0.173
policies=200
mean17923.437-17923.379=0.058
σ0.467-0.446=0.021
min17923.181-17923.020=0.162
max17924.138-17924.031=0.107
mean7600.000
σ0.000
min7600.000
max7600.000
mean2810.000-2767.000=43.000
σ0.000
min2810.000-2767.000=43.000
max2810.000-2767.000=43.000
mean28.420-28.399=0.021
σ0.120-0.152=-0.032
min28.295-28.270=0.025
max28.552-28.588=-0.036