Compare commits

Home / Compare 9e8b136a .. 8f66bbf0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean92.531-92.524=0.007
σ0.051-0.055=-0.004
min92.495-92.480=0.015
max92.666-92.668=-0.002
mean417.000-414.600=2.400
σ0.000-0.516=-0.516
min417.000-414.000=3.000
max417.000-415.000=2.000
mean0.235-0.213=0.022
σ0.024-0.003=0.020
min0.204-0.207=-0.003
max0.259-0.219=0.040
cache=y
dps=1
iters=10
policies=100
mean43.136-43.137=-0.001
σ0.005-0.005=0.000
min43.128-43.130=-0.002
max43.144-43.142=0.001
mean417.000-416.400=0.600
σ0.000-0.966=-0.966
min417.000-415.000=2.000
max417.000
mean0.115-0.113=0.002
σ0.003-0.003=-0.000
min0.110-0.108=0.002
max0.118-0.116=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1761.433-1761.433=-0.000
σ0.362-0.364=-0.002
min1760.864-1760.860=0.004
max1762.026-1762.030=-0.004
mean1654.450-1664.300=-9.850
σ640.734-654.770=-14.036
min659.000-657.000=2.000
max2836.000-2855.000=-19.000
mean2.568-2.560=0.008
σ0.339-0.309=0.029
min2.174-2.181=-0.006
max3.216-3.036=0.180

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean328.800-328.797=0.003
σ0.069-0.069=0.000
min328.676-328.674=0.003
max328.838-328.834=0.004
mean2836.000-2855.000=-19.000
σ0.000
min2836.000-2855.000=-19.000
max2836.000-2855.000=-19.000
mean0.447-0.439=0.007
σ0.013-0.011=0.002
min0.434-0.432=0.003
max0.462-0.459=0.002
iters=5
new-facts=1
prior-facts=6402
mean1989.320-1989.330=-0.010
σ0.014-0.005=0.009
min1989.303-1989.322=-0.019
max1989.332-1989.334=-0.002
mean2836.000-2855.000=-19.000
σ0.000
min2836.000-2855.000=-19.000
max2836.000-2855.000=-19.000
mean3.039-3.177=-0.138
σ0.138-0.272=-0.133
min2.845-2.725=0.120
max3.215-3.406=-0.191
iters=5
new-facts=6402
prior-facts=1
mean4812.936-4812.740=0.197
σ7.852-7.979=-0.127
min4808.980-4808.410=0.570
max4826.974-4826.990=-0.016
mean2836.000-2855.000=-19.000
σ0.000
min2836.000-2855.000=-19.000
max2836.000-2855.000=-19.000
mean8.735-8.456=0.280
σ0.265-0.481=-0.216
min8.407-7.650=0.757
max9.146-8.827=0.320
iters=5
new-facts=6402
prior-facts=6402
mean5000.535-5000.590=-0.056
σ0.159-0.026=0.133
min5000.253-5000.559=-0.306
max5000.629-5000.620=0.009
mean3017.000-3080.000=-63.000
σ201.149-244.967=-43.818
min2836.000-2855.000=-19.000
max3325.000-3339.000=-14.000
mean8.837-8.865=-0.028
σ0.436-0.358=0.078
min8.515-8.516=-0.001
max9.597-9.455=0.142

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.042-1.070=-0.029
σ0.133-0.273=-0.140
min0.919-0.918=0.001
max1.245-1.548=-0.303

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean470.844-470.849=-0.004
σ574.237-574.236=0.001
min183.719-183.717=0.003
max1332.200-1332.203=-0.003
mean90.250
σ8.500
min86.000
max103.000
mean2836.000-2855.000=-19.000
σ0.000
min2836.000-2855.000=-19.000
max2836.000-2855.000=-19.000
mean0.439-0.446=-0.008
σ0.298-0.299=-0.001
min0.279-0.294=-0.015
max0.885-0.894=-0.009
policies=20
mean1837.509-1837.498=0.011
σ0.398-0.406=-0.007
min1837.214-1837.192=0.022
max1838.090-1838.090=-0.000
mean860.000
σ0.000
min860.000
max860.000
mean2836.000-2855.000=-19.000
σ0.000
min2836.000-2855.000=-19.000
max2836.000-2855.000=-19.000
mean2.932-2.925=0.007
σ0.015-0.004=0.010
min2.911-2.922=-0.011
max2.945-2.931=0.014
policies=200
mean18382.001-18381.988=0.014
σ0.446-0.356=0.089
min18381.729-18381.692=0.038
max18382.662-18382.503=0.159
mean8600.000
σ0.000
min8600.000
max8600.000
mean2836.000-2855.000=-19.000
σ0.000
min2836.000-2855.000=-19.000
max2836.000-2855.000=-19.000
mean29.196-29.019=0.177
σ0.434-0.360=0.074
min28.746-28.705=0.040
max29.593-29.457=0.136