Compare commits

Home / Compare 5ef26fd2 .. 38a3b691

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.619-35.617=0.001
σ0.055-0.053=0.002
min35.590-35.591=-0.001
max35.774-35.768=0.006
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.086-0.082=0.003
σ0.005-0.004=0.000
min0.082-0.076=0.006
max0.093-0.091=0.002
cache=y
dps=1
iters=10
policies=100
mean24.046-24.048=-0.002
σ0.002-0.003=-0.001
min24.043-24.044=-0.001
max24.051-24.054=-0.004
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.064-0.068=-0.004
σ0.004-0.003=0.001
min0.061-0.067=-0.005
max0.072-0.075=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.487=0.003
σ0.366-0.365=0.001
min1755.913-1755.912=0.002
max1757.080-1757.072=0.008
mean1633.800-1654.050=-20.250
σ592.992-643.499=-50.507
min646.000-628.000=18.000
max2432.000-2841.000=-409.000
mean2.330-2.347=-0.016
σ0.083-0.079=0.004
min2.233-2.265=-0.032
max2.552-2.534=0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.769-324.765=0.004
σ0.046-0.045=0.000
min324.687-324.684=0.003
max324.795-324.792=0.002
mean2432.000-2841.000=-409.000
σ0.000
min2432.000-2841.000=-409.000
max2432.000-2841.000=-409.000
mean0.430-0.416=0.014
σ0.008-0.001=0.007
min0.422-0.415=0.008
max0.443-0.418=0.025
iters=5
new-facts=1
prior-facts=6402
mean1985.320-1985.317=0.003
σ0.014-0.016=-0.003
min1985.301-1985.287=0.013
max1985.334-1985.326=0.008
mean2432.000-2841.000=-409.000
σ0.000
min2432.000-2841.000=-409.000
max2432.000-2841.000=-409.000
mean2.664-2.742=-0.078
σ0.149-0.142=0.007
min2.464-2.599=-0.135
max2.806-2.949=-0.143
iters=5
new-facts=6402
prior-facts=1
mean4808.998-4809.105=-0.107
σ7.715-7.648=0.067
min4805.079-4805.580=-0.501
max4822.789-4822.784=0.004
mean2432.000-2841.000=-409.000
σ0.000
min2432.000-2841.000=-409.000
max2432.000-2841.000=-409.000
mean8.834-8.824=0.010
σ0.430-0.314=0.116
min8.238-8.477=-0.239
max9.367-9.194=0.173
iters=5
new-facts=6402
prior-facts=6402
mean4996.626-4996.631=-0.005
σ0.034-0.020=0.014
min4996.583-4996.610=-0.028
max4996.660-4996.660=0.000
mean2928.600-3078.800=-150.200
σ411.732-255.919=155.813
min2459.000-2841.000=-382.000
max3491.000-3348.000=143.000
mean8.495-8.720=-0.225
σ0.106-0.125=-0.019
min8.389-8.527=-0.138
max8.665-8.827=-0.162

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.678-0.953=0.725
σ0.132-0.056=0.076
min1.510-0.918=0.592
max1.807-1.052=0.755

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.202-463.204=-0.002
σ574.764-574.773=-0.010
min175.811-175.811=-0.000
max1325.347-1325.364=-0.016
mean86.250
σ8.500
min82.000
max99.000
mean2432.000-2841.000=-409.000
σ0.000
min2432.000-2841.000=-409.000
max2432.000-2841.000=-409.000
mean0.535-0.431=0.104
σ0.526-0.299=0.227
min0.270-0.279=-0.009
max1.324-0.880=0.445
policies=20
mean1758.491-1758.496=-0.005
σ0.338-0.344=-0.006
min1758.258-1758.262=-0.004
max1758.991-1759.004=-0.013
mean820.000
σ0.000
min820.000
max820.000
mean2432.000-2841.000=-409.000
σ0.000
min2432.000-2841.000=-409.000
max2432.000-2841.000=-409.000
mean2.717-2.795=-0.078
σ0.016-0.016=0.000
min2.700-2.778=-0.078
max2.736-2.815=-0.080
policies=200
mean17592.143-17592.058=0.086
σ0.492-0.512=-0.021
min17591.883-17591.715=0.168
max17592.881-17592.819=0.062
mean8200.000
σ0.000
min8200.000
max8200.000
mean2432.000-2841.000=-409.000
σ0.000
min2432.000-2841.000=-409.000
max2432.000-2841.000=-409.000
mean27.348-27.780=-0.432
σ0.152-0.353=-0.201
min27.200-27.358=-0.158
max27.492-28.164=-0.672