Compare commits

Home / Compare 27a76a02 .. 6c9fb3a0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.706-70.707=-0.001
σ0.047-0.045=0.002
min70.672-70.681=-0.009
max70.836-70.832=0.004
mean417.000-411.000=6.000
σ0.000
min417.000-411.000=6.000
max417.000-411.000=6.000
mean0.158-0.161=-0.003
σ0.006-0.004=0.002
min0.150-0.156=-0.006
max0.167-0.168=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.412-21.412=-0.000
σ0.003-0.003=0.000
min21.407-21.408=-0.001
max21.417-21.416=0.002
mean417.900-411.000=6.900
σ0.316-0.000=0.316
min417.000-411.000=6.000
max418.000-411.000=7.000
mean0.065-0.065=0.000
σ0.002-0.002=0.000
min0.064-0.063=0.000
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.929-1754.932=-0.003
σ0.358-0.362=-0.004
min1754.364-1754.357=0.007
max1755.502-1755.522=-0.020
mean1649.250-1652.350=-3.100
σ631.656-620.187=11.470
min628.000-679.000=-51.000
max2773.000-2784.000=-11.000
mean2.804-2.810=-0.007
σ0.194-0.170=0.024
min2.371-2.365=0.005
max3.191-3.105=0.086

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.794-272.792=0.002
σ0.006-0.003=0.004
min272.783-272.788=-0.006
max272.797-272.794=0.003
mean2773.000-2784.000=-11.000
σ0.000
min2773.000-2784.000=-11.000
max2773.000-2784.000=-11.000
mean0.381-0.377=0.004
σ0.009-0.001=0.007
min0.373-0.376=-0.002
max0.394-0.379=0.015
iters=5
new-facts=1
prior-facts=6402
mean1933.229-1933.229=0.001
σ0.009-0.012=-0.003
min1933.218-1933.215=0.003
max1933.241-1933.243=-0.003
mean2773.000-2784.000=-11.000
σ0.000
min2773.000-2784.000=-11.000
max2773.000-2784.000=-11.000
mean2.883-2.987=-0.104
σ0.276-0.101=0.175
min2.416-2.878=-0.462
max3.067-3.143=-0.076
iters=5
new-facts=6402
prior-facts=1
mean4757.008-4756.832=0.176
σ7.569-7.638=-0.069
min4753.543-4752.915=0.628
max4770.547-4770.484=0.062
mean2773.000-2784.000=-11.000
σ0.000
min2773.000-2784.000=-11.000
max2773.000-2784.000=-11.000
mean8.159-8.755=-0.595
σ0.477-0.252=0.226
min7.674-8.483=-0.809
max8.772-9.064=-0.292
iters=5
new-facts=6402
prior-facts=6402
mean4944.451-4944.381=0.070
σ0.022-0.168=-0.146
min4944.428-4944.082=0.346
max4944.484-4944.480=0.004
mean3017.600-3001.000=16.600
σ285.499-225.536=59.963
min2773.000-2784.000=-11.000
max3428.000-3334.000=94.000
mean8.497-8.522=-0.025
σ0.109-0.089=0.021
min8.357-8.421=-0.064
max8.652-8.620=0.032

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.035-1.089=-0.054
σ0.124-0.194=-0.070
min0.915-0.910=0.005
max1.221-1.349=-0.128

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.324-468.332=-0.008
σ574.227-574.238=-0.011
min181.200-181.203=-0.003
max1329.664-1329.689=-0.025
mean88.250
σ8.500
min84.000
max101.000
mean2773.000-2784.000=-11.000
σ0.000
min2773.000-2784.000=-11.000
max2773.000-2784.000=-11.000
mean0.443-0.444=-0.000
σ0.304-0.301=0.003
min0.288-0.291=-0.003
max0.899-0.895=0.004
policies=20
mean1812.338-1812.368=-0.029
σ0.390-0.405=-0.015
min1812.058-1812.095=-0.036
max1812.909-1812.962=-0.053
mean840.000
σ0.000
min840.000
max840.000
mean2773.000-2784.000=-11.000
σ0.000
min2773.000-2784.000=-11.000
max2773.000-2784.000=-11.000
mean2.884-2.885=-0.002
σ0.026-0.016=0.010
min2.865-2.865=0.000
max2.922-2.902=0.019
policies=200
mean18128.991-18129.105=-0.114
σ0.483-0.464=0.019
min18128.681-18128.725=-0.043
max18129.710-18129.689=0.022
mean8400.000
σ0.000
min8400.000
max8400.000
mean2773.000-2784.000=-11.000
σ0.000
min2773.000-2784.000=-11.000
max2773.000-2784.000=-11.000
mean28.322-28.423=-0.101
σ0.171-0.190=-0.019
min28.223-28.283=-0.060
max28.578-28.695=-0.117