Compare commits

Home / Compare 7494df9b .. f18b3a46

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.699-70.696=0.004
σ0.044-0.044=-0.001
min70.673-70.668=0.005
max70.820-70.820=-0.000
mean414.000
σ0.000
min414.000
max414.000
mean0.162-0.160=0.002
σ0.003-0.003=-0.001
min0.158-0.157=0.001
max0.167-0.167=0.000
cache=y
dps=1
iters=10
policies=100
mean21.421-21.421=0.000
σ0.003-0.003=-0.000
min21.416-21.415=0.000
max21.427-21.424=0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.066-0.065=0.001
σ0.003-0.002=0.001
min0.061-0.063=-0.003
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.460-1754.371=0.089
σ0.362-0.361=0.001
min1753.892-1753.804=0.088
max1755.036-1754.954=0.082
mean1642.800-1643.350=-0.550
σ627.992-617.124=10.868
min625.000-690.000=-65.000
max2857.000-2773.000=84.000
mean2.795-2.841=-0.046
σ0.207-0.167=0.040
min2.252-2.263=-0.010
max3.042-3.105=-0.062

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.501-273.405=0.096
σ0.017-0.010=0.007
min273.471-273.395=0.076
max273.513-273.421=0.092
mean2857.000-2773.000=84.000
σ0.000
min2857.000-2773.000=84.000
max2857.000-2773.000=84.000
mean0.377-0.388=-0.011
σ0.006-0.008=-0.003
min0.372-0.382=-0.010
max0.386-0.403=-0.017
iters=5
new-facts=1
prior-facts=6402
mean1933.884-1933.809=0.075
σ0.007-0.012=-0.005
min1933.876-1933.794=0.082
max1933.892-1933.822=0.070
mean2857.000-2773.000=84.000
σ0.000
min2857.000-2773.000=84.000
max2857.000-2773.000=84.000
mean2.977-2.898=0.079
σ0.076-0.128=-0.051
min2.908-2.714=0.194
max3.102-3.074=0.028
iters=5
new-facts=6402
prior-facts=1
mean4754.622-4754.256=0.365
σ0.902-0.814=0.088
min4754.106-4753.173=0.933
max4756.230-4755.469=0.761
mean2857.000-2773.000=84.000
σ0.000
min2857.000-2773.000=84.000
max2857.000-2773.000=84.000
mean8.928-8.382=0.546
σ0.331-0.350=-0.020
min8.536-7.761=0.775
max9.433-8.583=0.850
iters=5
new-facts=6402
prior-facts=6402
mean4945.114-4945.036=0.077
σ0.018-0.019=-0.001
min4945.095-4945.014=0.081
max4945.141-4945.056=0.084
mean3023.000-2988.800=34.200
σ190.062-210.462=-20.400
min2857.000-2773.000=84.000
max3321.000-3296.000=25.000
mean8.442-8.545=-0.104
σ0.083-0.116=-0.033
min8.335-8.442=-0.107
max8.525-8.730=-0.205

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.046-1.056=-0.010
σ0.123-0.127=-0.004
min0.932-0.930=0.002
max1.237-1.234=0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.079-473.869=-0.790
σ575.913-575.952=-0.039
min185.118-185.884=-0.766
max1336.948-1337.797=-0.848
mean88.250
σ8.500
min84.000
max101.000
mean2857.000-2773.000=84.000
σ0.000
min2857.000-2773.000=84.000
max2857.000-2773.000=84.000
mean0.494-0.494=-0.000
σ0.373-0.407=-0.034
min0.305-0.290=0.015
max1.053-1.104=-0.051
policies=20
mean1851.449-1859.134=-7.685
σ0.371-0.369=0.001
min1851.173-1858.882=-7.710
max1851.988-1859.681=-7.693
mean840.000
σ0.000
min840.000
max840.000
mean2857.000-2773.000=84.000
σ0.000
min2857.000-2773.000=84.000
max2857.000-2773.000=84.000
mean2.947-2.873=0.074
σ0.012-0.013=-0.000
min2.931-2.859=0.073
max2.958-2.890=0.069
policies=200
mean18519.847-18598.326=-78.480
σ0.744-0.585=0.160
min18519.295-18597.936=-78.641
max18520.874-18599.184=-78.310
mean8400.000
σ0.000
min8400.000
max8400.000
mean2857.000-2773.000=84.000
σ0.000
min2857.000-2773.000=84.000
max2857.000-2773.000=84.000
mean29.048-28.990=0.057
σ0.409-0.086=0.323
min28.797-28.890=-0.092
max29.657-29.099=0.558