Compare commits

Home / Compare d7df35d5 .. 49e03b5f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.966-36.728=-0.762
σ0.102-0.688=-0.586
min35.922-35.922=-0.000
max36.254-37.532=-1.277
mean412.000-4016.000=-3604.000
σ0.000
min412.000-4016.000=-3604.000
max412.000-4016.000=-3604.000
mean0.077-0.074=0.003
σ0.004-0.000=0.003
min0.074-0.073=0.001
max0.085-0.075=0.010
cache=y
dps=1
iters=10
policies=100
mean26.209-26.708=-0.499
σ0.004-0.574=-0.571
min26.202-26.211=-0.009
max26.214-27.463=-1.249
mean413.000-4016.000=-3603.000
σ0.000
min413.000-4016.000=-3603.000
max413.000-4016.000=-3603.000
mean0.060-0.060=0.000
σ0.003-0.001=0.003
min0.057-0.059=-0.001
max0.069-0.061=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.315-1756.378=-0.062
σ0.367-0.372=-0.006
min1755.741-1755.805=-0.065
max1756.908-1756.984=-0.077
mean1656.500-1661.950=-5.450
σ637.700-627.435=10.265
min611.000-688.000=-77.000
max2690.000-2611.000=79.000
mean2.409-2.302=0.106
σ0.169-0.180=-0.011
min2.262-2.144=0.118
max3.047-2.786=0.261

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.843-278.719=0.124
σ0.008-0.005=0.004
min278.830-278.711=0.119
max278.850-278.723=0.127
mean2690.000-2611.000=79.000
σ0.000
min2690.000-2611.000=79.000
max2690.000-2611.000=79.000
mean0.415-0.419=-0.003
σ0.008-0.001=0.007
min0.409-0.418=-0.009
max0.428-0.420=0.008
iters=5
new-facts=1
prior-facts=6402
mean2268.905-2268.880=0.025
σ0.009-0.014=-0.004
min2268.896-2268.856=0.040
max2268.918-2268.888=0.030
mean2690.000-2611.000=79.000
σ0.000
min2690.000-2611.000=79.000
max2690.000-2611.000=79.000
mean2.972-2.984=-0.012
σ0.160-0.134=0.026
min2.780-2.895=-0.115
max3.176-3.220=-0.044
iters=5
new-facts=6402
prior-facts=1
mean4954.258-4952.259=1.999
σ0.884-0.941=-0.057
min4953.783-4951.407=2.376
max4955.837-4953.876=1.961
mean2690.000-2611.000=79.000
σ0.000
min2690.000-2611.000=79.000
max2690.000-2611.000=79.000
mean8.127-7.998=0.129
σ0.363-0.173=0.190
min7.742-7.797=-0.055
max8.702-8.250=0.451
iters=5
new-facts=6402
prior-facts=6402
mean5168.746-5167.095=1.651
σ0.210-0.011=0.200
min5168.399-5167.083=1.315
max5168.935-5167.113=1.822
mean3506.200-3362.400=143.800
σ494.156-448.654=45.501
min2858.000-2840.000=18.000
max4187.000-4016.000=171.000
mean9.585-9.376=0.208
σ0.305-0.296=0.010
min9.309-8.955=0.354
max10.084-9.698=0.387

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.149-1.113=0.035
σ0.303-0.077=0.226
min0.940-1.072=-0.132
max1.680-1.251=0.428

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.359-460.266=0.093
σ572.653-572.607=0.045
min174.024-173.961=0.063
max1319.338-1319.177=0.161
mean79.500
σ7.000
min76.000
max90.000
mean2690.000-437.000=2253.000
σ0.000
min2690.000-437.000=2253.000
max2690.000-437.000=2253.000
mean0.532-0.571=-0.039
σ0.514-0.591=-0.077
min0.268-0.271=-0.002
max1.302-1.457=-0.155
policies=20
mean1740.500-1740.115=0.385
σ0.323-0.334=-0.011
min1740.295-1739.876=0.419
max1740.982-1740.605=0.377
mean760.000
σ0.000
min760.000
max760.000
mean2690.000-448.250=2241.750
σ0.000-10.308=-10.308
min2690.000-437.000=2253.000
max2690.000-457.000=2233.000
mean2.691-2.666=0.025
σ0.039-0.009=0.030
min2.658-2.658=0.000
max2.746-2.678=0.068
policies=200
mean17411.945-17410.395=1.551
σ0.514-0.076=0.438
min17411.645-17410.330=1.314
max17412.713-17410.504=2.209
mean7600.000
σ0.000
min7600.000
max7600.000
mean2690.000-494.000=2196.000
σ0.000-3.367=-3.367
min2690.000-490.000=2200.000
max2690.000-498.000=2192.000
mean27.004-26.878=0.125
σ0.136-0.089=0.048
min26.883-26.749=0.134
max27.180-26.950=0.230