Compare commits

Home / Compare 5b3d58d5 .. a5f98821

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.569-70.569=0.000
σ0.047-0.045=0.002
min70.546-70.547=-0.001
max70.701-70.696=0.005
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.157-0.159=-0.002
σ0.005-0.002=0.003
min0.150-0.157=-0.007
max0.166-0.164=0.003
cache=y
dps=1
iters=10
policies=100
mean21.295-21.292=0.004
σ0.012-0.003=0.009
min21.287-21.287=-0.000
max21.329-21.297=0.032
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.064-0.064=0.000
σ0.002-0.002=0.000
min0.063-0.063=-0.000
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1749.768-1753.174=-3.406
σ0.360-0.359=0.001
min1749.195-1752.610=-3.415
max1750.338-1753.755=-3.417
mean1655.200-1660.250=-5.050
σ628.848-641.088=-12.240
min641.000-692.000=-51.000
max2856.000-2902.000=-46.000
mean2.829-2.867=-0.038
σ0.086-0.154=-0.068
min2.589-2.341=0.248
max2.977-3.070=-0.093

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean268.233-271.621=-3.388
σ0.008-0.005=0.004
min268.224-271.614=-3.390
max268.243-271.625=-3.382
mean2856.000-2902.000=-46.000
σ0.000
min2856.000-2902.000=-46.000
max2856.000-2902.000=-46.000
mean0.384-0.376=0.008
σ0.009-0.008=0.001
min0.374-0.371=0.004
max0.395-0.390=0.005
iters=5
new-facts=1
prior-facts=6402
mean1928.635-1932.036=-3.400
σ0.010-0.009=0.001
min1928.621-1932.026=-3.406
max1928.649-1932.047=-3.399
mean2856.000-2902.000=-46.000
σ0.000
min2856.000-2902.000=-46.000
max2856.000-2902.000=-46.000
mean3.003-2.999=0.004
σ0.045-0.068=-0.022
min2.952-2.921=0.031
max3.062-3.102=-0.040
iters=5
new-facts=6402
prior-facts=1
mean4749.385-4752.711=-3.327
σ0.909-0.935=-0.027
min4748.897-4751.980=-3.083
max4751.001-4754.344=-3.343
mean2856.000-2902.000=-46.000
σ0.000
min2856.000-2902.000=-46.000
max2856.000-2902.000=-46.000
mean8.471-8.665=-0.194
σ0.537-0.525=0.012
min7.589-7.950=-0.361
max8.921-9.407=-0.485
iters=5
new-facts=6402
prior-facts=6402
mean4939.833-4943.166=-3.332
σ0.018-0.153=-0.135
min4939.806-4942.892=-3.086
max4939.849-4943.242=-3.393
mean3055.000-3030.800=24.200
σ193.929-156.771=37.158
min2856.000-2902.000=-46.000
max3335.000-3286.000=49.000
mean8.480-8.595=-0.116
σ0.168-0.135=0.033
min8.336-8.469=-0.133
max8.731-8.812=-0.081

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.000-1.031=-0.031
σ0.142-0.142=-0.000
min0.930-0.936=-0.006
max1.254-1.263=-0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.510-472.291=-6.782
σ575.914-575.921=-0.007
min177.546-184.321=-6.775
max1329.380-1336.173=-6.793
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2856.000-2902.000=-46.000
σ0.000
min2856.000-2902.000=-46.000
max2856.000-2902.000=-46.000
mean0.437-0.486=-0.049
σ0.300-0.379=-0.079
min0.282-0.292=-0.010
max0.887-1.055=-0.168
policies=20
mean1775.744-1843.554=-67.810
σ0.367-0.376=-0.009
min1775.471-1843.280=-67.809
max1776.283-1844.103=-67.821
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2856.000-2902.000=-46.000
σ0.000
min2856.000-2902.000=-46.000
max2856.000-2902.000=-46.000
mean2.859-2.944=-0.085
σ0.006-0.006=0.000
min2.851-2.937=-0.086
max2.865-2.950=-0.086
policies=200
mean17763.863-18442.080=-678.217
σ0.494-0.410=0.084
min17763.402-18441.776=-678.374
max17764.546-18442.683=-678.137
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2856.000-2902.000=-46.000
σ0.000
min2856.000-2902.000=-46.000
max2856.000-2902.000=-46.000
mean28.335-29.391=-1.056
σ0.517-0.553=-0.036
min27.772-28.788=-1.016
max28.845-30.007=-1.162