Compare commits

Home / Compare ce5300ba .. 4876e7eb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.782=0.000
σ0.044-0.048=-0.003
min70.750-70.752=-0.002
max70.905-70.914=-0.009
mean413.800-415.000=-1.200
σ0.422-0.000=0.422
min413.000-415.000=-2.000
max414.000-415.000=-1.000
mean0.161-0.160=0.002
σ0.003-0.005=-0.002
min0.158-0.152=0.007
max0.166-0.168=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=0.000
σ0.002-0.003=-0.001
min21.490-21.489=0.000
max21.495-21.498=-0.003
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.065-0.064=0.001
σ0.002-0.003=-0.001
min0.063-0.061=0.003
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1754.094=-0.001
σ0.360-0.360=-0.001
min1753.537-1753.528=0.009
max1754.679-1754.682=-0.004
mean1658.950-1678.850=-19.900
σ619.795-643.084=-23.289
min644.000-670.000=-26.000
max2498.000-2751.000=-253.000
mean2.786-2.769=0.017
σ0.187-0.175=0.012
min2.287-2.333=-0.046
max3.120-2.993=0.127

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.956-271.597=0.359
σ0.007-0.004=0.002
min271.950-271.593=0.357
max271.966-271.604=0.362
mean2498.000-2751.000=-253.000
σ0.000
min2498.000-2751.000=-253.000
max2498.000-2751.000=-253.000
mean0.382-0.384=-0.001
σ0.007-0.005=0.002
min0.378-0.380=-0.002
max0.395-0.393=0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.322-1932.002=0.319
σ0.006-0.009=-0.003
min1932.315-1931.988=0.328
max1932.330-1932.010=0.320
mean2498.000-2751.000=-253.000
σ0.000
min2498.000-2751.000=-253.000
max2498.000-2751.000=-253.000
mean3.076-2.516=0.560
σ0.139-0.072=0.067
min2.919-2.460=0.458
max3.225-2.614=0.611
iters=5
new-facts=6402
prior-facts=1
mean4752.831-4752.771=0.060
σ1.072-0.844=0.229
min4752.047-4752.232=-0.186
max4754.692-4754.265=0.426
mean2498.000-2751.000=-253.000
σ0.000
min2498.000-2751.000=-253.000
max2498.000-2751.000=-253.000
mean8.846-8.341=0.505
σ0.162-0.523=-0.360
min8.589-7.631=0.957
max9.025-9.023=0.002
iters=5
new-facts=6402
prior-facts=6402
mean4943.562-4943.208=0.354
σ0.010-0.010=-0.001
min4943.551-4943.199=0.352
max4943.576-4943.222=0.354
mean3001.800-3035.600=-33.800
σ311.966-252.622=59.344
min2595.000-2751.000=-156.000
max3403.000-3386.000=17.000
mean8.503-8.611=-0.108
σ0.082-0.139=-0.057
min8.426-8.434=-0.007
max8.619-8.819=-0.200

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.535-1.003=0.532
σ0.125-0.143=-0.018
min1.390-0.935=0.455
max1.729-1.259=0.470

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.631-468.638=-0.007
σ574.929-574.942=-0.013
min181.161-181.165=-0.004
max1331.025-1331.051=-0.026
mean88.250
σ8.500
min84.000
max101.000
mean2498.000-2751.000=-253.000
σ0.000
min2498.000-2751.000=-253.000
max2498.000-2751.000=-253.000
mean0.580-0.569=0.011
σ0.586-0.565=0.021
min0.285-0.283=0.002
max1.459-1.417=0.042
policies=20
mean1811.935-1811.965=-0.030
σ0.398-0.380=0.018
min1811.665-1811.711=-0.046
max1812.521-1812.527=-0.006
mean840.000
σ0.000
min840.000
max840.000
mean2498.000-2751.000=-253.000
σ0.000
min2498.000-2751.000=-253.000
max2498.000-2751.000=-253.000
mean2.846-2.840=0.006
σ0.009-0.016=-0.007
min2.836-2.823=0.013
max2.854-2.861=-0.007
policies=200
mean18126.739-18126.722=0.017
σ0.506-0.337=0.169
min18126.326-18126.491=-0.165
max18127.477-18127.222=0.255
mean8400.000
σ0.000
min8400.000
max8400.000
mean2498.000-2751.000=-253.000
σ0.000
min2498.000-2751.000=-253.000
max2498.000-2751.000=-253.000
mean28.570-28.713=-0.143
σ0.133-0.084=0.050
min28.392-28.590=-0.198
max28.703-28.775=-0.072