Compare commits

Home / Compare a68909ba .. 8db18346

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.778-70.780=-0.002
σ0.053-0.052=0.001
min70.752-70.750=0.002
max70.928-70.926=0.002
mean410.000-412.000=-2.000
σ0.000
min410.000-412.000=-2.000
max410.000-412.000=-2.000
mean0.153-0.158=-0.005
σ0.006-0.005=0.001
min0.147-0.150=-0.003
max0.163-0.163=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.495-21.493=0.002
σ0.003-0.001=0.001
min21.491-21.491=0.000
max21.499-21.496=0.004
mean410.000-412.000=-2.000
σ0.000
min410.000-412.000=-2.000
max410.000-412.000=-2.000
mean0.064-0.063=0.001
σ0.002-0.003=-0.001
min0.059-0.060=-0.001
max0.068-0.071=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.882-1751.881=0.001
σ0.360-0.360=-0.001
min1751.306-1751.316=-0.010
max1752.453-1752.462=-0.010
mean1659.900-1663.850=-3.950
σ635.507-627.695=7.812
min670.000-650.000=20.000
max2699.000-2510.000=189.000
mean2.844-2.830=0.014
σ0.111-0.170=-0.059
min2.597-2.342=0.255
max3.047-3.225=-0.178

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.376-269.375=0.001
σ0.003-0.004=-0.001
min269.373-269.371=0.002
max269.380-269.381=-0.000
mean2699.000-2510.000=189.000
σ0.000
min2699.000-2510.000=189.000
max2699.000-2510.000=189.000
mean0.378-0.378=0.000
σ0.004-0.005=-0.001
min0.374-0.374=-0.000
max0.385-0.387=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1929.745-1929.751=-0.005
σ0.012-0.020=-0.008
min1929.733-1929.723=0.011
max1929.763-1929.779=-0.015
mean2699.000-2510.000=189.000
σ0.000
min2699.000-2510.000=189.000
max2699.000-2510.000=189.000
mean3.147-2.895=0.252
σ0.140-0.272=-0.131
min3.016-2.467=0.549
max3.362-3.153=0.209
iters=5
new-facts=6402
prior-facts=1
mean4750.460-4750.530=-0.071
σ0.906-0.852=0.054
min4749.590-4750.078=-0.487
max4751.997-4752.049=-0.052
mean2699.000-2510.000=189.000
σ0.000
min2699.000-2510.000=189.000
max2699.000-2510.000=189.000
mean8.388-8.456=-0.069
σ0.421-0.465=-0.043
min7.969-7.645=0.324
max8.981-8.772=0.209
iters=5
new-facts=6402
prior-facts=6402
mean4940.985-4940.913=0.073
σ0.015-0.149=-0.134
min4940.968-4940.646=0.322
max4941.000-4940.994=0.006
mean3006.800-2923.200=83.600
σ342.347-366.425=-24.078
min2699.000-2510.000=189.000
max3517.000-3428.000=89.000
mean8.403-8.356=0.048
σ0.079-0.058=0.021
min8.330-8.291=0.039
max8.510-8.444=0.065

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.159-1.714=-0.555
σ0.231-0.267=-0.036
min0.934-1.240=-0.306
max1.538-1.885=-0.347

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.064-466.056=0.008
σ574.947-574.931=0.017
min178.587-178.588=-0.000
max1328.485-1328.452=0.033
mean86.250
σ8.500
min82.000
max99.000
mean2699.000-2510.000=189.000
σ0.000
min2699.000-2510.000=189.000
max2699.000-2510.000=189.000
mean0.556-0.549=0.007
σ0.551-0.533=0.018
min0.278-0.280=-0.002
max1.382-1.348=0.034
policies=20
mean1786.128-1786.136=-0.008
σ0.362-0.373=-0.011
min1785.890-1785.904=-0.014
max1786.668-1786.694=-0.025
mean820.000
σ0.000
min820.000
max820.000
mean2699.000-2510.000=189.000
σ0.000
min2699.000-2510.000=189.000
max2699.000-2510.000=189.000
mean2.762-2.774=-0.012
σ0.010-0.033=-0.022
min2.750-2.749=0.001
max2.773-2.823=-0.050
policies=200
mean17868.376-17868.396=-0.020
σ0.447-0.436=0.012
min17867.986-17868.082=-0.096
max17869.020-17869.037=-0.017
mean8200.000
σ0.000
min8200.000
max8200.000
mean2699.000-2510.000=189.000
σ0.000
min2699.000-2510.000=189.000
max2699.000-2510.000=189.000
mean27.931-27.830=0.101
σ0.063-0.024=0.039
min27.865-27.798=0.066
max28.014-27.856=0.158