Compare commits

Home / Compare d0cfc4d5 .. 2b2395ff

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.780-70.779=0.001
σ0.053-0.052=0.001
min70.747-70.743=0.004
max70.927-70.924=0.004
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.157-0.159=-0.002
σ0.005-0.003=0.002
min0.150-0.156=-0.006
max0.164-0.164=0.000
cache=y
dps=1
iters=10
policies=100
mean21.494-21.494=0.001
σ0.002-0.003=-0.000
min21.491-21.489=0.002
max21.498-21.497=0.001
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.065-0.065=-0.000
σ0.002-0.003=-0.000
min0.064-0.064=-0.000
max0.071-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.883-1751.879=0.003
σ0.363-0.361=0.002
min1751.305-1751.306=-0.001
max1752.468-1752.455=0.013
mean1662.900-1649.200=13.700
σ624.689-623.919=0.771
min672.000
max2663.000-2695.000=-32.000
mean2.863-2.813=0.050
σ0.170-0.220=-0.050
min2.269-2.258=0.010
max3.118-3.249=-0.131

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.350-269.362=-0.012
σ0.005-0.013=-0.008
min269.344-269.346=-0.002
max269.355-269.376=-0.021
mean2663.000-2695.000=-32.000
σ0.000
min2663.000-2695.000=-32.000
max2663.000-2695.000=-32.000
mean0.378-0.378=-0.000
σ0.004-0.005=-0.001
min0.375-0.374=0.001
max0.384-0.385=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1929.758-1929.753=0.005
σ0.011-0.018=-0.007
min1929.750-1929.740=0.010
max1929.778-1929.785=-0.007
mean2663.000-2695.000=-32.000
σ0.000
min2663.000-2695.000=-32.000
max2663.000-2695.000=-32.000
mean3.026-2.969=0.057
σ0.106-0.320=-0.214
min2.897-2.469=0.428
max3.190-3.324=-0.134
iters=5
new-facts=6402
prior-facts=1
mean4750.361-4750.494=-0.133
σ0.968-0.838=0.131
min4749.529-4750.029=-0.499
max4752.039-4751.987=0.052
mean2663.000-2695.000=-32.000
σ0.000
min2663.000-2695.000=-32.000
max2663.000-2695.000=-32.000
mean8.641-8.449=0.192
σ0.399-0.500=-0.101
min7.991-7.756=0.236
max9.055-8.968=0.087
iters=5
new-facts=6402
prior-facts=6402
mean4940.985-4940.989=-0.004
σ0.018-0.012=0.006
min4940.964-4940.974=-0.011
max4941.002-4941.004=-0.002
mean3018.000-3030.000=-12.000
σ265.855-286.497=-20.642
min2663.000-2695.000=-32.000
max3323.000-3414.000=-91.000
mean8.508-8.547=-0.038
σ0.142-0.174=-0.032
min8.343-8.360=-0.016
max8.689-8.771=-0.082

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.132-1.070=0.062
σ0.315-0.140=0.175
min0.923-0.932=-0.009
max1.639-1.241=0.398

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.062-466.060=0.002
σ574.941-574.941=-0.000
min178.588-178.583=0.005
max1328.473-1328.471=0.001
mean86.250
σ8.500
min82.000
max99.000
mean2663.000-2695.000=-32.000
σ0.000
min2663.000-2695.000=-32.000
max2663.000-2695.000=-32.000
mean0.557-0.569=-0.012
σ0.557-0.584=-0.027
min0.275-0.275=-0.000
max1.392-1.444=-0.052
policies=20
mean1786.140-1786.123=0.018
σ0.364-0.367=-0.003
min1785.918-1785.891=0.027
max1786.685-1786.671=0.013
mean820.000
σ0.000
min820.000
max820.000
mean2663.000-2695.000=-32.000
σ0.000
min2663.000-2695.000=-32.000
max2663.000-2695.000=-32.000
mean2.785-2.768=0.017
σ0.014-0.009=0.005
min2.766-2.760=0.006
max2.796-2.777=0.019
policies=200
mean17868.488-17868.460=0.028
σ0.456-0.529=-0.073
min17868.248-17868.158=0.090
max17869.172-17869.252=-0.080
mean8200.000
σ0.000
min8200.000
max8200.000
mean2663.000-2695.000=-32.000
σ0.000
min2663.000-2695.000=-32.000
max2663.000-2695.000=-32.000
mean28.004-27.917=0.087
σ0.210-0.099=0.111
min27.808-27.795=0.014
max28.249-28.027=0.223