Compare commits

Home / Compare 58976fae .. d02ce9dd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.375=-0.001
σ0.059-0.058=0.002
min70.337-70.339=-0.002
max70.540-70.536=0.004
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.158-0.159=-0.001
σ0.004-0.004=0.000
min0.150-0.150=-0.000
max0.164-0.164=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.143-21.144=-0.001
σ0.002-0.002=-0.000
min21.139-21.140=-0.001
max21.146-21.149=-0.002
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.063-0.064=-0.001
σ0.002-0.002=-0.000
min0.058-0.062=-0.004
max0.067-0.071=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.200-1752.200=0.001
σ0.362-0.363=-0.000
min1751.634-1751.632=0.002
max1752.797-1752.787=0.010
mean1653.650-1637.750=15.900
σ646.710-617.099=29.611
min644.000-646.000=-2.000
max2855.000-2472.000=383.000
mean2.822-2.726=0.096
σ0.161-0.249=-0.088
min2.467-2.152=0.315
max3.143-3.039=0.104

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.932-269.935=-0.004
σ0.011-0.008=0.004
min269.917-269.927=-0.010
max269.944-269.946=-0.002
mean2855.000-2472.000=383.000
σ0.000
min2855.000-2472.000=383.000
max2855.000-2472.000=383.000
mean0.372-0.377=-0.005
σ0.004-0.010=-0.006
min0.370-0.369=0.001
max0.378-0.392=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1930.399-1930.384=0.015
σ0.018-0.014=0.004
min1930.372-1930.371=0.001
max1930.421-1930.403=0.018
mean2855.000-2472.000=383.000
σ0.000
min2855.000-2472.000=383.000
max2855.000-2472.000=383.000
mean2.662-2.489=0.173
σ0.200-0.115=0.085
min2.372-2.386=-0.014
max2.874-2.684=0.190
iters=5
new-facts=6402
prior-facts=1
mean4750.863-4750.820=0.043
σ0.828-0.822=0.006
min4750.376-4750.312=0.064
max4752.338-4752.274=0.064
mean2855.000-2472.000=383.000
σ0.000
min2855.000-2472.000=383.000
max2855.000-2472.000=383.000
mean8.626-8.652=-0.026
σ0.478-0.270=0.209
min7.844-8.302=-0.459
max9.069-8.925=0.144
iters=5
new-facts=6402
prior-facts=6402
mean4941.334-4941.334=0.000
σ0.084-0.084=0.001
min4941.268-4941.271=-0.003
max4941.430-4941.427=0.003
mean3109.600-2957.800=151.800
σ311.580-264.772=46.808
min2855.000-2602.000=253.000
max3582.000-3306.000=276.000
mean8.651-8.427=0.224
σ0.179-0.112=0.067
min8.476-8.323=0.154
max8.934-8.606=0.328

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.083-1.802=-0.719
σ0.269-0.085=0.184
min0.933-1.665=-0.732
max1.556-1.869=-0.313

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.994-465.979=0.016
σ575.921-575.902=0.018
min178.024-178.024=0.001
max1329.875-1329.832=0.043
mean81.750
σ7.500
min78.000
max93.000
mean2855.000-2472.000=383.000
σ0.000
min2855.000-2472.000=383.000
max2855.000-2472.000=383.000
mean0.444-0.539=-0.096
σ0.303-0.522=-0.218
min0.282-0.275=0.006
max0.898-1.322=-0.423
policies=20
mean1780.520-1780.474=0.046
σ0.359-0.359=0.001
min1780.250-1780.233=0.017
max1781.043-1781.006=0.037
mean780.000
σ0.000
min780.000
max780.000
mean2855.000-2472.000=383.000
σ0.000
min2855.000-2472.000=383.000
max2855.000-2472.000=383.000
mean2.868-2.766=0.102
σ0.023-0.012=0.011
min2.844-2.751=0.093
max2.890-2.779=0.111
policies=200
mean17811.568-17811.438=0.130
σ0.472-0.432=0.041
min17811.204-17811.130=0.075
max17812.261-17812.076=0.185
mean7800.000
σ0.000
min7800.000
max7800.000
mean2855.000-2472.000=383.000
σ0.000
min2855.000-2472.000=383.000
max2855.000-2472.000=383.000
mean28.358-27.792=0.566
σ0.516-0.075=0.441
min27.833-27.721=0.111
max28.884-27.894=0.990