Compare commits

Home / Compare 86c62e19 .. 7ba077f0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.374=0.001
σ0.058-0.059=-0.001
min70.338-70.335=0.003
max70.535-70.538=-0.003
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.158-0.157=0.001
σ0.004-0.006=-0.002
min0.148-0.149=-0.002
max0.163-0.167=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.144-21.142=0.001
σ0.002-0.002=-0.001
min21.140-21.139=0.001
max21.146-21.147=-0.001
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.063-0.062=0.001
σ0.002-0.005=-0.003
min0.058-0.058=-0.001
max0.066-0.071=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.199-1752.198=0.002
σ0.361-0.359=0.001
min1751.624-1751.627=-0.003
max1752.766-1752.785=-0.019
mean1649.950-1639.450=10.500
σ642.240-614.146=28.094
min629.000-635.000=-6.000
max2847.000-2470.000=377.000
mean2.835-2.777=0.059
σ0.123-0.161=-0.037
min2.517-2.385=0.132
max3.011-2.997=0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.934-269.931=0.003
σ0.007-0.008=-0.001
min269.924-269.918=0.006
max269.940-269.939=0.001
mean2847.000-2470.000=377.000
σ0.000
min2847.000-2470.000=377.000
max2847.000-2470.000=377.000
mean0.379-0.372=0.007
σ0.005-0.005=0.000
min0.374-0.367=0.007
max0.388-0.379=0.009
iters=5
new-facts=1
prior-facts=6402
mean1930.385-1930.397=-0.012
σ0.012-0.012=-0.000
min1930.366-1930.376=-0.010
max1930.397-1930.405=-0.008
mean2847.000-2470.000=377.000
σ0.000
min2847.000-2470.000=377.000
max2847.000-2470.000=377.000
mean2.594-2.495=0.100
σ0.149-0.055=0.093
min2.426-2.436=-0.010
max2.814-2.551=0.263
iters=5
new-facts=6402
prior-facts=1
mean4750.863-4750.931=-0.068
σ0.882-0.748=0.134
min4750.346-4750.520=-0.173
max4752.433-4752.262=0.171
mean2847.000-2470.000=377.000
σ0.000
min2847.000-2470.000=377.000
max2847.000-2470.000=377.000
mean8.561-7.934=0.627
σ0.563-0.309=0.254
min7.623-7.679=-0.056
max9.085-8.434=0.651
iters=5
new-facts=6402
prior-facts=6402
mean4941.265-4941.330=-0.066
σ0.202-0.077=0.125
min4940.935-4941.262=-0.327
max4941.431-4941.418=0.013
mean3077.800-2951.800=126.000
σ248.987-417.666=-168.679
min2847.000-2470.000=377.000
max3340.000-3514.000=-174.000
mean8.761-8.540=0.221
σ0.231-0.260=-0.029
min8.513-8.301=0.213
max9.058-8.935=0.123

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.042-1.845=-0.803
σ0.125-0.115=0.010
min0.929-1.652=-0.723
max1.235-1.938=-0.703

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.908-465.899=0.009
σ575.758-575.759=-0.000
min178.026-178.017=0.009
max1329.546-1329.537=0.009
mean81.750
σ7.500
min78.000
max93.000
mean2847.000-2470.000=377.000
σ0.000
min2847.000-2470.000=377.000
max2847.000-2470.000=377.000
mean0.440-0.552=-0.113
σ0.301-0.543=-0.241
min0.285-0.279=0.007
max0.892-1.366=-0.475
policies=20
mean1780.466-1780.423=0.043
σ0.350-0.356=-0.007
min1780.201-1780.182=0.019
max1780.975-1780.952=0.024
mean780.000
σ0.000
min780.000
max780.000
mean2847.000-2470.000=377.000
σ0.000
min2847.000-2470.000=377.000
max2847.000-2470.000=377.000
mean2.846-2.750=0.096
σ0.006-0.007=-0.001
min2.838-2.742=0.096
max2.851-2.756=0.095
policies=200
mean17811.308-17811.201=0.107
σ0.480-0.400=0.081
min17811.010-17810.891=0.119
max17812.022-17811.787=0.235
mean7800.000
σ0.000
min7800.000
max7800.000
mean2847.000-2470.000=377.000
σ0.000
min2847.000-2470.000=377.000
max2847.000-2470.000=377.000
mean28.247-27.784=0.462
σ0.506-0.081=0.425
min27.807-27.698=0.109
max28.718-27.891=0.827