Compare commits

Home / Compare af6ad537 .. faf8313b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.041-31.040=0.001
σ0.049-0.051=-0.002
min31.005-31.001=0.004
max31.179-31.183=-0.005
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.079-0.077=0.002
σ0.003-0.005=-0.002
min0.076-0.072=0.005
max0.085-0.087=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.000
σ0.002-0.003=-0.001
min21.140-21.141=-0.000
max21.147-21.147=-0.001
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.064-0.065=-0.001
σ0.002-0.003=-0.001
min0.062-0.063=-0.000
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.410-1751.411=-0.002
σ0.366-0.361=0.005
min1750.846-1750.844=0.002
max1751.997-1752.006=-0.009
mean1652.900-1652.200=0.700
σ623.933-622.833=1.100
min675.000-682.000=-7.000
max2654.000-2650.000=4.000
mean2.819-2.870=-0.051
σ0.165-0.126=0.039
min2.324-2.622=-0.298
max3.021-3.042=-0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.779-266.779=0.000
σ0.007-0.007=-0.000
min266.767-266.768=-0.001
max266.783-266.786=-0.003
mean2654.000-2650.000=4.000
σ0.000
min2654.000-2650.000=4.000
max2654.000-2650.000=4.000
mean0.363-0.365=-0.002
σ0.001-0.001=-0.000
min0.362-0.364=-0.002
max0.364-0.367=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1927.210-1927.207=0.003
σ0.008-0.009=-0.001
min1927.201-1927.195=0.006
max1927.220-1927.221=-0.001
mean2654.000-2650.000=4.000
σ0.000
min2654.000-2650.000=4.000
max2654.000-2650.000=4.000
mean3.019-3.069=-0.050
σ0.061-0.078=-0.017
min2.954-2.999=-0.045
max3.093-3.177=-0.083
iters=5
new-facts=6402
prior-facts=1
mean4747.642-4747.749=-0.107
σ0.949-0.776=0.174
min4746.747-4747.289=-0.542
max4749.251-4749.126=0.125
mean2654.000-2650.000=4.000
σ0.000
min2654.000-2650.000=4.000
max2654.000-2650.000=4.000
mean8.303-8.194=0.110
σ0.524-0.373=0.151
min7.698-7.851=-0.153
max9.090-8.773=0.317
iters=5
new-facts=6402
prior-facts=6402
mean4938.089-4938.164=-0.075
σ0.118-0.089=0.029
min4937.916-4938.072=-0.156
max4938.249-4938.272=-0.023
mean3009.000-2972.600=36.400
σ391.304-344.106=47.198
min2654.000-2650.000=4.000
max3573.000-3433.000=140.000
mean8.478-8.486=-0.009
σ0.179-0.217=-0.038
min8.239-8.266=-0.027
max8.667-8.820=-0.154

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.217-1.073=0.145
σ0.323-0.191=0.131
min0.946-0.937=0.009
max1.763-1.343=0.420

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.120-465.124=-0.004
σ575.768-575.764=0.004
min177.231-177.233=-0.003
max1328.772-1328.770=0.002
mean79.750
σ7.500
min76.000
max91.000
mean2654.000-2650.000=4.000
σ0.000
min2654.000-2650.000=4.000
max2654.000-2650.000=4.000
mean0.560-0.575=-0.015
σ0.554-0.592=-0.038
min0.281-0.277=0.004
max1.391-1.464=-0.073
policies=20
mean1772.580-1772.590=-0.010
σ0.333-0.329=0.004
min1772.375-1772.365=0.009
max1773.076-1773.078=-0.002
mean760.000
σ0.000
min760.000
max760.000
mean2654.000-2650.000=4.000
σ0.000
min2654.000-2650.000=4.000
max2654.000-2650.000=4.000
mean2.758-2.757=0.001
σ0.022-0.017=0.004
min2.740-2.738=0.002
max2.786-2.780=0.007
policies=200
mean17732.425-17732.490=-0.065
σ0.438-0.411=0.027
min17732.078-17732.260=-0.182
max17733.066-17733.106=-0.040
mean7600.000
σ0.000
min7600.000
max7600.000
mean2654.000-2650.000=4.000
σ0.000
min2654.000-2650.000=4.000
max2654.000-2650.000=4.000
mean27.741-27.788=-0.047
σ0.187-0.132=0.056
min27.593-27.690=-0.097
max28.014-27.981=0.033