Compare commits

Home / Compare ba8690a5 .. b2dd35a5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.703-70.702=0.000
σ0.048-0.047=0.001
min70.667-70.672=-0.005
max70.835-70.832=0.003
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.162-0.161=0.001
σ0.004-0.005=-0.001
min0.159-0.157=0.002
max0.170-0.170=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.409-21.409=-0.000
σ0.003-0.002=0.000
min21.404-21.405=-0.001
max21.412-21.412=0.000
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.065-0.066=-0.000
σ0.003-0.003=0.000
min0.061-0.064=-0.003
max0.073-0.074=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.930-1754.929=0.001
σ0.360-0.360=0.000
min1754.369-1754.358=0.012
max1755.513-1755.502=0.011
mean1651.250-1662.800=-11.550
σ633.106-620.954=12.151
min613.000-621.000=-8.000
max2871.000-2504.000=367.000
mean2.887-2.786=0.101
σ0.179-0.142=0.038
min2.563-2.463=0.100
max3.402-2.973=0.429

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.752-272.750=0.003
σ0.005-0.017=-0.012
min272.743-272.720=0.023
max272.756-272.762=-0.006
mean2871.000-2504.000=367.000
σ0.000
min2871.000-2504.000=367.000
max2871.000-2504.000=367.000
mean0.383-0.382=0.001
σ0.006-0.004=0.002
min0.378-0.380=-0.002
max0.393-0.389=0.003
iters=5
new-facts=1
prior-facts=6402
mean1933.161-1933.162=-0.002
σ0.008-0.010=-0.003
min1933.150-1933.147=0.003
max1933.169-1933.174=-0.005
mean2871.000-2504.000=367.000
σ0.000
min2871.000-2504.000=367.000
max2871.000-2504.000=367.000
mean3.193-3.122=0.071
σ0.179-0.087=0.093
min3.008-3.013=-0.005
max3.476-3.207=0.269
iters=5
new-facts=6402
prior-facts=1
mean4756.997-4757.011=-0.014
σ7.553-7.594=-0.041
min4753.520-4753.421=0.099
max4770.508-4770.595=-0.087
mean2871.000-2504.000=367.000
σ0.000
min2871.000-2504.000=367.000
max2871.000-2504.000=367.000
mean8.128-8.036=0.093
σ0.358-0.540=-0.182
min7.752-7.698=0.054
max8.615-8.992=-0.377
iters=5
new-facts=6402
prior-facts=6402
mean4944.399-4944.402=-0.003
σ0.020-0.016=0.004
min4944.373-4944.383=-0.011
max4944.418-4944.415=0.003
mean3044.000-2945.400=98.600
σ250.571-392.293=-141.722
min2871.000-2504.000=367.000
max3439.000-3478.000=-39.000
mean8.586-8.524=0.062
σ0.112-0.152=-0.040
min8.448-8.365=0.082
max8.681-8.690=-0.009

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.080-1.489=-0.409
σ0.224-0.352=-0.129
min0.915-0.923=-0.008
max1.462-1.761=-0.299

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.349-468.319=0.029
σ574.269-574.262=0.007
min181.204-181.186=0.018
max1329.753-1329.712=0.041
mean88.250
σ8.500
min84.000
max101.000
mean2871.000-2504.000=367.000
σ0.000
min2871.000-2504.000=367.000
max2871.000-2504.000=367.000
mean0.445-0.565=-0.121
σ0.296-0.567=-0.271
min0.290-0.279=0.011
max0.888-1.416=-0.528
policies=20
mean1812.369-1812.148=0.221
σ0.392-0.366=0.026
min1812.089-1811.935=0.154
max1812.944-1812.694=0.250
mean840.000
σ0.000
min840.000
max840.000
mean2871.000-2504.000=367.000
σ0.000
min2871.000-2504.000=367.000
max2871.000-2504.000=367.000
mean2.881-2.813=0.067
σ0.008-0.035=-0.027
min2.873-2.770=0.103
max2.887-2.854=0.033
policies=200
mean18129.747-18128.932=0.814
σ0.728-0.594=0.134
min18128.838-18128.546=0.293
max18130.495-18129.800=0.696
mean8400.000
σ0.000
min8400.000
max8400.000
mean2871.000-2504.000=367.000
σ0.000
min2871.000-2504.000=367.000
max2871.000-2504.000=367.000
mean28.818-28.323=0.494
σ0.404-0.122=0.282
min28.427-28.174=0.253
max29.234-28.469=0.765