Compare commits

Home / Compare 32492fea .. 1e581caa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.389-70.379=0.010
σ0.047-0.049=-0.002
min70.362-70.352=0.010
max70.521-70.516=0.005
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.160-0.153=0.007
σ0.004-0.003=0.001
min0.156-0.150=0.006
max0.167-0.159=0.008
cache=y
dps=1
iters=10
policies=100
mean21.145-21.144=0.001
σ0.003-0.001=0.002
min21.141-21.141=-0.000
max21.151-21.145=0.006
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.064-0.064=-0.000
σ0.003-0.003=0.000
min0.059-0.063=-0.004
max0.071-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.387=0.007
σ0.360-0.360=0.000
min1751.824-1751.820=0.004
max1752.976-1752.952=0.024
mean1655.900-1654.500=1.400
σ617.018-645.332=-28.314
min636.000-632.000=4.000
max2495.000-2850.000=-355.000
mean2.830-2.815=0.015
σ0.119-0.162=-0.043
min2.567-2.299=0.268
max2.989-3.075=-0.086

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.145-270.127=0.018
σ0.007-0.001=0.005
min270.134-270.126=0.008
max270.152-270.129=0.023
mean2495.000-2850.000=-355.000
σ0.000
min2495.000-2850.000=-355.000
max2495.000-2850.000=-355.000
mean0.379-0.373=0.006
σ0.002-0.004=-0.002
min0.377-0.370=0.007
max0.381-0.379=0.002
iters=5
new-facts=1
prior-facts=6402
mean1930.609-1930.584=0.025
σ0.012-0.019=-0.007
min1930.597-1930.563=0.034
max1930.625-1930.608=0.017
mean2495.000-2850.000=-355.000
σ0.000
min2495.000-2850.000=-355.000
max2495.000-2850.000=-355.000
mean2.521-2.544=-0.023
σ0.074-0.116=-0.043
min2.458-2.451=0.007
max2.612-2.738=-0.126
iters=5
new-facts=6402
prior-facts=1
mean4751.311-4751.129=0.182
σ0.928-0.783=0.145
min4750.789-4750.652=0.137
max4752.958-4752.520=0.437
mean2495.000-2850.000=-355.000
σ0.000
min2495.000-2850.000=-355.000
max2495.000-2850.000=-355.000
mean8.593-8.092=0.501
σ0.464-0.382=0.082
min7.965-7.650=0.315
max9.026-8.476=0.550
iters=5
new-facts=6402
prior-facts=6402
mean4941.563-4941.456=0.107
σ0.186-0.201=-0.015
min4941.411-4941.120=0.291
max4941.773-4941.619=0.154
mean3013.800-3060.600=-46.800
σ259.093-270.281=-11.188
min2629.000-2850.000=-221.000
max3321.000-3475.000=-154.000
mean8.545-8.374=0.171
σ0.134-0.132=0.002
min8.430-8.256=0.174
max8.777-8.586=0.190

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.666-1.077=0.589
σ0.148-0.113=0.035
min1.444-0.936=0.508
max1.795-1.254=0.542

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.367-466.363=0.004
σ575.927-575.922=0.005
min178.400-178.386=0.014
max1330.257-1330.246=0.011
mean84.000
σ8.000
min80.000
max96.000
mean2495.000-2850.000=-355.000
σ0.000
min2495.000-2850.000=-355.000
max2495.000-2850.000=-355.000
mean0.556-0.441=0.115
σ0.542-0.310=0.232
min0.283-0.284=-0.001
max1.368-0.906=0.463
policies=20
mean1784.298-1784.247=0.051
σ0.351-0.359=-0.008
min1784.070-1784.006=0.064
max1784.820-1784.778=0.042
mean800.000
σ0.000
min800.000
max800.000
mean2495.000-2850.000=-355.000
σ0.000
min2495.000-2850.000=-355.000
max2495.000-2850.000=-355.000
mean2.784-2.852=-0.067
σ0.022-0.022=-0.000
min2.767-2.835=-0.068
max2.814-2.882=-0.068
policies=200
mean17849.891-17848.931=0.960
σ0.530-0.492=0.039
min17849.555-17848.615=0.941
max17850.683-17849.665=1.018
mean8000.000
σ0.000
min8000.000
max8000.000
mean2495.000-2850.000=-355.000
σ0.000
min2495.000-2850.000=-355.000
max2495.000-2850.000=-355.000
mean27.886-28.324=-0.438
σ0.138-0.487=-0.349
min27.766-27.733=0.033
max28.026-28.729=-0.703