Compare commits

Home / Compare 609a8e22 .. c62bed62

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.707-70.708=-0.001
σ0.047-0.045=0.002
min70.674-70.683=-0.009
max70.836-70.833=0.003
mean416.800-415.600=1.200
σ0.422-0.516=-0.095
min416.000-415.000=1.000
max417.000-416.000=1.000
mean0.161-0.159=0.001
σ0.004-0.004=0.000
min0.157-0.151=0.006
max0.167-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.410-21.412=-0.002
σ0.002-0.002=0.000
min21.407-21.409=-0.002
max21.414-21.415=-0.001
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.063-0.063=0.000
σ0.003-0.003=0.000
min0.059-0.059=0.001
max0.069-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.932-1754.931=0.001
σ0.361-0.359=0.002
min1754.361-1754.363=-0.002
max1755.518-1755.513=0.005
mean1662.900-1663.650=-0.750
σ618.673-619.848=-1.175
min627.000
max2510.000-2511.000=-1.000
mean2.781-2.814=-0.033
σ0.193-0.128=0.066
min2.293-2.415=-0.123
max2.997-2.975=0.022

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.792-272.795=-0.004
σ0.008-0.005=0.003
min272.780-272.790=-0.010
max272.801-272.803=-0.002
mean2510.000-2511.000=-1.000
σ0.000
min2510.000-2511.000=-1.000
max2510.000-2511.000=-1.000
mean0.383-0.388=-0.004
σ0.007-0.012=-0.004
min0.377-0.377=0.000
max0.396-0.402=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1933.228-1933.220=0.008
σ0.011-0.013=-0.002
min1933.212-1933.207=0.006
max1933.240-1933.236=0.004
mean2510.000-2511.000=-1.000
σ0.000
min2510.000-2511.000=-1.000
max2510.000-2511.000=-1.000
mean3.008-2.876=0.132
σ0.158-0.159=-0.001
min2.752-2.635=0.118
max3.174-3.030=0.144
iters=5
new-facts=6402
prior-facts=1
mean4756.903-4756.948=-0.045
σ7.605-7.569=0.036
min4753.131-4753.490=-0.359
max4770.502-4770.487=0.015
mean2510.000-2511.000=-1.000
σ0.000
min2510.000-2511.000=-1.000
max2510.000-2511.000=-1.000
mean8.343-8.599=-0.257
σ0.371-0.273=0.097
min7.852-8.275=-0.423
max8.624-8.895=-0.271
iters=5
new-facts=6402
prior-facts=6402
mean4944.455-4944.456=-0.001
σ0.020-0.017=0.003
min4944.435-4944.438=-0.003
max4944.480-4944.474=0.006
mean2992.000-2943.200=48.800
σ276.878-302.621=-25.743
min2618.000-2511.000=107.000
max3328.000-3316.000=12.000
mean8.560-8.467=0.094
σ0.172-0.145=0.027
min8.359-8.370=-0.011
max8.787-8.715=0.072

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.606-1.555=0.051
σ0.189-0.225=-0.036
min1.329-1.272=0.057
max1.842-1.780=0.062

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.307-468.303=0.003
σ574.228-574.232=-0.004
min181.184-181.183=0.001
max1329.649-1329.651=-0.002
mean88.250
σ8.500
min84.000
max101.000
mean2510.000-2511.000=-1.000
σ0.000
min2510.000-2511.000=-1.000
max2510.000-2511.000=-1.000
mean0.568-0.573=-0.005
σ0.566-0.576=-0.010
min0.283-0.283=-0.001
max1.416-1.436=-0.020
policies=20
mean1812.152-1812.158=-0.007
σ0.370-0.384=-0.014
min1811.919-1811.901=0.018
max1812.702-1812.727=-0.025
mean840.000
σ0.000
min840.000
max840.000
mean2510.000-2511.000=-1.000
σ0.000
min2510.000-2511.000=-1.000
max2510.000-2511.000=-1.000
mean2.822-2.812=0.009
σ0.004-0.015=-0.012
min2.819-2.797=0.022
max2.827-2.827=-0.000
policies=200
mean18129.032-18129.088=-0.057
σ0.615-0.517=0.098
min18128.608-18128.686=-0.078
max18129.922-18129.845=0.076
mean8400.000
σ0.000
min8400.000
max8400.000
mean2510.000-2511.000=-1.000
σ0.000
min2510.000-2511.000=-1.000
max2510.000-2511.000=-1.000
mean28.394-28.416=-0.022
σ0.073-0.151=-0.078
min28.319-28.278=0.041
max28.476-28.609=-0.133