Compare commits

Home / Compare 0fda44df .. dd5395c9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.263=-0.000
σ0.055-0.056=-0.001
min35.235-35.229=0.006
max35.417-35.421=-0.004
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.086-0.086=0.000
σ0.004-0.003=0.001
min0.082-0.084=-0.001
max0.094-0.093=0.001
cache=y
dps=1
iters=10
policies=100
mean23.769-23.770=-0.001
σ0.002-0.004=-0.002
min23.766-23.763=0.002
max23.772-23.777=-0.005
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.066-0.068=-0.002
σ0.003-0.002=0.001
min0.061-0.067=-0.006
max0.072-0.075=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1756.485=0.000
σ0.365-0.363=0.001
min1755.910-1755.913=-0.003
max1757.075-1757.070=0.005
mean1647.200-1652.900=-5.700
σ639.394-644.388=-4.995
min625.000-626.000=-1.000
max2823.000-2842.000=-19.000
mean2.339-2.332=0.007
σ0.063-0.092=-0.029
min2.249-2.126=0.123
max2.472-2.508=-0.036

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.713-324.705=0.008
σ0.047-0.056=-0.010
min324.631-324.605=0.026
max324.747-324.740=0.006
mean2823.000-2842.000=-19.000
σ0.000
min2823.000-2842.000=-19.000
max2823.000-2842.000=-19.000
mean0.424-0.426=-0.002
σ0.002-0.012=-0.010
min0.421-0.420=0.001
max0.426-0.447=-0.021
iters=5
new-facts=1
prior-facts=6402
mean1985.271-1985.267=0.004
σ0.006-0.011=-0.005
min1985.262-1985.248=0.015
max1985.276-1985.277=-0.001
mean2823.000-2842.000=-19.000
σ0.000
min2823.000-2842.000=-19.000
max2823.000-2842.000=-19.000
mean2.626-2.629=-0.002
σ0.091-0.211=-0.120
min2.554-2.437=0.117
max2.734-2.965=-0.231
iters=5
new-facts=6402
prior-facts=1
mean4808.774-4808.890=-0.116
σ7.736-7.637=0.098
min4804.868-4805.448=-0.581
max4822.604-4822.552=0.052
mean2823.000-2842.000=-19.000
σ0.000
min2823.000-2842.000=-19.000
max2823.000-2842.000=-19.000
mean8.951-9.033=-0.082
σ0.467-0.235=0.233
min8.383-8.645=-0.262
max9.565-9.269=0.295
iters=5
new-facts=6402
prior-facts=6402
mean4996.471-4996.325=0.146
σ0.022-0.182=-0.160
min4996.446-4996.124=0.323
max4996.495-4996.481=0.014
mean3088.200-3064.600=23.600
σ259.371-297.990=-38.619
min2823.000-2842.000=-19.000
max3341.000-3528.000=-187.000
mean8.965-8.425=0.540
σ0.490-0.173=0.317
min8.521-8.164=0.357
max9.754-8.651=1.103

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.944-0.918=0.026
σ0.053-0.011=0.042
min0.913-0.912=0.000
max1.038-0.937=0.100

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.971-462.968=0.003
σ574.247-574.248=-0.001
min175.841-175.836=0.005
max1324.342-1324.340=0.001
mean86.250
σ8.500
min82.000
max99.000
mean2823.000-2842.000=-19.000
σ0.000
min2823.000-2842.000=-19.000
max2823.000-2842.000=-19.000
mean0.431-0.430=0.001
σ0.294-0.306=-0.013
min0.281-0.262=0.019
max0.871-0.889=-0.018
policies=20
mean1758.725-1758.708=0.016
σ0.344-0.360=-0.016
min1758.500-1758.487=0.013
max1759.236-1759.245=-0.009
mean820.000
σ0.000
min820.000
max820.000
mean2823.000-2842.000=-19.000
σ0.000
min2823.000-2842.000=-19.000
max2823.000-2842.000=-19.000
mean2.798-2.779=0.019
σ0.022-0.003=0.019
min2.782-2.776=0.006
max2.831-2.783=0.047
policies=200
mean17593.156-17593.309=-0.153
σ0.840-0.633=0.207
min17591.949-17592.544=-0.595
max17593.804-17593.908=-0.104
mean8200.000
σ0.000
min8200.000
max8200.000
mean2823.000-2842.000=-19.000
σ0.000
min2823.000-2842.000=-19.000
max2823.000-2842.000=-19.000
mean27.903-27.786=0.118
σ0.361-0.374=-0.012
min27.471-27.378=0.092
max28.335-28.154=0.181