Compare commits

Home / Compare c7f695f0 .. 22557edb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.617=0.001
σ0.055-0.056=-0.001
min35.589-35.585=0.004
max35.773-35.775=-0.002
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.086-0.086=-0.001
σ0.003-0.004=-0.001
min0.083-0.083=-0.000
max0.091-0.093=-0.002
cache=y
dps=1
iters=10
policies=100
mean24.048-24.047=0.001
σ0.004-0.003=0.002
min24.042-24.043=-0.001
max24.056-24.053=0.003
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.070-0.068=0.002
σ0.004-0.002=0.002
min0.066-0.066=0.000
max0.076-0.073=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.490=0.001
σ0.365-0.364=0.001
min1755.916-1755.914=0.002
max1757.079-1757.075=0.004
mean1646.450-1639.600=6.850
σ640.653-604.977=35.676
min631.000-659.000=-28.000
max2825.000-2452.000=373.000
mean2.360-2.368=-0.008
σ0.069-0.111=-0.042
min2.271-2.208=0.063
max2.490-2.752=-0.262

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.767-324.766=0.001
σ0.046-0.043=0.003
min324.685-324.690=-0.005
max324.796-324.794=0.003
mean2825.000-2452.000=373.000
σ0.000
min2825.000-2452.000=373.000
max2825.000-2452.000=373.000
mean0.418-0.430=-0.011
σ0.002-0.009=-0.007
min0.416-0.422=-0.005
max0.421-0.441=-0.020
iters=5
new-facts=1
prior-facts=6402
mean1985.309-1985.318=-0.009
σ0.022-0.014=0.008
min1985.282-1985.302=-0.020
max1985.334-1985.333=0.001
mean2825.000-2452.000=373.000
σ0.000
min2825.000-2452.000=373.000
max2825.000-2452.000=373.000
mean2.648-2.686=-0.038
σ0.136-0.116=0.020
min2.549-2.572=-0.023
max2.879-2.818=0.062
iters=5
new-facts=6402
prior-facts=1
mean4809.090-4809.072=0.018
σ7.701-7.661=0.040
min4805.609-4805.605=0.004
max4822.867-4822.777=0.090
mean2825.000-2452.000=373.000
σ0.000
min2825.000-2452.000=373.000
max2825.000-2452.000=373.000
mean8.765-8.699=0.066
σ0.585-0.129=0.457
min7.746-8.526=-0.780
max9.210-8.869=0.341
iters=5
new-facts=6402
prior-facts=6402
mean4996.624-4996.567=0.057
σ0.017-0.148=-0.130
min4996.606-4996.307=0.299
max4996.648-4996.660=-0.012
mean3061.400-2996.400=65.000
σ307.123-371.884=-64.761
min2825.000-2522.000=303.000
max3531.000-3355.000=176.000
mean8.680-8.792=-0.112
σ0.366-0.176=0.190
min8.454-8.623=-0.170
max9.309-9.088=0.221

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.947-1.822=-0.875
σ0.054-0.057=-0.002
min0.910-1.737=-0.827
max1.042-1.884=-0.842

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.207-463.200=0.007
σ574.775-574.759=0.016
min175.810-175.818=-0.008
max1325.369-1325.338=0.031
mean86.250
σ8.500
min82.000
max99.000
mean2825.000-2452.000=373.000
σ0.000
min2825.000-2452.000=373.000
max2825.000-2452.000=373.000
mean0.430-0.548=-0.118
σ0.292-0.543=-0.252
min0.282-0.274=0.008
max0.868-1.363=-0.495
policies=20
mean1758.501-1758.487=0.014
σ0.361-0.339=0.022
min1758.248-1758.264=-0.016
max1759.033-1758.990=0.044
mean820.000
σ0.000
min820.000
max820.000
mean2825.000-2452.000=373.000
σ0.000
min2825.000-2452.000=373.000
max2825.000-2452.000=373.000
mean2.809-2.722=0.087
σ0.019-0.014=0.004
min2.795-2.703=0.092
max2.835-2.734=0.102
policies=200
mean17592.066-17592.001=0.065
σ0.521-0.493=0.028
min17591.788-17591.667=0.121
max17592.847-17592.712=0.135
mean8200.000
σ0.000
min8200.000
max8200.000
mean2825.000-2452.000=373.000
σ0.000
min2825.000-2452.000=373.000
max2825.000-2452.000=373.000
mean27.874-27.354=0.520
σ0.539-0.076=0.463
min27.347-27.283=0.063
max28.465-27.423=1.042