Compare commits

Home / Compare 777e40ca .. ee0a5cd1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.913=0.001
σ0.367-0.366=0.001
min53.777-53.777=-0.000
max54.959-54.954=0.004
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.137-0.135=0.002
σ0.004-0.005=-0.001
min0.134-0.128=0.005
max0.144-0.143=0.001
cache=y
dps=1
iters=10
policies=100
mean43.142-43.144=-0.002
σ0.007-0.013=-0.006
min43.130-43.128=0.002
max43.153-43.174=-0.020
mean414.400-413.000=1.400
σ0.516-0.000=0.516
min414.000-413.000=1.000
max415.000-413.000=2.000
mean0.121-0.121=0.000
σ0.004-0.004=0.000
min0.113-0.113=0.000
max0.126-0.126=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.812-991.810=0.002
σ1.243-1.266=-0.023
min991.237-991.249=-0.012
max997.038-997.141=-0.103
mean1080.300-1065.950=14.350
σ319.141-322.618=-3.477
min602.000-572.000=30.000
max1631.000-1630.000=1.000
mean1.523-1.523=0.000
σ0.081-0.076=0.005
min1.389-1.388=0.001
max1.778-1.749=0.029

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.412-285.408=0.004
σ0.010-0.011=-0.001
min285.394-285.390=0.004
max285.420-285.418=0.002
mean1631.000-1630.000=1.000
σ0.000
min1631.000-1630.000=1.000
max1631.000-1630.000=1.000
mean0.376-0.371=0.005
σ0.006-0.006=-0.000
min0.373-0.368=0.005
max0.387-0.382=0.005
iters=5
new-facts=1
prior-facts=6402
mean1285.353-1285.378=-0.024
σ0.085-0.131=-0.046
min1285.307-1285.313=-0.005
max1285.506-1285.612=-0.106
mean1631.000-1630.000=1.000
σ0.000
min1631.000-1630.000=1.000
max1631.000-1630.000=1.000
mean1.872-1.892=-0.020
σ0.079-0.133=-0.053
min1.779-1.791=-0.012
max1.992-2.121=-0.129
iters=5
new-facts=6402
prior-facts=1
mean1807.719-1807.688=0.030
σ6.987-7.001=-0.014
min1804.357-1804.326=0.031
max1820.203-1820.198=0.005
mean1631.000-1630.000=1.000
σ0.000
min1631.000-1630.000=1.000
max1631.000-1630.000=1.000
mean4.251-4.129=0.122
σ0.293-0.238=0.055
min3.856-3.845=0.010
max4.670-4.381=0.289
iters=5
new-facts=6402
prior-facts=6402
mean2070.192-2070.204=-0.012
σ0.003-0.017=-0.014
min2070.187-2070.188=-0.002
max2070.194-2070.231=-0.037
mean1849.000-1862.800=-13.800
σ178.192-196.827=-18.634
min1631.000-1630.000=1.000
max2095.000-2078.000=17.000
mean4.454-4.642=-0.188
σ0.048-0.245=-0.197
min4.418-4.421=-0.003
max4.531-5.040=-0.509

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.211-1.183=0.028
σ0.337-0.318=0.019
min0.905-0.907=-0.002
max1.778-1.718=0.060

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.787-436.780=0.007
σ572.359-572.354=0.004
min150.598-150.596=0.002
max1295.325-1295.312=0.013
mean90.250
σ8.500
min86.000
max103.000
mean1631.000-1630.000=1.000
σ0.000
min1631.000-1630.000=1.000
max1631.000-1630.000=1.000
mean0.523-0.501=0.021
σ0.537-0.502=0.035
min0.253-0.249=0.004
max1.328-1.255=0.074
policies=20
mean1506.279-1506.263=0.016
σ0.246-0.228=0.018
min1506.121-1506.110=0.011
max1506.646-1506.603=0.044
mean860.000
σ0.000
min860.000
max860.000
mean1631.000-1630.000=1.000
σ0.000
min1631.000-1630.000=1.000
max1631.000-1630.000=1.000
mean2.520-2.509=0.011
σ0.025-0.010=0.014
min2.486-2.501=-0.015
max2.545-2.524=0.021
policies=200
mean15070.285-15070.295=-0.011
σ0.273-0.073=0.200
min15069.879-15070.247=-0.369
max15070.464-15070.404=0.061
mean8600.000
σ0.000
min8600.000
max8600.000
mean1631.000-1630.000=1.000
σ0.000
min1631.000-1630.000=1.000
max1631.000-1630.000=1.000
mean25.457-25.503=-0.046
σ0.109-0.134=-0.025
min25.351-25.312=0.040
max25.554-25.618=-0.065