Compare commits

Home / Compare dfea0b1b .. 9c66b779

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.914=0.000
σ0.364-0.367=-0.003
min53.782-53.777=0.005
max54.950-54.959=-0.008
mean414.300-414.000=0.300
σ0.483-0.000=0.483
min414.000
max415.000-414.000=1.000
mean0.136-0.137=-0.002
σ0.004-0.004=0.000
min0.130-0.134=-0.004
max0.142-0.144=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.144-43.142=0.002
σ0.013-0.007=0.006
min43.130-43.130=0.000
max43.177-43.153=0.024
mean415.000-414.400=0.600
σ0.000-0.516=-0.516
min415.000-414.000=1.000
max415.000
mean0.121-0.121=0.001
σ0.005-0.004=0.000
min0.118-0.113=0.005
max0.131-0.126=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.799-991.812=-0.014
σ1.235-1.243=-0.007
min991.251-991.237=0.014
max997.001-997.038=-0.038
mean1071.150-1080.300=-9.150
σ328.071-319.141=8.929
min568.000-602.000=-34.000
max1643.000-1631.000=12.000
mean1.521-1.523=-0.002
σ0.065-0.081=-0.016
min1.452-1.389=0.063
max1.727-1.778=-0.051

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.413-285.412=0.001
σ0.012-0.010=0.001
min285.393-285.394=-0.001
max285.423-285.420=0.003
mean1643.000-1631.000=12.000
σ0.000
min1643.000-1631.000=12.000
max1643.000-1631.000=12.000
mean0.379-0.376=0.003
σ0.007-0.006=0.001
min0.374-0.373=0.001
max0.389-0.387=0.003
iters=5
new-facts=1
prior-facts=6402
mean1285.375-1285.353=0.021
σ0.135-0.085=0.050
min1285.307-1285.307=-0.001
max1285.617-1285.506=0.111
mean1643.000-1631.000=12.000
σ0.000
min1643.000-1631.000=12.000
max1643.000-1631.000=12.000
mean1.937-1.872=0.065
σ0.112-0.079=0.033
min1.829-1.779=0.049
max2.104-1.992=0.112
iters=5
new-facts=6402
prior-facts=1
mean1807.743-1807.719=0.025
σ6.987-6.987=-0.000
min1804.396-1804.357=0.039
max1820.226-1820.203=0.023
mean1643.000-1631.000=12.000
σ0.000
min1643.000-1631.000=12.000
max1643.000-1631.000=12.000
mean4.269-4.251=0.018
σ0.145-0.293=-0.148
min4.127-3.856=0.271
max4.491-4.670=-0.180
iters=5
new-facts=6402
prior-facts=6402
mean2070.196-2070.192=0.004
σ0.011-0.003=0.007
min2070.183-2070.187=-0.004
max2070.212-2070.194=0.018
mean1842.800-1849.000=-6.200
σ178.595-178.192=0.403
min1643.000-1631.000=12.000
max2078.000-2095.000=-17.000
mean4.506-4.454=0.053
σ0.041-0.048=-0.006
min4.461-4.418=0.044
max4.559-4.531=0.028

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.207-1.211=-0.005
σ0.318-0.337=-0.020
min0.910-0.905=0.005
max1.706-1.778=-0.072

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.785-436.787=-0.002
σ572.364-572.359=0.005
min150.596-150.598=-0.002
max1295.331-1295.325=0.006
mean90.250
σ8.500
min86.000
max103.000
mean1643.000-1631.000=12.000
σ0.000
min1643.000-1631.000=12.000
max1643.000-1631.000=12.000
mean0.518-0.523=-0.005
σ0.536-0.537=-0.002
min0.250-0.253=-0.004
max1.322-1.328=-0.007
policies=20
mean1506.250-1506.279=-0.029
σ0.239-0.246=-0.008
min1506.091-1506.121=-0.029
max1506.605-1506.646=-0.041
mean860.000
σ0.000
min860.000
max860.000
mean1643.000-1631.000=12.000
σ0.000
min1643.000-1631.000=12.000
max1643.000-1631.000=12.000
mean2.513-2.520=-0.007
σ0.017-0.025=-0.008
min2.496-2.486=0.009
max2.532-2.545=-0.012
policies=200
mean15070.321-15070.285=0.037
σ0.092-0.273=-0.181
min15070.266-15069.879=0.388
max15070.459-15070.464=-0.005
mean8600.000
σ0.000
min8600.000
max8600.000
mean1643.000-1631.000=12.000
σ0.000
min1643.000-1631.000=12.000
max1643.000-1631.000=12.000
mean25.521-25.457=0.063
σ0.203-0.109=0.094
min25.338-25.351=-0.013
max25.784-25.554=0.231