Compare commits

Home / Compare 5cc7ce3d .. fb6ed40f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.263=-0.000
σ0.054-0.053=0.001
min35.238-35.236=0.002
max35.416-35.412=0.003
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.084-0.084=-0.001
σ0.006-0.003=0.003
min0.076-0.082=-0.006
max0.095-0.090=0.005
cache=y
dps=1
iters=10
policies=100
mean23.769-23.770=-0.000
σ0.003-0.003=0.000
min23.764-23.766=-0.002
max23.774-23.775=-0.001
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.067-0.069=-0.003
σ0.004-0.004=0.000
min0.062-0.066=-0.004
max0.075-0.076=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.484-1756.487=-0.003
σ0.365-0.365=0.000
min1755.908-1755.910=-0.002
max1757.068-1757.079=-0.012
mean1645.700-1656.050=-10.350
σ628.117-627.192=0.925
min629.000-631.000=-2.000
max2828.000-2760.000=68.000
mean2.349-2.355=-0.006
σ0.079-0.082=-0.003
min2.160-2.266=-0.106
max2.512-2.600=-0.088

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.707-324.710=-0.003
σ0.057-0.046=0.011
min324.605-324.628=-0.024
max324.742-324.738=0.004
mean2828.000-2760.000=68.000
σ0.000
min2828.000-2760.000=68.000
max2828.000-2760.000=68.000
mean0.428-0.426=0.002
σ0.008-0.006=0.002
min0.423-0.423=0.000
max0.442-0.437=0.005
iters=5
new-facts=1
prior-facts=6402
mean1985.264-1985.265=-0.001
σ0.012-0.009=0.003
min1985.249-1985.251=-0.002
max1985.277-1985.276=0.002
mean2828.000-2760.000=68.000
σ0.000
min2828.000-2760.000=68.000
max2828.000-2760.000=68.000
mean2.741-2.604=0.137
σ0.166-0.106=0.061
min2.563-2.461=0.102
max2.917-2.751=0.167
iters=5
new-facts=6402
prior-facts=1
mean4808.564-4808.774=-0.210
σ7.904-7.694=0.210
min4804.203-4804.796=-0.592
max4822.668-4822.526=0.141
mean2828.000-2760.000=68.000
σ0.000
min2828.000-2760.000=68.000
max2828.000-2760.000=68.000
mean8.598-8.672=-0.073
σ0.749-0.537=0.212
min7.727-7.765=-0.038
max9.357-9.085=0.272
iters=5
new-facts=6402
prior-facts=6402
mean4996.402-4996.404=-0.003
σ0.140-0.175=-0.035
min4996.152-4996.092=0.060
max4996.473-4996.493=-0.020
mean3025.800-3058.400=-32.600
σ264.493-268.997=-4.504
min2828.000-2760.000=68.000
max3423.000-3330.000=93.000
mean8.505-8.927=-0.422
σ0.054-0.460=-0.406
min8.431-8.527=-0.095
max8.576-9.518=-0.942

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.051-0.953=0.098
σ0.242-0.056=0.186
min0.912-0.919=-0.007
max1.473-1.051=0.422

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.971-462.966=0.004
σ574.244-574.249=-0.005
min175.841-175.835=0.006
max1324.337-1324.340=-0.003
mean86.250
σ8.500
min82.000
max99.000
mean2828.000-2760.000=68.000
σ0.000
min2828.000-2760.000=68.000
max2828.000-2760.000=68.000
mean0.468-0.432=0.036
σ0.369-0.305=0.063
min0.279-0.278=0.001
max1.021-0.890=0.131
policies=20
mean1758.714-1758.716=-0.002
σ0.347-0.327=0.019
min1758.480-1758.502=-0.022
max1759.228-1759.202=0.026
mean820.000
σ0.000
min820.000
max820.000
mean2828.000-2760.000=68.000
σ0.000
min2828.000-2760.000=68.000
max2828.000-2760.000=68.000
mean2.785-2.842=-0.058
σ0.003-0.083=-0.080
min2.782-2.797=-0.015
max2.789-2.967=-0.179
policies=200
mean17593.344-17592.341=1.003
σ0.694-0.609=0.085
min17592.381-17592.007=0.374
max17593.880-17593.253=0.627
mean8200.000
σ0.000
min8200.000
max8200.000
mean2828.000-2760.000=68.000
σ0.000
min2828.000-2760.000=68.000
max2828.000-2760.000=68.000
mean27.890-27.392=0.497
σ0.379-0.100=0.278
min27.449-27.300=0.149
max28.255-27.492=0.763