Compare commits

Home / Compare d3042363 .. 6559884b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.794-35.795=-0.001
σ0.110-0.113=-0.003
min35.742-35.740=0.003
max36.106-36.114=-0.008
mean409.000-412.000=-3.000
σ0.000
min409.000-412.000=-3.000
max409.000-412.000=-3.000
mean0.076-0.073=0.003
σ0.004-0.004=-0.000
min0.074-0.069=0.005
max0.083-0.080=0.002
cache=y
dps=1
iters=10
policies=100
mean26.066-26.066=-0.000
σ0.002-0.003=-0.001
min26.063-26.061=0.002
max26.069-26.071=-0.002
mean409.000-412.000=-3.000
σ0.000
min409.000-412.000=-3.000
max409.000-412.000=-3.000
mean0.061-0.061=-0.000
σ0.002-0.003=-0.000
min0.059-0.060=-0.001
max0.067-0.069=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.000-1718.973=38.028
σ0.364-169.953=-169.589
min1756.425-996.922=759.502
max1757.582-1757.588=-0.005
mean1651.050-1659.400=-8.350
σ632.708-637.385=-4.677
min660.000-671.000=-11.000
max2797.000-2710.000=87.000
mean2.854-2.789=0.065
σ0.105-0.343=-0.238
min2.576-1.434=1.142
max2.993-3.061=-0.068

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.280-278.283=-0.003
σ0.006-0.007=-0.002
min278.274-278.271=0.002
max278.288-278.292=-0.004
mean2797.000-2710.000=87.000
σ0.000
min2797.000-2710.000=87.000
max2797.000-2710.000=87.000
mean0.409-0.407=0.002
σ0.007-0.005=0.003
min0.403-0.403=-0.000
max0.419-0.415=0.004
iters=5
new-facts=1
prior-facts=6402
mean2175.528-2175.512=0.017
σ0.011-0.032=-0.021
min2175.514-2175.468=0.046
max2175.538-2175.547=-0.009
mean2797.000-2710.000=87.000
σ0.000
min2797.000-2710.000=87.000
max2797.000-2710.000=87.000
mean2.916-2.998=-0.082
σ0.129-0.129=0.000
min2.796-2.821=-0.025
max3.107-3.149=-0.042
iters=5
new-facts=6402
prior-facts=1
mean5134.486-5134.604=-0.117
σ1.016-1.006=0.011
min5133.724-5133.990=-0.266
max5136.275-5136.389=-0.115
mean2797.000-2710.000=87.000
σ0.000
min2797.000-2710.000=87.000
max2797.000-2710.000=87.000
mean9.289-8.943=0.346
σ0.271-0.548=-0.278
min8.965-8.340=0.625
max9.587-9.714=-0.128
iters=5
new-facts=6402
prior-facts=6402
mean5238.301-5238.368=-0.068
σ0.198-0.081=0.117
min5237.971-5238.292=-0.321
max5238.463-5238.466=-0.003
mean3280.000-3232.400=47.600
σ454.073-388.905=65.167
min2797.000-2710.000=87.000
max3899.000-3602.000=297.000
mean9.035-9.187=-0.152
σ0.427-0.275=0.152
min8.744-8.861=-0.117
max9.785-9.551=0.234

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.064-1.068=-0.005
σ0.131-0.130=0.001
min0.943-0.950=-0.007
max1.264-1.268=-0.004

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.467-467.468=-0.002
σ572.647-572.659=-0.012
min181.139-181.129=0.010
max1326.437-1326.457=-0.020
mean85.500
σ7.000
min82.000
max96.000
mean2797.000-2710.000=87.000
σ0.000
min2797.000-2710.000=87.000
max2797.000-2710.000=87.000
mean0.455-0.574=-0.119
σ0.306-0.567=-0.261
min0.297-0.279=0.018
max0.913-1.424=-0.511
policies=20
mean1811.683-1811.639=0.044
σ0.370-0.387=-0.017
min1811.419-1811.372=0.047
max1812.212-1812.210=0.003
mean820.000
σ0.000
min820.000
max820.000
mean2797.000-2710.000=87.000
σ0.000
min2797.000-2710.000=87.000
max2797.000-2710.000=87.000
mean2.946-2.869=0.077
σ0.091-0.026=0.065
min2.864-2.836=0.028
max3.065-2.894=0.171
policies=200
mean18123.338-18123.290=0.048
σ0.437-0.597=-0.160
min18123.086-18122.749=0.338
max18123.992-18124.143=-0.151
mean8200.000
σ0.000
min8200.000
max8200.000
mean2797.000-2710.000=87.000
σ0.000
min2797.000-2710.000=87.000
max2797.000-2710.000=87.000
mean28.938-28.958=-0.019
σ0.145-0.268=-0.123
min28.790-28.703=0.087
max29.064-29.304=-0.240