Compare commits

Home / Compare 25da4677 .. 31448a04

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.619=-0.001
σ0.054-0.056=-0.001
min35.592-35.589=0.002
max35.771-35.776=-0.004
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.085-0.085=-0.000
σ0.005-0.004=0.001
min0.082-0.082=-0.001
max0.096-0.093=0.003
cache=y
dps=1
iters=10
policies=100
mean24.047-24.046=0.001
σ0.002-0.004=-0.002
min24.044-24.041=0.003
max24.049-24.054=-0.005
mean414.000-415.100=-1.100
σ0.000-0.316=-0.316
min414.000-415.000=-1.000
max414.000-416.000=-2.000
mean0.067-0.067=-0.000
σ0.004-0.005=-0.001
min0.060-0.061=-0.000
max0.074-0.076=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1718.560=37.931
σ0.364-169.696=-169.331
min1755.915-997.604=758.311
max1757.076-1757.076=-0.000
mean1645.100-1598.800=46.300
σ625.550-593.717=31.833
min620.000-661.000=-41.000
max2825.000-2413.000=412.000
mean2.341-2.279=0.062
σ0.066-0.219=-0.153
min2.225-1.445=0.780
max2.505-2.496=0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.759-324.764=-0.005
σ0.053-0.040=0.013
min324.664-324.693=-0.029
max324.790-324.786=0.005
mean2825.000-2413.000=412.000
σ0.000
min2825.000-2413.000=412.000
max2825.000-2413.000=412.000
mean0.431-0.429=0.002
σ0.009-0.010=-0.001
min0.424-0.421=0.003
max0.441-0.440=0.001
iters=5
new-facts=1
prior-facts=6402
mean1985.317-1985.307=0.010
σ0.029-0.009=0.019
min1985.276-1985.292=-0.016
max1985.339-1985.314=0.024
mean2825.000-2413.000=412.000
σ0.000
min2825.000-2413.000=412.000
max2825.000-2413.000=412.000
mean2.680-2.698=-0.018
σ0.237-0.143=0.094
min2.524-2.532=-0.007
max3.083-2.845=0.238
iters=5
new-facts=6402
prior-facts=1
mean4809.004-4809.070=-0.066
σ7.731-7.670=0.061
min4805.063-4805.595=-0.532
max4822.823-4822.791=0.033
mean2825.000-2413.000=412.000
σ0.000
min2825.000-2413.000=412.000
max2825.000-2413.000=412.000
mean8.684-8.781=-0.096
σ0.415-0.125=0.290
min7.973-8.641=-0.668
max8.962-8.934=0.028
iters=5
new-facts=6402
prior-facts=6402
mean4996.620-4996.637=-0.017
σ0.027-0.031=-0.004
min4996.591-4996.602=-0.011
max4996.650-4996.671=-0.021
mean3061.000-3018.000=43.000
σ307.222-366.227=-59.004
min2825.000-2515.000=310.000
max3535.000-3365.000=170.000
mean8.481-9.070=-0.589
σ0.091-0.493=-0.402
min8.428-8.450=-0.022
max8.643-9.515=-0.871

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.164-1.640=-0.476
σ0.333-0.315=0.018
min0.918-1.076=-0.157
max1.543-1.786=-0.243

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.205-463.200=0.005
σ574.771-574.764=0.007
min175.814-175.817=-0.003
max1325.361-1325.346=0.015
mean86.250
σ8.500
min82.000
max99.000
mean2825.000-2413.000=412.000
σ0.000
min2825.000-2413.000=412.000
max2825.000-2413.000=412.000
mean0.418-0.559=-0.141
σ0.284-0.574=-0.291
min0.270-0.267=0.003
max0.844-1.421=-0.577
policies=20
mean1758.518-1758.494=0.024
σ0.358-0.351=0.006
min1758.265-1758.261=0.004
max1759.046-1759.016=0.030
mean820.000
σ0.000
min820.000
max820.000
mean2825.000-2413.000=412.000
σ0.000
min2825.000-2413.000=412.000
max2825.000-2413.000=412.000
mean2.807-2.700=0.107
σ0.040-0.008=0.032
min2.785-2.690=0.095
max2.867-2.710=0.157
policies=200
mean17592.078-17592.022=0.056
σ0.449-0.432=0.017
min17591.688-17591.670=0.018
max17592.712-17592.649=0.063
mean8200.000
σ0.000
min8200.000
max8200.000
mean2825.000-2413.000=412.000
σ0.000
min2825.000-2413.000=412.000
max2825.000-2413.000=412.000
mean27.943-27.373=0.570
σ0.332-0.181=0.150
min27.626-27.187=0.439
max28.290-27.551=0.739