Compare commits

Home / Compare 9a22a51e .. b48af375

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.617=0.001
σ0.055-0.052=0.002
min35.591-35.583=0.008
max35.773-35.764=0.008
mean418.000-412.300=5.700
σ0.000-0.483=-0.483
min418.000-412.000=6.000
max418.000-413.000=5.000
mean0.085-0.086=-0.001
σ0.003-0.005=-0.002
min0.083-0.083=0.000
max0.092-0.095=-0.003
cache=y
dps=1
iters=10
policies=100
mean24.047-24.046=0.000
σ0.003-0.002=0.000
min24.044-24.044=0.000
max24.051-24.050=0.000
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.067-0.069=-0.002
σ0.004-0.003=0.001
min0.062-0.067=-0.005
max0.074-0.076=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.492-1756.489=0.003
σ0.365-0.364=0.001
min1755.915-1755.915=0.000
max1757.078-1757.074=0.004
mean1644.200-1651.550=-7.350
σ625.308-645.559=-20.251
min662.000-631.000=31.000
max2838.000-2842.000=-4.000
mean2.343-2.344=-0.001
σ0.061-0.083=-0.022
min2.264-2.255=0.009
max2.487-2.526=-0.039

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.759-324.774=-0.015
σ0.055-0.040=0.016
min324.662-324.705=-0.043
max324.793-324.807=-0.014
mean2838.000-2842.000=-4.000
σ0.000
min2838.000-2842.000=-4.000
max2838.000-2842.000=-4.000
mean0.433-0.428=0.005
σ0.019-0.007=0.012
min0.422-0.421=0.001
max0.467-0.439=0.029
iters=5
new-facts=1
prior-facts=6402
mean1985.329-1985.306=0.023
σ0.009-0.024=-0.015
min1985.313-1985.275=0.038
max1985.335-1985.330=0.005
mean2838.000-2842.000=-4.000
σ0.000
min2838.000-2842.000=-4.000
max2838.000-2842.000=-4.000
mean2.632-2.667=-0.035
σ0.121-0.094=0.027
min2.523-2.561=-0.038
max2.774-2.759=0.015
iters=5
new-facts=6402
prior-facts=1
mean4809.095-4809.076=0.019
σ7.718-7.723=-0.004
min4805.559-4805.565=-0.006
max4822.901-4822.890=0.011
mean2838.000-2842.000=-4.000
σ0.000
min2838.000-2842.000=-4.000
max2838.000-2842.000=-4.000
mean8.840-8.812=0.028
σ0.247-0.178=0.069
min8.405-8.556=-0.152
max9.005-9.054=-0.049
iters=5
new-facts=6402
prior-facts=6402
mean4996.555-4996.560=-0.004
σ0.143-0.146=-0.004
min4996.302-4996.300=0.002
max4996.642-4996.652=-0.010
mean3063.200-3049.400=13.800
σ298.337-285.262=13.075
min2838.000-2842.000=-4.000
max3526.000-3501.000=25.000
mean8.557-8.518=0.039
σ0.116-0.127=-0.011
min8.471-8.411=0.060
max8.755-8.691=0.064

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.068-0.953=0.116
σ0.112-0.056=0.057
min0.926-0.921=0.005
max1.241-1.050=0.191

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.216-463.204=0.012
σ574.770-574.767=0.002
min175.816-175.815=0.001
max1325.371-1325.355=0.016
mean86.250
σ8.500
min82.000
max99.000
mean2838.000-2842.000=-4.000
σ0.000
min2838.000-2842.000=-4.000
max2838.000-2842.000=-4.000
mean0.436-0.434=0.002
σ0.306-0.305=0.002
min0.280-0.278=0.002
max0.895-0.891=0.005
policies=20
mean1758.501-1758.518=-0.017
σ0.332-0.358=-0.025
min1758.292-1758.282=0.009
max1758.995-1759.048=-0.053
mean820.000
σ0.000
min820.000
max820.000
mean2838.000-2842.000=-4.000
σ0.000
min2838.000-2842.000=-4.000
max2838.000-2842.000=-4.000
mean2.801-2.798=0.002
σ0.005-0.033=-0.028
min2.794-2.772=0.022
max2.805-2.846=-0.041
policies=200
mean17592.088-17592.202=-0.114
σ0.577-0.477=0.099
min17591.761-17591.811=-0.050
max17592.952-17592.891=0.061
mean8200.000
σ0.000
min8200.000
max8200.000
mean2838.000-2842.000=-4.000
σ0.000
min2838.000-2842.000=-4.000
max2838.000-2842.000=-4.000
mean28.004-27.882=0.123
σ0.337-0.383=-0.046
min27.629-27.470=0.160
max28.363-28.334=0.028