Compare commits

Home / Compare edc75ea6 .. db196213

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.649-53.915=-0.267
σ0.367-0.369=-0.002
min53.524-53.786=-0.262
max54.692-54.964=-0.272
mean414.000-414.100=-0.100
σ0.000-0.316=-0.316
min414.000
max414.000-415.000=-1.000
mean0.138-0.139=-0.002
σ0.004-0.005=-0.001
min0.130-0.135=-0.005
max0.145-0.146=-0.002
cache=y
dps=1
iters=10
policies=100
mean42.944-43.140=-0.197
σ0.007-0.006=0.001
min42.935-43.132=-0.197
max42.955-43.148=-0.193
mean414.400-415.000=-0.600
σ0.516-0.000=0.516
min414.000-415.000=-1.000
max415.000
mean0.121-0.121=0.000
σ0.005-0.004=0.001
min0.115-0.118=-0.003
max0.129-0.127=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.803-991.817=-0.014
σ1.271-1.244=0.027
min991.250-991.230=0.020
max997.155-997.041=0.114
mean1064.550-1064.050=0.500
σ321.237-322.173=-0.936
min568.000
max1632.000-1640.000=-8.000
mean1.526-1.539=-0.014
σ0.132-0.090=0.042
min1.362-1.425=-0.063
max1.822-1.770=0.052

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.392-285.412=-0.020
σ0.007-0.014=-0.007
min285.386-285.391=-0.004
max285.401-285.430=-0.028
mean1632.000-1640.000=-8.000
σ0.000
min1632.000-1640.000=-8.000
max1632.000-1640.000=-8.000
mean0.382-0.377=0.005
σ0.007-0.007=0.000
min0.373-0.371=0.002
max0.391-0.389=0.002
iters=5
new-facts=1
prior-facts=6402
mean1285.353-1285.364=-0.011
σ0.131-0.111=0.020
min1285.286-1285.309=-0.023
max1285.586-1285.562=0.024
mean1632.000-1640.000=-8.000
σ0.000
min1632.000-1640.000=-8.000
max1632.000-1640.000=-8.000
mean1.964-2.029=-0.065
σ0.143-0.265=-0.123
min1.829-1.822=0.007
max2.151-2.449=-0.298
iters=5
new-facts=6402
prior-facts=1
mean1807.690-1807.715=-0.025
σ6.973-7.004=-0.031
min1804.359-1804.353=0.006
max1820.148-1820.229=-0.082
mean1632.000-1640.000=-8.000
σ0.000
min1632.000-1640.000=-8.000
max1632.000-1640.000=-8.000
mean4.140-4.211=-0.071
σ0.070-0.230=-0.160
min4.064-3.852=0.212
max4.206-4.440=-0.234
iters=5
new-facts=6402
prior-facts=6402
mean2070.178-2070.197=-0.019
σ0.018-0.009=0.009
min2070.167-2070.186=-0.018
max2070.211-2070.207=0.003
mean1855.800-1836.400=19.400
σ199.416-173.961=25.455
min1632.000-1640.000=-8.000
max2084.000-2073.000=11.000
mean4.485-4.593=-0.108
σ0.083-0.160=-0.076
min4.407-4.474=-0.067
max4.581-4.871=-0.291

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.174-1.259=-0.084
σ0.243-0.316=-0.073
min0.917-0.908=0.009
max1.516-1.695=-0.179

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.774-436.790=-0.016
σ572.360-572.363=-0.003
min150.588-150.598=-0.010
max1295.314-1295.334=-0.020
mean90.250
σ8.500
min86.000
max103.000
mean1632.000-1640.000=-8.000
σ0.000
min1632.000-1640.000=-8.000
max1632.000-1640.000=-8.000
mean0.518-0.539=-0.021
σ0.538-0.580=-0.042
min0.245-0.248=-0.003
max1.325-1.409=-0.084
policies=20
mean1506.177-1506.267=-0.090
σ0.226-0.236=-0.010
min1506.029-1506.108=-0.079
max1506.514-1506.618=-0.104
mean860.000
σ0.000
min860.000
max860.000
mean1632.000-1640.000=-8.000
σ0.000
min1632.000-1640.000=-8.000
max1632.000-1640.000=-8.000
mean2.500-2.505=-0.005
σ0.030-0.016=0.014
min2.475-2.488=-0.013
max2.535-2.526=0.009
policies=200
mean15069.481-15070.386=-0.905
σ0.096-0.097=-0.001
min15069.396-15070.241=-0.845
max15069.616-15070.449=-0.833
mean8600.000
σ0.000
min8600.000
max8600.000
mean1632.000-1640.000=-8.000
σ0.000
min1632.000-1640.000=-8.000
max1632.000-1640.000=-8.000
mean25.422-25.523=-0.102
σ0.090-0.183=-0.093
min25.290-25.362=-0.072
max25.486-25.742=-0.256