Compare commits

Home / Compare cac17a20 .. f32781d6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-53.915=0.000
σ0.366-0.366=-0.000
min53.779-53.788=-0.010
max54.958-54.958=-0.000
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.140-0.140=0.001
σ0.004-0.004=0.000
min0.136-0.137=-0.000
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.140-43.141=-0.001
σ0.008-0.004=0.004
min43.128-43.134=-0.006
max43.155-43.146=0.009
mean412.800-413.000=-0.200
σ0.422-0.000=0.422
min412.000-413.000=-1.000
max413.000
mean0.120-0.119=0.000
σ0.004-0.005=-0.001
min0.115-0.113=0.002
max0.128-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.801-991.806=-0.006
σ1.268-1.252=0.016
min991.243-991.246=-0.002
max997.142-997.077=0.065
mean1067.950-1061.550=6.400
σ328.024-322.451=5.572
min565.000-564.000=1.000
max1641.000-1637.000=4.000
mean1.564-1.545=0.019
σ0.140-0.074=0.065
min1.405-1.479=-0.075
max1.909-1.731=0.178

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.409-285.410=-0.001
σ0.012-0.013=-0.001
min285.390-285.391=-0.001
max285.420-285.423=-0.003
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean0.372-0.378=-0.006
σ0.008-0.003=0.005
min0.367-0.376=-0.008
max0.385-0.383=0.002
iters=5
new-facts=1
prior-facts=6402
mean1285.371-1285.374=-0.003
σ0.125-0.129=-0.004
min1285.311-1285.314=-0.003
max1285.595-1285.605=-0.010
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean2.029-1.872=0.158
σ0.237-0.038=0.199
min1.837-1.818=0.019
max2.384-1.917=0.467
iters=5
new-facts=6402
prior-facts=1
mean1807.701-1807.695=0.006
σ7.000-7.025=-0.025
min1804.350-1804.311=0.039
max1820.208-1820.249=-0.041
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean4.187-4.114=0.073
σ0.172-0.260=-0.088
min3.950-3.899=0.051
max4.433-4.516=-0.083
iters=5
new-facts=6402
prior-facts=6402
mean2070.199-2070.199=-0.000
σ0.009-0.010=-0.002
min2070.187-2070.184=0.004
max2070.210-2070.212=-0.002
mean1833.200-1849.200=-16.000
σ168.081-175.992=-7.911
min1641.000-1637.000=4.000
max2068.000-2093.000=-25.000
mean4.519-4.452=0.067
σ0.042-0.041=0.002
min4.474-4.389=0.085
max4.570-4.500=0.070

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.200-1.226=-0.026
σ0.318-0.314=0.004
min0.908-0.914=-0.006
max1.732-1.738=-0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.787-436.785=0.002
σ572.358-572.359=-0.000
min150.598-150.598=-0.000
max1295.325-1295.323=0.001
mean90.250
σ8.500
min86.000
max103.000
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean0.538-0.529=0.010
σ0.577-0.559=0.018
min0.248-0.247=0.001
max1.405-1.368=0.037
policies=20
mean1506.271-1506.265=0.006
σ0.248-0.246=0.002
min1506.113-1506.109=0.004
max1506.641-1506.631=0.009
mean860.000
σ0.000
min860.000
max860.000
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean2.522-2.522=-0.001
σ0.005-0.015=-0.010
min2.516-2.501=0.015
max2.526-2.535=-0.009
policies=200
mean15070.388-15070.305=0.084
σ0.092-0.093=-0.001
min15070.252-15070.195=0.057
max15070.456-15070.416=0.040
mean8600.000
σ0.000
min8600.000
max8600.000
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean25.545-25.514=0.031
σ0.275-0.082=0.193
min25.302-25.445=-0.143
max25.883-25.619=0.264