Compare commits

Home / Compare afa850e7 .. 963c22e8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.646-53.914=-0.267
σ0.366-0.368=-0.002
min53.510-53.787=-0.277
max54.688-54.961=-0.272
mean413.000-416.600=-3.600
σ0.000-0.516=-0.516
min413.000-416.000=-3.000
max413.000-417.000=-4.000
mean0.137-0.138=-0.001
σ0.005-0.003=0.001
min0.133-0.134=-0.002
max0.146-0.143=0.002
cache=y
dps=1
iters=10
policies=100
mean42.942-43.140=-0.198
σ0.006-0.006=-0.000
min42.932-43.131=-0.198
max42.952-43.151=-0.199
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.118-0.119=-0.001
σ0.001-0.004=-0.003
min0.117-0.114=0.003
max0.120-0.126=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.799-991.792=0.006
σ1.250-1.265=-0.015
min991.234-991.248=-0.014
max997.062-997.117=-0.055
mean1063.650-1065.150=-1.500
σ322.894-321.640=1.254
min565.000-569.000=-4.000
max1639.000-1629.000=10.000
mean1.522-1.570=-0.048
σ0.084-0.146=-0.062
min1.439-1.428=0.012
max1.724-1.995=-0.271

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.393-285.409=-0.016
σ0.013-0.015=-0.003
min285.372-285.383=-0.011
max285.405-285.422=-0.017
mean1639.000-1629.000=10.000
σ0.000
min1639.000-1629.000=10.000
max1639.000-1629.000=10.000
mean0.378-0.380=-0.002
σ0.008-0.009=-0.001
min0.374-0.373=0.001
max0.392-0.393=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1285.347-1285.376=-0.029
σ0.107-0.136=-0.028
min1285.290-1285.307=-0.017
max1285.538-1285.619=-0.080
mean1639.000-1629.000=10.000
σ0.000
min1639.000-1629.000=10.000
max1639.000-1629.000=10.000
mean2.002-1.938=0.064
σ0.254-0.119=0.136
min1.773-1.832=-0.059
max2.381-2.123=0.257
iters=5
new-facts=6402
prior-facts=1
mean1807.690-1807.728=-0.038
σ7.001-6.961=0.040
min1804.333-1804.381=-0.048
max1820.199-1820.163=0.036
mean1639.000-1629.000=10.000
σ0.000
min1639.000-1629.000=10.000
max1639.000-1629.000=10.000
mean4.187-4.198=-0.011
σ0.200-0.156=0.044
min3.861-4.073=-0.212
max4.385-4.466=-0.080
iters=5
new-facts=6402
prior-facts=6402
mean2070.176-2070.196=-0.020
σ0.010-0.008=0.002
min2070.168-2070.184=-0.016
max2070.193-2070.205=-0.012
mean1837.000-1835.400=1.600
σ169.663-181.182=-11.519
min1639.000-1629.000=10.000
max2073.000
mean4.557-4.491=0.065
σ0.127-0.025=0.102
min4.459-4.475=-0.016
max4.776-4.536=0.240

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.162-1.165=-0.003
σ0.277-0.248=0.029
min0.894-0.902=-0.008
max1.553-1.502=0.052

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.772-436.785=-0.013
σ572.360-572.366=-0.006
min150.587-150.596=-0.009
max1295.311-1295.333=-0.022
mean90.250
σ8.500
min86.000
max103.000
mean1639.000-1629.000=10.000
σ0.000
min1639.000-1629.000=10.000
max1639.000-1629.000=10.000
mean0.545-0.519=0.026
σ0.579-0.537=0.041
min0.249-0.248=0.001
max1.413-1.325=0.088
policies=20
mean1506.159-1506.256=-0.097
σ0.220-0.221=-0.000
min1506.016-1506.109=-0.093
max1506.488-1506.585=-0.097
mean860.000
σ0.000
min860.000
max860.000
mean1639.000-1629.000=10.000
σ0.000
min1639.000-1629.000=10.000
max1639.000-1629.000=10.000
mean2.493-2.497=-0.004
σ0.029-0.007=0.022
min2.456-2.489=-0.033
max2.528-2.507=0.021
policies=200
mean15069.480-15070.287=-0.807
σ0.100-0.082=0.018
min15069.397-15070.177=-0.780
max15069.597-15070.364=-0.767
mean8600.000
σ0.000
min8600.000
max8600.000
mean1639.000-1629.000=10.000
σ0.000
min1639.000-1629.000=10.000
max1639.000-1629.000=10.000
mean25.394-25.383=0.012
σ0.087-0.066=0.021
min25.311-25.328=-0.018
max25.491-25.469=0.023