Compare commits

Home / Compare ffe6045d .. 61d08a5c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.912-53.310=0.602
σ0.366-0.367=-0.001
min53.778-53.171=0.607
max54.953-54.353=0.599
mean413.000-417.300=-4.300
σ0.000-0.483=-0.483
min413.000-417.000=-4.000
max413.000-418.000=-5.000
mean0.135-0.136=-0.001
σ0.005-0.005=0.001
min0.130-0.129=0.001
max0.145-0.144=0.001
cache=y
dps=1
iters=10
policies=100
mean43.142-42.545=0.597
σ0.007-0.013=-0.006
min43.127-42.528=0.599
max43.149-42.574=0.574
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.120-0.118=0.001
σ0.005-0.003=0.001
min0.113-0.115=-0.002
max0.128-0.124=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.085-989.875=2.210
σ1.224-1.245=-0.021
min991.500-989.292=2.209
max997.217-995.108=2.109
mean1065.350-1055.200=10.150
σ319.229-294.917=24.312
min600.000-622.000=-22.000
max1639.000-1473.000=166.000
mean1.510-1.531=-0.020
σ0.076-0.081=-0.005
min1.406-1.389=0.018
max1.736-1.747=-0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.608-280.215=5.393
σ0.010-0.010=0.001
min285.595-280.203=5.392
max285.622-280.225=5.397
mean1639.000-1473.000=166.000
σ0.000
min1639.000-1473.000=166.000
max1639.000-1473.000=166.000
mean0.384-0.370=0.014
σ0.010-0.004=0.006
min0.376-0.368=0.008
max0.397-0.377=0.020
iters=5
new-facts=1
prior-facts=6402
mean1285.569-1280.283=5.286
σ0.136-0.124=0.012
min1285.502-1280.214=5.288
max1285.813-1280.502=5.310
mean1639.000-1473.000=166.000
σ0.000
min1639.000-1473.000=166.000
max1639.000-1473.000=166.000
mean1.874-1.841=0.033
σ0.045-0.040=0.005
min1.826-1.799=0.027
max1.923-1.902=0.021
iters=5
new-facts=6402
prior-facts=1
mean1807.890-1802.580=5.310
σ7.012-7.057=-0.046
min1804.556-1799.178=5.378
max1820.419-1815.188=5.231
mean1639.000-1473.000=166.000
σ0.000
min1639.000-1473.000=166.000
max1639.000-1473.000=166.000
mean4.138-4.305=-0.167
σ0.144-0.203=-0.059
min3.990-4.006=-0.016
max4.323-4.481=-0.159
iters=5
new-facts=6402
prior-facts=6402
mean2070.393-2065.010=5.383
σ0.011-0.011=-0.000
min2070.387-2065.002=5.386
max2070.412-2065.028=5.384
mean1862.800-1802.000=60.800
σ194.784-195.974=-1.191
min1639.000-1561.000=78.000
max2086.000-1993.000=93.000
mean4.477-4.412=0.065
σ0.067-0.087=-0.020
min4.422-4.329=0.093
max4.581-4.532=0.049

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.222-1.793=-0.571
σ0.258-0.064=0.194
min0.913-1.702=-0.789
max1.568-1.868=-0.300

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.383-435.103=2.281
σ572.361-572.812=-0.451
min151.192-148.692=2.499
max1295.925-1294.321=1.604
mean90.250
σ8.500
min86.000
max103.000
mean1639.000-1473.000=166.000
σ0.000
min1639.000-1473.000=166.000
max1639.000-1473.000=166.000
mean0.532-0.524=0.008
σ0.559-0.539=0.020
min0.249-0.252=-0.004
max1.370-1.333=0.038
policies=20
mean1512.186-1487.169=25.017
σ0.254-0.236=0.018
min1512.017-1487.007=25.010
max1512.564-1487.519=25.045
mean860.000
σ0.000
min860.000
max860.000
mean1639.000-1473.000=166.000
σ0.000
min1639.000-1473.000=166.000
max1639.000-1473.000=166.000
mean2.530-2.503=0.027
σ0.011-0.022=-0.011
min2.515-2.471=0.044
max2.540-2.518=0.023
policies=200
mean15129.652-14879.297=250.356
σ0.156-0.101=0.056
min15129.494-14879.222=250.272
max15129.807-14879.442=250.364
mean8600.000
σ0.000
min8600.000
max8600.000
mean1639.000-1473.000=166.000
σ0.000
min1639.000-1473.000=166.000
max1639.000-1473.000=166.000
mean25.680-25.315=0.365
σ0.086-0.160=-0.074
min25.602-25.178=0.423
max25.758-25.505=0.252