Compare commits

Home / Compare fbde3d39 .. 4325dc70

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.914=0.000
σ0.367-0.368=-0.001
min53.779-53.787=-0.007
max54.957-54.961=-0.003
mean413.000-416.600=-3.600
σ0.000-0.516=-0.516
min413.000-416.000=-3.000
max413.000-417.000=-4.000
mean0.138-0.138=0.000
σ0.004-0.003=0.000
min0.135-0.134=0.001
max0.144-0.143=0.001
cache=y
dps=1
iters=10
policies=100
mean43.141-43.140=0.001
σ0.006-0.006=0.000
min43.131-43.131=0.000
max43.152-43.151=0.001
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.121-0.119=0.002
σ0.003-0.004=-0.001
min0.118-0.114=0.004
max0.128-0.126=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.814-991.792=0.022
σ1.263-1.265=-0.002
min991.239-991.248=-0.009
max997.129-997.117=0.012
mean1062.000-1065.150=-3.150
σ321.991-321.640=0.351
min566.000-569.000=-3.000
max1635.000-1629.000=6.000
mean1.542-1.570=-0.028
σ0.104-0.146=-0.043
min1.457-1.428=0.029
max1.837-1.995=-0.158

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.409-285.409=0.000
σ0.010-0.015=-0.005
min285.396-285.383=0.013
max285.421-285.422=-0.001
mean1635.000-1629.000=6.000
σ0.000
min1635.000-1629.000=6.000
max1635.000-1629.000=6.000
mean0.378-0.380=-0.002
σ0.005-0.009=-0.004
min0.375-0.373=0.002
max0.386-0.393=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1285.376-1285.376=0.000
σ0.130-0.136=-0.005
min1285.308-1285.307=0.001
max1285.609-1285.619=-0.010
mean1635.000-1629.000=6.000
σ0.000
min1635.000-1629.000=6.000
max1635.000-1629.000=6.000
mean1.891-1.938=-0.047
σ0.128-0.119=0.010
min1.802-1.832=-0.030
max2.118-2.123=-0.005
iters=5
new-facts=6402
prior-facts=1
mean1807.731-1807.728=0.003
σ6.993-6.961=0.032
min1804.368-1804.381=-0.013
max1820.225-1820.163=0.062
mean1635.000-1629.000=6.000
σ0.000
min1635.000-1629.000=6.000
max1635.000-1629.000=6.000
mean4.249-4.198=0.050
σ0.174-0.156=0.018
min3.989-4.073=-0.085
max4.435-4.466=-0.031
iters=5
new-facts=6402
prior-facts=6402
mean2070.196-2070.196=0.000
σ0.007-0.008=-0.002
min2070.184-2070.184=0.000
max2070.200-2070.205=-0.005
mean1831.800-1835.400=-3.600
σ169.767-181.182=-11.415
min1635.000-1629.000=6.000
max2068.000-2073.000=-5.000
mean4.506-4.491=0.015
σ0.048-0.025=0.023
min4.447-4.475=-0.028
max4.573-4.536=0.037

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.158-1.165=-0.008
σ0.265-0.248=0.017
min0.912-0.902=0.010
max1.590-1.502=0.089

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.785-436.785=0.000
σ572.364-572.366=-0.002
min150.601-150.596=0.005
max1295.330-1295.333=-0.003
mean90.250
σ8.500
min86.000
max103.000
mean1635.000-1629.000=6.000
σ0.000
min1635.000-1629.000=6.000
max1635.000-1629.000=6.000
mean0.530-0.519=0.011
σ0.562-0.537=0.025
min0.247-0.248=-0.001
max1.373-1.325=0.049
policies=20
mean1506.277-1506.256=0.021
σ0.234-0.221=0.013
min1506.129-1506.109=0.020
max1506.626-1506.585=0.041
mean860.000
σ0.000
min860.000
max860.000
mean1635.000-1629.000=6.000
σ0.000
min1635.000-1629.000=6.000
max1635.000-1629.000=6.000
mean2.516-2.497=0.018
σ0.052-0.007=0.045
min2.445-2.489=-0.043
max2.564-2.507=0.057
policies=200
mean15070.413-15070.287=0.126
σ0.019-0.082=-0.063
min15070.394-15070.177=0.217
max15070.434-15070.364=0.069
mean8600.000
σ0.000
min8600.000
max8600.000
mean1635.000-1629.000=6.000
σ0.000
min1635.000-1629.000=6.000
max1635.000-1629.000=6.000
mean25.611-25.383=0.228
σ0.050-0.066=-0.016
min25.569-25.328=0.240
max25.680-25.469=0.211