Compare commits

Home / Compare a16259d6 .. eec35b6b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.064-73.060=0.004
σ0.051-0.054=-0.003
min73.037-73.026=0.010
max73.207-73.212=-0.005
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.164-0.160=0.005
σ0.008-0.005=0.003
min0.157-0.150=0.007
max0.183-0.167=0.016
cache=y
dps=1
iters=10
policies=100
mean23.754-23.754=-0.000
σ0.004-0.003=0.001
min23.749-23.751=-0.002
max23.763-23.761=0.002
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.066-0.068=-0.001
σ0.005-0.004=0.000
min0.062-0.062=0.000
max0.074-0.075=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.819-1755.819=0.000
σ0.362-0.360=0.002
min1755.254-1755.245=0.009
max1756.405-1756.391=0.014
mean1653.500-1648.250=5.250
σ639.461-638.685=0.776
min650.000-648.000=2.000
max2853.000-2850.000=3.000
mean2.866-2.808=0.058
σ0.138-0.166=-0.028
min2.487-2.254=0.233
max3.177-2.994=0.184

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean321.044-321.044=0.001
σ0.057-0.059=-0.002
min320.943-320.939=0.004
max321.082-321.083=-0.001
mean2853.000-2850.000=3.000
σ0.000
min2853.000-2850.000=3.000
max2853.000-2850.000=3.000
mean0.430-0.430=-0.000
σ0.010-0.005=0.004
min0.421-0.421=-0.000
max0.444-0.436=0.008
iters=5
new-facts=1
prior-facts=6402
mean1981.610-1981.614=-0.004
σ0.030-0.013=0.017
min1981.558-1981.602=-0.044
max1981.628-1981.628=-0.000
mean2853.000-2850.000=3.000
σ0.000
min2853.000-2850.000=3.000
max2853.000-2850.000=3.000
mean2.643-2.705=-0.062
σ0.131-0.122=0.009
min2.555-2.570=-0.015
max2.867-2.871=-0.004
iters=5
new-facts=6402
prior-facts=1
mean4805.243-4805.240=0.003
σ7.782-7.783=-0.001
min4801.672-4801.734=-0.061
max4819.164-4819.162=0.002
mean2853.000-2850.000=3.000
σ0.000
min2853.000-2850.000=3.000
max2853.000-2850.000=3.000
mean8.932-8.872=0.060
σ0.236-0.333=-0.097
min8.637-8.340=0.298
max9.212-9.169=0.043
iters=5
new-facts=6402
prior-facts=6402
mean4992.825-4992.759=0.066
σ0.022-0.172=-0.150
min4992.798-4992.452=0.346
max4992.851-4992.845=0.005
mean3068.200-3087.400=-19.200
σ223.250-245.589=-22.338
min2853.000-2850.000=3.000
max3403.000-3340.000=63.000
mean8.955-9.007=-0.052
σ0.227-0.436=-0.208
min8.758-8.574=0.185
max9.327-9.536=-0.209

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.059-1.061=-0.002
σ0.228-0.174=0.054
min0.923-0.923=-0.000
max1.453-1.351=0.102

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.422-462.415=0.007
σ574.241-574.229=0.012
min175.293-175.295=-0.002
max1323.784-1323.758=0.026
mean86.250
σ8.500
min82.000
max99.000
mean2853.000-2850.000=3.000
σ0.000
min2853.000-2850.000=3.000
max2853.000-2850.000=3.000
mean0.435-0.437=-0.002
σ0.301-0.305=-0.004
min0.282-0.281=0.000
max0.886-0.895=-0.008
policies=20
mean1753.219-1753.177=0.042
σ0.365-0.285=0.080
min1752.968-1752.972=-0.004
max1753.761-1753.599=0.162
mean820.000
σ0.000
min820.000
max820.000
mean2853.000-2850.000=3.000
σ0.000
min2853.000-2850.000=3.000
max2853.000-2850.000=3.000
mean2.787-2.789=-0.002
σ0.010-0.010=0.000
min2.780-2.782=-0.001
max2.801-2.802=-0.002
policies=200
mean17538.671-17538.462=0.209
σ0.432-0.503=-0.070
min17538.165-17537.825=0.341
max17539.040-17539.053=-0.013
mean8200.000
σ0.000
min8200.000
max8200.000
mean2853.000-2850.000=3.000
σ0.000
min2853.000-2850.000=3.000
max2853.000-2850.000=3.000
mean27.867-27.905=-0.038
σ0.269-0.289=-0.020
min27.515-27.528=-0.014
max28.120-28.155=-0.035