Compare commits

Home / Compare 1b8144d0 .. e362cd80

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.915=-0.001
σ0.367-0.368=-0.002
min53.779-53.786=-0.006
max54.957-54.963=-0.006
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.138-0.139=-0.000
σ0.004-0.004=-0.000
min0.135-0.136=-0.001
max0.144-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.141-43.141=0.000
σ0.006-0.005=0.001
min43.131-43.133=-0.002
max43.152-43.147=0.005
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.121-0.122=-0.001
σ0.003-0.004=-0.000
min0.118-0.119=-0.001
max0.128-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.814-992.061=-0.247
σ1.263-1.259=0.004
min991.239-991.512=-0.273
max997.129-997.362=-0.233
mean1062.000-1067.450=-5.450
σ321.991-321.639=0.353
min566.000-575.000=-9.000
max1635.000-1631.000=4.000
mean1.542-1.531=0.011
σ0.104-0.092=0.012
min1.457-1.443=0.014
max1.837-1.752=0.085

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.409-285.674=-0.264
σ0.010-0.008=0.002
min285.396-285.662=-0.266
max285.421-285.682=-0.261
mean1635.000-1631.000=4.000
σ0.000
min1635.000-1631.000=4.000
max1635.000-1631.000=4.000
mean0.378-0.373=0.005
σ0.005-0.001=0.004
min0.375-0.372=0.003
max0.386-0.375=0.011
iters=5
new-facts=1
prior-facts=6402
mean1285.376-1285.639=-0.263
σ0.130-0.128=0.002
min1285.308-1285.574=-0.266
max1285.609-1285.869=-0.260
mean1635.000-1631.000=4.000
σ0.000
min1635.000-1631.000=4.000
max1635.000-1631.000=4.000
mean1.891-1.878=0.013
σ0.128-0.077=0.052
min1.802-1.786=0.016
max2.118-1.997=0.121
iters=5
new-facts=6402
prior-facts=1
mean1807.731-1807.976=-0.245
σ6.993-7.007=-0.014
min1804.368-1804.621=-0.253
max1820.225-1820.495=-0.271
mean1635.000-1631.000=4.000
σ0.000
min1635.000-1631.000=4.000
max1635.000-1631.000=4.000
mean4.249-4.196=0.053
σ0.174-0.171=0.003
min3.989-3.981=0.008
max4.435-4.449=-0.014
iters=5
new-facts=6402
prior-facts=6402
mean2070.196-2070.463=-0.267
σ0.007-0.008=-0.001
min2070.184-2070.455=-0.270
max2070.200-2070.476=-0.275
mean1831.800-1845.000=-13.200
σ169.767-194.170=-24.403
min1635.000-1631.000=4.000
max2068.000-2088.000=-20.000
mean4.506-4.500=0.006
σ0.048-0.045=0.003
min4.447-4.455=-0.008
max4.573-4.565=0.008

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.158-1.196=-0.039
σ0.265-0.330=-0.065
min0.912-0.912=-0.001
max1.590-1.753=-0.163

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.785-437.389=-0.604
σ572.364-572.363=0.000
min150.601-151.195=-0.594
max1295.330-1295.934=-0.604
mean90.250
σ8.500
min86.000
max103.000
mean1635.000-1631.000=4.000
σ0.000
min1635.000-1631.000=4.000
max1635.000-1631.000=4.000
mean0.530-0.525=0.005
σ0.562-0.560=0.002
min0.247-0.226=0.021
max1.373-1.365=0.008
policies=20
mean1506.277-1512.209=-5.932
σ0.234-0.246=-0.012
min1506.129-1512.051=-5.922
max1506.626-1512.576=-5.950
mean860.000
σ0.000
min860.000
max860.000
mean1635.000-1631.000=4.000
σ0.000
min1635.000-1631.000=4.000
max1635.000-1631.000=4.000
mean2.516-2.527=-0.012
σ0.052-0.019=0.033
min2.445-2.506=-0.060
max2.564-2.544=0.020
policies=200
mean15070.413-15129.738=-59.325
σ0.019-0.036=-0.018
min15070.394-15129.694=-59.300
max15070.434-15129.771=-59.337
mean8600.000
σ0.000
min8600.000
max8600.000
mean1635.000-1631.000=4.000
σ0.000
min1635.000-1631.000=4.000
max1635.000-1631.000=4.000
mean25.611-25.552=0.059
σ0.050-0.097=-0.047
min25.569-25.422=0.147
max25.680-25.642=0.038