Compare commits

Home / Compare f04197d3 .. 7ebbd455

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.646-53.914=-0.267
σ0.367-0.368=-0.002
min53.516-53.784=-0.268
max54.690-54.962=-0.272
mean414.600-417.400=-2.800
σ0.516
min414.000-417.000=-3.000
max415.000-418.000=-3.000
mean0.136-0.137=-0.001
σ0.005-0.003=0.002
min0.127-0.131=-0.003
max0.144-0.142=0.002
cache=y
dps=1
iters=10
policies=100
mean42.942-43.141=-0.199
σ0.006-0.007=-0.000
min42.932-43.129=-0.197
max42.951-43.154=-0.203
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.121-0.122=-0.001
σ0.003-0.004=-0.000
min0.118-0.117=0.001
max0.127-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.810-991.812=-0.002
σ1.240-1.256=-0.017
min991.222-991.233=-0.011
max997.015-997.099=-0.084
mean1071.350-1071.900=-0.550
σ319.412-321.152=-1.739
min613.000-574.000=39.000
max1634.000-1636.000=-2.000
mean1.511-1.514=-0.003
σ0.058-0.068=-0.009
min1.347-1.392=-0.045
max1.608-1.725=-0.117

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.386-285.412=-0.026
σ0.011-0.006=0.005
min285.371-285.405=-0.035
max285.398-285.421=-0.023
mean1634.000-1636.000=-2.000
σ0.000
min1634.000-1636.000=-2.000
max1634.000-1636.000=-2.000
mean0.375-0.381=-0.006
σ0.010-0.008=0.002
min0.366-0.374=-0.008
max0.386-0.391=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1285.351-1285.370=-0.019
σ0.130-0.121=0.009
min1285.287-1285.309=-0.022
max1285.584-1285.587=-0.003
mean1634.000-1636.000=-2.000
σ0.000
min1634.000-1636.000=-2.000
max1634.000-1636.000=-2.000
mean1.942-1.967=-0.025
σ0.164-0.114=0.050
min1.850-1.880=-0.030
max2.235-2.121=0.114
iters=5
new-facts=6402
prior-facts=1
mean1807.667-1807.708=-0.041
σ7.014-7.012=0.002
min1804.316-1804.384=-0.069
max1820.198-1820.239=-0.042
mean1634.000-1636.000=-2.000
σ0.000
min1634.000-1636.000=-2.000
max1634.000-1636.000=-2.000
mean4.149-4.203=-0.053
σ0.185-0.327=-0.142
min3.983-3.841=0.142
max4.445-4.490=-0.044
iters=5
new-facts=6402
prior-facts=6402
mean2070.180-2070.200=-0.021
σ0.007-0.008=-0.001
min2070.168-2070.195=-0.027
max2070.187-2070.215=-0.028
mean1832.400-1834.800=-2.400
σ170.638-173.601=-2.963
min1634.000-1636.000=-2.000
max2068.000-2070.000=-2.000
mean4.588-4.548=0.040
σ0.082-0.034=0.048
min4.504-4.510=-0.005
max4.720-4.588=0.132

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.206-1.221=-0.015
σ0.327-0.284=0.044
min0.914-0.918=-0.004
max1.757-1.526=0.231

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.774-436.787=-0.013
σ572.365-572.359=0.006
min150.586-150.600=-0.014
max1295.322-1295.325=-0.003
mean90.250
σ8.500
min86.000
max103.000
mean1634.000-1636.000=-2.000
σ0.000
min1634.000-1636.000=-2.000
max1634.000-1636.000=-2.000
mean0.521-0.517=0.004
σ0.541-0.555=-0.014
min0.250-0.234=0.016
max1.332-1.349=-0.017
policies=20
mean1506.155-1506.241=-0.086
σ0.233-0.241=-0.008
min1505.997-1506.078=-0.081
max1506.500-1506.598=-0.098
mean860.000
σ0.000
min860.000
max860.000
mean1634.000-1636.000=-2.000
σ0.000
min1634.000-1636.000=-2.000
max1634.000-1636.000=-2.000
mean2.507-2.517=-0.010
σ0.018-0.030=-0.012
min2.484-2.485=-0.001
max2.525-2.556=-0.031
policies=200
mean15069.487-15070.350=-0.864
σ0.111-0.105=0.006
min15069.357-15070.226=-0.869
max15069.591-15070.460=-0.869
mean8600.000
σ0.000
min8600.000
max8600.000
mean1634.000-1636.000=-2.000
σ0.000
min1634.000-1636.000=-2.000
max1634.000-1636.000=-2.000
mean25.457-25.507=-0.050
σ0.085-0.117=-0.032
min25.357-25.405=-0.047
max25.541-25.615=-0.075