Compare commits

Home / Compare ea18de99 .. 6d111cc0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.618=0.001
σ0.055-0.055=0.001
min35.591-35.588=0.003
max35.775-35.772=0.003
mean419.000-411.000=8.000
σ0.000
min419.000-411.000=8.000
max419.000-411.000=8.000
mean0.085-0.081=0.003
σ0.004-0.004=-0.001
min0.079-0.077=0.003
max0.092-0.089=0.003
cache=y
dps=1
iters=10
policies=100
mean24.047-24.048=-0.001
σ0.002-0.002=-0.000
min24.044-24.045=-0.001
max24.050-24.052=-0.002
mean419.000-411.000=8.000
σ0.000
min419.000-411.000=8.000
max419.000-411.000=8.000
mean0.068-0.067=0.001
σ0.003-0.001=0.003
min0.061-0.066=-0.005
max0.075-0.068=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.492-1756.490=0.001
σ0.365-0.364=0.001
min1755.915-1755.917=-0.002
max1757.081-1757.071=0.010
mean1634.100-1643.850=-9.750
σ595.627-633.298=-37.670
min664.000-618.000=46.000
max2436.000-2828.000=-392.000
mean2.312-2.311=0.001
σ0.093-0.053=0.040
min2.137-2.212=-0.075
max2.508-2.417=0.091

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.774-324.761=0.013
σ0.029-0.042=-0.013
min324.726-324.692=0.033
max324.800-324.790=0.010
mean2436.000-2828.000=-392.000
σ0.000
min2436.000-2828.000=-392.000
max2436.000-2828.000=-392.000
mean0.424-0.423=0.001
σ0.010-0.010=-0.000
min0.416-0.415=0.001
max0.436-0.438=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1985.313-1985.326=-0.014
σ0.020-0.007=0.013
min1985.281-1985.319=-0.038
max1985.330-1985.334=-0.004
mean2436.000-2828.000=-392.000
σ0.000
min2436.000-2828.000=-392.000
max2436.000-2828.000=-392.000
mean2.635-2.593=0.043
σ0.116-0.078=0.038
min2.520-2.501=0.020
max2.771-2.701=0.070
iters=5
new-facts=6402
prior-facts=1
mean4809.104-4808.986=0.118
σ7.695-7.777=-0.081
min4805.552-4805.075=0.477
max4822.869-4822.889=-0.021
mean2436.000-2828.000=-392.000
σ0.000
min2436.000-2828.000=-392.000
max2436.000-2828.000=-392.000
mean9.095-8.992=0.103
σ0.301-0.326=-0.025
min8.774-8.568=0.207
max9.590-9.418=0.172
iters=5
new-facts=6402
prior-facts=6402
mean4996.617-4996.631=-0.014
σ0.031-0.017=0.014
min4996.573-4996.612=-0.039
max4996.651-4996.646=0.005
mean2961.400-3036.200=-74.800
σ430.290-216.703=213.587
min2469.000-2828.000=-359.000
max3540.000-3345.000=195.000
mean8.516-8.611=-0.095
σ0.133-0.097=0.036
min8.373-8.507=-0.134
max8.735-8.739=-0.005

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.628-0.927=0.702
σ0.216-0.011=0.205
min1.262-0.919=0.342
max1.795-0.945=0.850

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.203-463.214=-0.012
σ574.764-574.778=-0.015
min175.815-175.817=-0.002
max1325.348-1325.382=-0.034
mean86.250
σ8.500
min82.000
max99.000
mean2436.000-2828.000=-392.000
σ0.000
min2436.000-2828.000=-392.000
max2436.000-2828.000=-392.000
mean0.549-0.427=0.123
σ0.550-0.289=0.262
min0.271-0.276=-0.005
max1.375-0.859=0.515
policies=20
mean1758.467-1758.535=-0.069
σ0.321-0.345=-0.024
min1758.264-1758.315=-0.051
max1758.944-1759.047=-0.103
mean820.000
σ0.000
min820.000
max820.000
mean2436.000-2828.000=-392.000
σ0.000
min2436.000-2828.000=-392.000
max2436.000-2828.000=-392.000
mean2.700-2.787=-0.086
σ0.009-0.006=0.003
min2.691-2.778=-0.088
max2.712-2.792=-0.079
policies=200
mean17592.005-17592.064=-0.059
σ0.445-0.466=-0.021
min17591.606-17591.564=0.042
max17592.635-17592.690=-0.055
mean8200.000
σ0.000
min8200.000
max8200.000
mean2436.000-2828.000=-392.000
σ0.000
min2436.000-2828.000=-392.000
max2436.000-2828.000=-392.000
mean27.394-27.833=-0.438
σ0.132-0.403=-0.271
min27.279-27.482=-0.203
max27.559-28.212=-0.654