Compare commits

Home / Compare fa328c72 .. 74912a6f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.702-70.698=0.004
σ0.046-0.045=0.001
min70.669-70.671=-0.002
max70.829-70.823=0.006
mean411.000-413.000=-2.000
σ0.000
min411.000-413.000=-2.000
max411.000-413.000=-2.000
mean0.160-0.159=0.001
σ0.006-0.005=0.001
min0.152-0.150=0.002
max0.169-0.168=0.001
cache=y
dps=1
iters=10
policies=100
mean21.408-21.409=-0.000
σ0.003-0.003=0.000
min21.405-21.404=0.001
max21.414-21.413=0.001
mean411.000-413.000=-2.000
σ0.000
min411.000-413.000=-2.000
max411.000-413.000=-2.000
mean0.066-0.062=0.003
σ0.002-0.004=-0.002
min0.064-0.058=0.006
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.930-1754.895=0.036
σ0.359-0.358=0.001
min1754.361-1754.338=0.023
max1755.514-1755.479=0.035
mean1658.050-1624.350=33.700
σ621.179-606.116=15.063
min621.000-661.000=-40.000
max2509.000-2435.000=74.000
mean2.803-2.823=-0.020
σ0.156-0.135=0.021
min2.355-2.502=-0.147
max2.956-3.073=-0.117

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.759-272.756=0.003
σ0.004-0.005=-0.001
min272.753-272.749=0.004
max272.762-272.762=0.000
mean2509.000-2435.000=74.000
σ0.000
min2509.000-2435.000=74.000
max2509.000-2435.000=74.000
mean0.390-0.384=0.006
σ0.016-0.005=0.011
min0.378-0.379=-0.001
max0.414-0.392=0.021
iters=5
new-facts=1
prior-facts=6402
mean1933.164-1933.129=0.035
σ0.014-0.006=0.008
min1933.143-1933.119=0.024
max1933.177-1933.135=0.042
mean2509.000-2435.000=74.000
σ0.000
min2509.000-2435.000=74.000
max2509.000-2435.000=74.000
mean2.992-2.919=0.073
σ0.093-0.159=-0.066
min2.834-2.666=0.167
max3.075-3.104=-0.029
iters=5
new-facts=6402
prior-facts=1
mean4756.908-4753.669=3.239
σ7.562-1.122=6.441
min4753.449-4752.388=1.061
max4770.435-4755.481=14.955
mean2509.000-2435.000=74.000
σ0.000
min2509.000-2435.000=74.000
max2509.000-2435.000=74.000
mean8.655-8.504=0.151
σ0.373-0.403=-0.030
min8.219-7.902=0.316
max9.074-8.936=0.138
iters=5
new-facts=6402
prior-facts=6402
mean4944.395-4944.362=0.032
σ0.015-0.020=-0.005
min4944.375-4944.339=0.035
max4944.409-4944.390=0.019
mean2927.600-2957.800=-30.200
σ368.141-268.448=99.693
min2509.000-2594.000=-85.000
max3427.000-3305.000=122.000
mean8.448-8.494=-0.046
σ0.129-0.116=0.013
min8.347-8.398=-0.051
max8.666-8.684=-0.019

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.629-1.720=-0.091
σ0.247-0.207=0.040
min1.230-1.469=-0.239
max1.813-1.911=-0.099

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.319-468.632=-0.314
σ574.258-574.882=-0.624
min181.186-181.184=0.003
max1329.706-1330.956=-1.250
mean88.250
σ8.500
min84.000
max101.000
mean2509.000-2435.000=74.000
σ0.000
min2509.000-2435.000=74.000
max2509.000-2435.000=74.000
mean0.564-0.564=0.001
σ0.560-0.554=0.006
min0.282-0.282=-0.000
max1.404-1.394=0.010
policies=20
mean1812.186-1812.169=0.017
σ0.393-0.385=0.008
min1811.930-1811.914=0.016
max1812.767-1812.738=0.029
mean840.000
σ0.000
min840.000
max840.000
mean2509.000-2435.000=74.000
σ0.000
min2509.000-2435.000=74.000
max2509.000-2435.000=74.000
mean2.838-2.823=0.014
σ0.040-0.014=0.026
min2.810-2.812=-0.002
max2.897-2.841=0.055
policies=200
mean18128.910-18129.218=-0.307
σ0.568-0.476=0.092
min18128.451-18128.914=-0.463
max18129.736-18129.927=-0.192
mean8400.000
σ0.000
min8400.000
max8400.000
mean2509.000-2435.000=74.000
σ0.000
min2509.000-2435.000=74.000
max2509.000-2435.000=74.000
mean28.440-28.635=-0.195
σ0.069-0.031=0.038
min28.353-28.591=-0.238
max28.521-28.662=-0.141