Compare commits

Home / Compare 08eaec08 .. 10b303f1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean92.512-92.510=0.001
σ0.053-0.053=0.000
min92.464-92.466=-0.002
max92.654-92.652=0.002
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.216-0.215=0.001
σ0.004-0.003=0.001
min0.210-0.210=0.000
max0.221-0.219=0.002
cache=y
dps=1
iters=10
policies=100
mean43.128-43.128=-0.000
σ0.009-0.008=0.000
min43.116-43.116=0.000
max43.140-43.137=0.003
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.116-0.116=-0.000
σ0.002-0.004=-0.002
min0.114-0.111=0.003
max0.123-0.123=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1761.427-1761.424=0.002
σ0.362-0.358=0.004
min1760.857-1760.852=0.005
max1762.012-1761.998=0.013
mean1653.400-1654.500=-1.100
σ632.006-636.558=-4.552
min654.000-632.000=22.000
max2826.000-2778.000=48.000
mean2.547-2.621=-0.075
σ0.345-0.347=-0.003
min2.172-2.190=-0.018
max3.168-3.283=-0.115

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean328.787-328.789=-0.002
σ0.068-0.061=0.006
min328.667-328.680=-0.014
max328.823-328.820=0.002
mean2826.000-2778.000=48.000
σ0.000
min2826.000-2778.000=48.000
max2826.000-2778.000=48.000
mean0.433-0.434=-0.001
σ0.002-0.001=0.000
min0.431-0.433=-0.001
max0.435-0.437=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1989.330-1989.318=0.012
σ0.005-0.015=-0.010
min1989.324-1989.300=0.024
max1989.334-1989.340=-0.005
mean2826.000-2778.000=48.000
σ0.000
min2826.000-2778.000=48.000
max2826.000-2778.000=48.000
mean3.003-3.078=-0.075
σ0.085-0.097=-0.012
min2.893-2.974=-0.081
max3.093-3.234=-0.141
iters=5
new-facts=6402
prior-facts=1
mean4813.035-4813.027=0.007
σ7.794-7.842=-0.048
min4809.453-4809.458=-0.005
max4826.976-4827.055=-0.079
mean2826.000-2778.000=48.000
σ0.000
min2826.000-2778.000=48.000
max2826.000-2778.000=48.000
mean8.562-8.877=-0.315
σ0.453-0.356=0.097
min7.971-8.467=-0.496
max9.223-9.432=-0.209
iters=5
new-facts=6402
prior-facts=6402
mean5000.585-5000.516=0.069
σ0.025-0.161=-0.135
min5000.562-5000.229=0.333
max5000.615-5000.602=0.013
mean3028.200-2993.800=34.400
σ205.096-216.242=-11.147
min2826.000-2778.000=48.000
max3309.000-3310.000=-1.000
mean8.828-8.586=0.242
σ0.293-0.069=0.225
min8.559-8.478=0.081
max9.284-8.662=0.622

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.038-1.068=-0.030
σ0.191-0.263=-0.072
min0.925-0.920=0.005
max1.368-1.529=-0.161

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean470.840-470.836=0.004
σ574.236-574.246=-0.010
min183.716-183.710=0.007
max1332.194-1332.205=-0.011
mean90.250
σ8.500
min86.000
max103.000
mean2826.000-2778.000=48.000
σ0.000
min2826.000-2778.000=48.000
max2826.000-2778.000=48.000
mean0.448-0.487=-0.039
σ0.303-0.381=-0.078
min0.294-0.295=-0.001
max0.902-1.058=-0.156
policies=20
mean1837.450-1837.426=0.024
σ0.400-0.396=0.005
min1837.158-1837.139=0.020
max1838.035-1838.006=0.029
mean860.000
σ0.000
min860.000
max860.000
mean2826.000-2778.000=48.000
σ0.000
min2826.000-2778.000=48.000
max2826.000-2778.000=48.000
mean2.937-2.925=0.012
σ0.008-0.012=-0.004
min2.929-2.910=0.019
max2.948-2.941=0.007
policies=200
mean18381.313-18381.412=-0.099
σ0.591-0.430=0.161
min18381.014-18381.140=-0.126
max18382.199-18382.051=0.147
mean8600.000
σ0.000
min8600.000
max8600.000
mean2826.000-2778.000=48.000
σ0.000
min2826.000-2778.000=48.000
max2826.000-2778.000=48.000
mean29.275-28.813=0.461
σ0.383-0.292=0.091
min28.904-28.584=0.320
max29.662-29.237=0.425