Compare commits

Home / Compare 75500c48 .. 53fe5e20

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.696-70.698=-0.002
σ0.046-0.045=0.002
min70.670-70.673=-0.002
max70.826-70.821=0.005
mean413.900-413.000=0.900
σ0.316-0.000=0.316
min413.000
max414.000-413.000=1.000
mean0.158-0.157=0.001
σ0.005-0.005=0.000
min0.151-0.152=-0.000
max0.165-0.163=0.002
cache=y
dps=1
iters=10
policies=100
mean21.421-21.421=0.000
σ0.002-0.003=-0.000
min21.418-21.417=0.001
max21.424-21.424=0.000
mean414.000-413.800=0.200
σ0.000-0.422=-0.422
min414.000-413.000=1.000
max414.000
mean0.065-0.064=0.001
σ0.003-0.004=-0.001
min0.061-0.060=0.001
max0.071-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.458-1754.459=-0.001
σ0.361-0.362=-0.001
min1753.889-1753.889=0.000
max1755.035-1755.053=-0.018
mean1642.050-1643.650=-1.600
σ627.502-627.749=-0.247
min623.000-624.000=-1.000
max2850.000-2851.000=-1.000
mean2.765-2.804=-0.039
σ0.204-0.143=0.061
min2.267-2.500=-0.233
max3.044-3.026=0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.503-273.502=0.000
σ0.007-0.005=0.003
min273.495-273.497=-0.002
max273.514-273.510=0.004
mean2850.000-2851.000=-1.000
σ0.000
min2850.000-2851.000=-1.000
max2850.000-2851.000=-1.000
mean0.376-0.378=-0.001
σ0.006-0.005=0.000
min0.372-0.373=-0.001
max0.386-0.384=0.002
iters=5
new-facts=1
prior-facts=6402
mean1933.901-1933.892=0.009
σ0.009-0.011=-0.002
min1933.893-1933.878=0.015
max1933.914-1933.908=0.006
mean2850.000-2851.000=-1.000
σ0.000
min2850.000-2851.000=-1.000
max2850.000-2851.000=-1.000
mean2.949-3.006=-0.056
σ0.172-0.055=0.117
min2.675-2.941=-0.266
max3.148-3.084=0.064
iters=5
new-facts=6402
prior-facts=1
mean4754.534-4754.734=-0.201
σ0.984-0.796=0.189
min4753.681-4754.307=-0.626
max4756.237-4756.155=0.082
mean2850.000-2851.000=-1.000
σ0.000
min2850.000-2851.000=-1.000
max2850.000-2851.000=-1.000
mean8.664-7.932=0.732
σ0.225-0.343=-0.117
min8.414-7.676=0.738
max8.947-8.530=0.417
iters=5
new-facts=6402
prior-facts=6402
mean4945.050-4944.972=0.077
σ0.165-0.189=-0.024
min4944.757-4944.756=0.001
max4945.144-4945.123=0.021
mean3058.600-3056.800=1.800
σ226.190-286.815=-60.625
min2850.000-2851.000=-1.000
max3397.000-3510.000=-113.000
mean8.604-8.462=0.142
σ0.166-0.167=-0.000
min8.425-8.334=0.091
max8.871-8.729=0.142

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.999-1.056=-0.056
σ0.139-0.134=0.005
min0.936-0.933=0.004
max1.248-1.259=-0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.071-473.080=-0.008
σ575.912-575.910=0.002
min185.111-185.122=-0.011
max1336.939-1336.945=-0.005
mean88.250
σ8.500
min84.000
max101.000
mean2850.000-2851.000=-1.000
σ0.000
min2850.000-2851.000=-1.000
max2850.000-2851.000=-1.000
mean0.483-0.488=-0.005
σ0.368-0.373=-0.004
min0.292-0.296=-0.004
max1.035-1.046=-0.011
policies=20
mean1851.457-1851.456=0.001
σ0.378-0.373=0.005
min1851.163-1851.177=-0.014
max1852.003-1851.998=0.006
mean840.000
σ0.000
min840.000
max840.000
mean2850.000-2851.000=-1.000
σ0.000
min2850.000-2851.000=-1.000
max2850.000-2851.000=-1.000
mean2.961-2.954=0.007
σ0.024-0.017=0.007
min2.934-2.937=-0.002
max2.987-2.977=0.010
policies=200
mean18519.755-18519.918=-0.164
σ0.839-0.765=0.074
min18519.065-18519.271=-0.206
max18520.895-18520.859=0.036
mean8400.000
σ0.000
min8400.000
max8400.000
mean2850.000-2851.000=-1.000
σ0.000
min2850.000-2851.000=-1.000
max2850.000-2851.000=-1.000
mean29.110-29.150=-0.041
σ0.437-0.384=0.052
min28.747-28.910=-0.163
max29.724-29.724=-0.000