Compare commits

Home / Compare 5e21ed3a .. 8f2dc02c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.646-53.647=-0.001
σ0.365-0.368=-0.002
min53.511-53.522=-0.011
max54.685-54.694=-0.008
mean416.300-413.000=3.300
σ0.483-0.000=0.483
min416.000-413.000=3.000
max417.000-413.000=4.000
mean0.139-0.138=0.001
σ0.003-0.004=-0.002
min0.135-0.135=0.000
max0.145-0.146=-0.002
cache=y
dps=1
iters=10
policies=100
mean42.943-42.945=-0.002
σ0.006-0.013=-0.007
min42.932-42.929=0.004
max42.952-42.976=-0.024
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.121-0.120=0.001
σ0.003-0.009=-0.005
min0.117-0.113=0.004
max0.127-0.143=-0.016

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.803-991.793=0.010
σ1.237-1.253=-0.016
min991.227-991.240=-0.012
max997.004-997.070=-0.066
mean1065.600-1069.050=-3.450
σ319.464-328.393=-8.928
min617.000-567.000=50.000
max1644.000-1643.000=1.000
mean1.544-1.540=0.004
σ0.102-0.102=-0.000
min1.453-1.420=0.033
max1.915-1.805=0.110

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.394-285.393=0.001
σ0.018-0.014=0.004
min285.368-285.372=-0.004
max285.412-285.406=0.006
mean1644.000-1643.000=1.000
σ0.000
min1644.000-1643.000=1.000
max1644.000-1643.000=1.000
mean0.379-0.378=0.001
σ0.006-0.009=-0.002
min0.374-0.373=0.001
max0.390-0.394=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1285.356-1285.356=-0.000
σ0.126-0.140=-0.014
min1285.297-1285.288=0.009
max1285.580-1285.605=-0.025
mean1644.000-1643.000=1.000
σ0.000
min1644.000-1643.000=1.000
max1644.000-1643.000=1.000
mean1.917-1.965=-0.048
σ0.056-0.139=-0.083
min1.877-1.807=0.070
max2.015-2.089=-0.074
iters=5
new-facts=6402
prior-facts=1
mean1807.688-1807.668=0.020
σ7.005-6.990=0.015
min1804.331-1804.291=0.040
max1820.202-1820.153=0.050
mean1644.000-1643.000=1.000
σ0.000
min1644.000-1643.000=1.000
max1644.000-1643.000=1.000
mean4.189-4.064=0.124
σ0.182-0.235=-0.053
min3.893-3.818=0.076
max4.369-4.384=-0.015
iters=5
new-facts=6402
prior-facts=6402
mean2070.181-2070.175=0.007
σ0.009-0.012=-0.002
min2070.171-2070.163=0.008
max2070.195-2070.194=0.002
mean1854.800-1855.600=-0.800
σ175.292-192.449=-17.158
min1644.000-1643.000=1.000
max2099.000-2077.000=22.000
mean4.506-4.523=-0.017
σ0.036-0.086=-0.050
min4.464-4.454=0.010
max4.555-4.665=-0.110

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.170-1.272=-0.103
σ0.302-0.352=-0.050
min0.916-0.917=-0.001
max1.687-1.827=-0.140

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.776-436.773=0.003
σ572.365-572.358=0.007
min150.591-150.589=0.002
max1295.323-1295.310=0.013
mean90.250
σ8.500
min86.000
max103.000
mean1644.000-1643.000=1.000
σ0.000
min1644.000-1643.000=1.000
max1644.000-1643.000=1.000
mean0.524-0.516=0.007
σ0.545-0.532=0.013
min0.248-0.247=0.001
max1.342-1.315=0.027
policies=20
mean1506.200-1506.172=0.029
σ0.235-0.247=-0.012
min1506.046-1506.007=0.039
max1506.550-1506.539=0.011
mean860.000
σ0.000
min860.000
max860.000
mean1644.000-1643.000=1.000
σ0.000
min1644.000-1643.000=1.000
max1644.000-1643.000=1.000
mean2.517-2.525=-0.008
σ0.012-0.018=-0.006
min2.501-2.505=-0.005
max2.528-2.549=-0.020
policies=200
mean15069.633-15069.533=0.100
σ0.480-0.045=0.435
min15068.917-15069.498=-0.581
max15069.934-15069.599=0.336
mean8600.000
σ0.000
min8600.000
max8600.000
mean1644.000-1643.000=1.000
σ0.000
min1644.000-1643.000=1.000
max1644.000-1643.000=1.000
mean25.518-25.431=0.087
σ0.207-0.085=0.122
min25.346-25.340=0.006
max25.787-25.514=0.273