Compare commits

Home / Compare 6cdb6bcb .. 23d31ef0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.397-70.392=0.005
σ0.047-0.045=0.002
min70.371-70.370=0.001
max70.526-70.519=0.007
mean414.800-410.200=4.600
σ0.422
min414.000-410.000=4.000
max415.000-411.000=4.000
mean0.158-0.160=-0.002
σ0.005-0.003=0.002
min0.150-0.158=-0.008
max0.164-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.145-21.147=-0.002
σ0.003-0.012=-0.009
min21.140-21.140=0.000
max21.150-21.181=-0.031
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.064-0.062=0.002
σ0.002-0.004=-0.002
min0.063-0.058=0.005
max0.070-0.070=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.699-1752.697=0.002
σ0.360-0.358=0.002
min1752.128-1752.129=-0.001
max1753.286-1753.264=0.023
mean1661.100-1657.600=3.500
σ638.539-628.909=9.630
min690.000-615.000=75.000
max2771.000-2764.000=7.000
mean2.761-2.736=0.025
σ0.220-0.242=-0.022
min2.286-2.143=0.143
max3.163-3.077=0.085

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.608-270.608=0.000
σ0.006-0.004=0.001
min270.599-270.601=-0.002
max270.613-270.611=0.002
mean2771.000-2764.000=7.000
σ0.000
min2771.000-2764.000=7.000
max2771.000-2764.000=7.000
mean0.378-0.378=-0.000
σ0.002-0.001=0.001
min0.374-0.377=-0.003
max0.380-0.379=0.001
iters=5
new-facts=1
prior-facts=6402
mean1931.046-1931.044=0.002
σ0.008-0.011=-0.003
min1931.036-1931.032=0.004
max1931.058-1931.061=-0.003
mean2771.000-2764.000=7.000
σ0.000
min2771.000-2764.000=7.000
max2771.000-2764.000=7.000
mean2.909-3.014=-0.105
σ0.084-0.148=-0.064
min2.780-2.827=-0.047
max2.978-3.192=-0.214
iters=5
new-facts=6402
prior-facts=1
mean4751.843-4751.604=0.239
σ0.795-1.009=-0.214
min4751.423-4750.807=0.616
max4753.263-4753.372=-0.108
mean2771.000-2764.000=7.000
σ0.000
min2771.000-2764.000=7.000
max2771.000-2764.000=7.000
mean7.899-8.778=-0.880
σ0.306-0.552=-0.246
min7.649-7.823=-0.173
max8.405-9.172=-0.767
iters=5
new-facts=6402
prior-facts=6402
mean4942.234-4942.161=0.073
σ0.023-0.167=-0.145
min4942.202-4941.863=0.340
max4942.255-4942.255=0.001
mean3007.000-3050.800=-43.800
σ294.585-274.494=20.091
min2771.000-2764.000=7.000
max3462.000-3432.000=30.000
mean8.380-8.604=-0.224
σ0.043-0.161=-0.118
min8.331-8.366=-0.035
max8.426-8.812=-0.386

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.049-1.030=0.020
σ0.139-0.216=-0.077
min0.918-0.929=-0.012
max1.260-1.416=-0.156

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.204-467.205=-0.000
σ575.929-575.929=-0.000
min179.237-179.231=0.006
max1331.098-1331.099=-0.001
mean86.250
σ8.500
min82.000
max99.000
mean2771.000-2764.000=7.000
σ0.000
min2771.000-2764.000=7.000
max2771.000-2764.000=7.000
mean0.445-0.478=-0.034
σ0.302-0.391=-0.089
min0.290-0.281=0.009
max0.897-1.065=-0.168
policies=20
mean1792.645-1792.621=0.024
σ0.351-0.367=-0.016
min1792.388-1792.417=-0.029
max1793.153-1793.170=-0.017
mean820.000
σ0.000
min820.000
max820.000
mean2771.000-2764.000=7.000
σ0.000
min2771.000-2764.000=7.000
max2771.000-2764.000=7.000
mean2.844-2.797=0.047
σ0.107-0.027=0.080
min2.783-2.774=0.009
max3.004-2.836=0.168
policies=200
mean17932.918-17932.930=-0.011
σ0.565-0.472=0.093
min17932.618-17932.567=0.052
max17933.765-17933.618=0.148
mean8200.000
σ0.000
min8200.000
max8200.000
mean2771.000-2764.000=7.000
σ0.000
min2771.000-2764.000=7.000
max2771.000-2764.000=7.000
mean28.172-28.100=0.072
σ0.231-0.200=0.030
min27.958-27.935=0.022
max28.477-28.374=0.104