Compare commits

Home / Compare a00dd2c7 .. 9ccd0263

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.392-70.396=-0.004
σ0.042-0.047=-0.005
min70.367-70.370=-0.002
max70.510-70.524=-0.014
mean415.000-412.100=2.900
σ0.000-0.316=-0.316
min415.000-412.000=3.000
max415.000-413.000=2.000
mean0.160-0.157=0.003
σ0.002-0.005=-0.002
min0.158-0.149=0.008
max0.165-0.163=0.002
cache=y
dps=1
iters=10
policies=100
mean21.148-21.145=0.002
σ0.012-0.003=0.009
min21.141-21.140=0.000
max21.180-21.150=0.031
mean415.800-413.000=2.800
σ0.422-0.000=0.422
min415.000-413.000=2.000
max416.000-413.000=3.000
mean0.064-0.064=0.001
σ0.002-0.004=-0.002
min0.062-0.058=0.004
max0.070-0.074=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.697-1752.696=0.002
σ0.360-0.360=0.000
min1752.125-1752.123=0.002
max1753.287-1753.282=0.005
mean1634.000-1636.150=-2.150
σ592.563-613.738=-21.176
min626.000-624.000=2.000
max2424.000-2469.000=-45.000
mean2.763-2.717=0.047
σ0.184-0.179=0.005
min2.152-2.302=-0.150
max2.972-2.968=0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.610-270.610=0.000
σ0.007-0.008=-0.002
min270.600-270.602=-0.002
max270.618-270.620=-0.002
mean2424.000-2469.000=-45.000
σ0.000
min2424.000-2469.000=-45.000
max2424.000-2469.000=-45.000
mean0.378-0.381=-0.003
σ0.006-0.006=-0.001
min0.370-0.376=-0.006
max0.386-0.389=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1931.038-1931.042=-0.004
σ0.006-0.005=0.001
min1931.031-1931.037=-0.006
max1931.046-1931.047=-0.001
mean2424.000-2469.000=-45.000
σ0.000
min2424.000-2469.000=-45.000
max2424.000-2469.000=-45.000
mean2.983-3.012=-0.029
σ0.145-0.118=0.027
min2.747-2.862=-0.115
max3.127-3.182=-0.055
iters=5
new-facts=6402
prior-facts=1
mean4751.599-4751.807=-0.209
σ1.010-0.844=0.167
min4750.780-4751.208=-0.428
max4753.364-4753.289=0.075
mean2424.000-2469.000=-45.000
σ0.000
min2424.000-2469.000=-45.000
max2424.000-2469.000=-45.000
mean8.852-8.182=0.670
σ0.152-0.696=-0.544
min8.610-7.622=0.989
max9.015-9.248=-0.233
iters=5
new-facts=6402
prior-facts=6402
mean4942.232-4942.228=0.004
σ0.019-0.028=-0.009
min4942.209-4942.194=0.015
max4942.249-4942.255=-0.006
mean3022.800-2957.000=65.800
σ311.225-435.857=-124.633
min2604.000-2469.000=135.000
max3417.000-3541.000=-124.000
mean8.629-8.430=0.200
σ0.162-0.140=0.022
min8.447-8.313=0.135
max8.845-8.664=0.181

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.728-1.849=-0.121
σ0.232-0.055=0.177
min1.373-1.805=-0.432
max1.984-1.940=0.043

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.201-467.195=0.006
σ575.927-575.929=-0.001
min179.229-179.228=0.001
max1331.092-1331.088=0.004
mean86.250
σ8.500
min82.000
max99.000
mean2424.000-2469.000=-45.000
σ0.000
min2424.000-2469.000=-45.000
max2424.000-2469.000=-45.000
mean0.560-0.565=-0.006
σ0.556-0.583=-0.027
min0.280-0.265=0.015
max1.393-1.440=-0.047
policies=20
mean1792.607-1792.538=0.069
σ0.384-0.300=0.083
min1792.355-1792.348=0.007
max1793.178-1792.986=0.193
mean820.000
σ0.000
min820.000
max820.000
mean2424.000-2469.000=-45.000
σ0.000
min2424.000-2469.000=-45.000
max2424.000-2469.000=-45.000
mean2.785-2.774=0.012
σ0.015-0.025=-0.010
min2.763-2.746=0.017
max2.796-2.798=-0.002
policies=200
mean17933.081-17932.895=0.187
σ0.475-0.643=-0.169
min17932.779-17932.241=0.537
max17933.789-17933.782=0.007
mean8200.000
σ0.000
min8200.000
max8200.000
mean2424.000-2469.000=-45.000
σ0.000
min2424.000-2469.000=-45.000
max2424.000-2469.000=-45.000
mean28.054-28.040=0.014
σ0.067-0.122=-0.056
min27.986-27.966=0.020
max28.130-28.222=-0.093