Compare commits

Home / Compare 22586d5d .. 04e26a65

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean55.029-55.028=0.002
σ0.052-0.053=-0.001
min54.993-54.992=0.001
max55.173-55.174=-0.001
mean416.800-413.000=3.800
σ0.422-0.000=0.422
min416.000-413.000=3.000
max417.000-413.000=4.000
mean0.138-0.138=-0.000
σ0.004-0.004=0.001
min0.132-0.134=-0.002
max0.145-0.144=0.001
cache=y
dps=1
iters=10
policies=100
mean44.363-44.363=-0.001
σ0.003-0.003=0.000
min44.356-44.360=-0.005
max44.366-44.368=-0.002
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.120-0.122=-0.003
σ0.004-0.003=0.002
min0.110-0.120=-0.010
max0.126-0.128=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1767.297-1767.298=-0.001
σ0.365-0.366=-0.001
min1766.719-1766.718=0.001
max1767.885-1767.887=-0.003
mean1648.750-1614.050=34.700
σ619.673-594.380=25.294
min651.000-633.000=18.000
max2498.000-2413.000=85.000
mean2.371-2.369=0.002
σ0.086-0.082=0.004
min2.278-2.250=0.028
max2.656-2.513=0.142

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean350.826-350.826=0.001
σ0.071-0.069=0.001
min350.702-350.702=-0.000
max350.876-350.865=0.011
mean2498.000-2413.000=85.000
σ0.000
min2498.000-2413.000=85.000
max2498.000-2413.000=85.000
mean0.451-0.455=-0.004
σ0.001-0.006=-0.004
min0.449-0.449=-0.000
max0.453-0.463=-0.010
iters=5
new-facts=1
prior-facts=6402
mean2012.902-2012.895=0.007
σ0.014-0.017=-0.003
min2012.885-2012.868=0.016
max2012.922-2012.915=0.008
mean2498.000-2413.000=85.000
σ0.000
min2498.000-2413.000=85.000
max2498.000-2413.000=85.000
mean2.711-2.741=-0.030
σ0.039-0.138=-0.099
min2.666-2.632=0.034
max2.763-2.981=-0.218
iters=5
new-facts=6402
prior-facts=1
mean4837.895-4837.802=0.093
σ7.720-7.463=0.257
min4834.324-4834.315=0.009
max4851.704-4851.151=0.553
mean2498.000-2413.000=85.000
σ0.000
min2498.000-2413.000=85.000
max2498.000-2413.000=85.000
mean8.303-8.334=-0.030
σ0.441-0.552=-0.111
min8.017-7.706=0.311
max9.075-9.183=-0.108
iters=5
new-facts=6402
prior-facts=6402
mean5025.392-5025.395=-0.003
σ0.019-0.023=-0.004
min5025.372-5025.371=0.001
max5025.419-5025.426=-0.007
mean2906.000-3041.800=-135.800
σ379.189-326.044=53.145
min2498.000-2593.000=-95.000
max3425.000-3348.000=77.000
mean9.430-9.653=-0.223
σ0.577-0.295=0.282
min8.575-9.423=-0.848
max9.982-10.128=-0.145

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.556-1.679=-0.123
σ0.371-0.097=0.274
min0.939-1.566=-0.626
max1.796-1.786=0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean469.204-469.200=0.003
σ574.770-574.767=0.003
min181.813-181.815=-0.001
max1331.359-1331.351=0.008
mean90.250
σ8.500
min86.000
max103.000
mean2498.000-2413.000=85.000
σ0.000
min2498.000-2413.000=85.000
max2498.000-2413.000=85.000
mean0.564-0.570=-0.006
σ0.545-0.549=-0.004
min0.288-0.292=-0.004
max1.382-1.393=-0.011
policies=20
mean1818.491-1818.483=0.008
σ0.381-0.390=-0.010
min1818.239-1818.208=0.031
max1819.056-1819.057=-0.001
mean860.000
σ0.000
min860.000
max860.000
mean2498.000-2413.000=85.000
σ0.000
min2498.000-2413.000=85.000
max2498.000-2413.000=85.000
mean2.795-2.789=0.006
σ0.016-0.006=0.010
min2.784-2.782=0.002
max2.818-2.796=0.023
policies=200
mean18192.273-18192.285=-0.012
σ0.437-0.422=0.015
min18191.911-18191.980=-0.069
max18192.907-18192.897=0.011
mean8600.000
σ0.000
min8600.000
max8600.000
mean2498.000-2413.000=85.000
σ0.000
min2498.000-2413.000=85.000
max2498.000-2413.000=85.000
mean28.177-28.111=0.066
σ0.067-0.065=0.003
min28.096-28.064=0.032
max28.234-28.203=0.031