Compare commits

Home / Compare b1de13d1 .. c8a33108

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-30.958=39.416
σ0.059-0.049=0.010
min70.334-30.917=39.417
max70.540-31.093=39.447
mean414.000
σ0.000
min414.000
max414.000
mean0.158-0.077=0.081
σ0.006-0.004=0.002
min0.149-0.071=0.078
max0.168-0.085=0.083
cache=y
dps=1
iters=10
policies=100
mean21.143-21.060=0.083
σ0.002-0.003=-0.001
min21.140-21.056=0.084
max21.146-21.064=0.082
mean414.000
σ0.000
min414.000
max414.000
mean0.064-0.061=0.003
σ0.003-0.004=-0.001
min0.057-0.057=0.001
max0.069-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.197-1751.412=0.785
σ0.362-0.362=0.000
min1751.632-1750.842=0.790
max1752.761-1752.006=0.756
mean1640.800-1633.450=7.350
σ613.662-609.898=3.763
min629.000-648.000=-19.000
max2470.000-2451.000=19.000
mean2.841-2.853=-0.012
σ0.122-0.181=-0.059
min2.603-2.300=0.303
max3.032-3.263=-0.231

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.934-273.402=-3.468
σ0.006-0.010=-0.004
min269.927-273.392=-3.466
max269.943-273.417=-3.474
mean2470.000-2451.000=19.000
σ0.000
min2470.000-2451.000=19.000
max2470.000-2451.000=19.000
mean0.382-0.383=-0.002
σ0.011-0.008=0.003
min0.372-0.376=-0.004
max0.400-0.392=0.008
iters=5
new-facts=1
prior-facts=6402
mean1930.386-1933.832=-3.446
σ0.025-0.012=0.014
min1930.357-1933.812=-3.456
max1930.411-1933.843=-3.432
mean2470.000-2451.000=19.000
σ0.000
min2470.000-2451.000=19.000
max2470.000-2451.000=19.000
mean2.566-3.044=-0.478
σ0.161-0.192=-0.031
min2.406-2.732=-0.326
max2.830-3.238=-0.407
iters=5
new-facts=6402
prior-facts=1
mean4750.851-4754.335=-3.484
σ0.810-0.848=-0.039
min4750.338-4753.789=-3.451
max4752.278-4755.841=-3.563
mean2470.000-2451.000=19.000
σ0.000
min2470.000-2451.000=19.000
max2470.000-2451.000=19.000
mean8.637-8.676=-0.038
σ0.224-0.504=-0.280
min8.411-7.804=0.607
max8.925-9.058=-0.134
iters=5
new-facts=6402
prior-facts=6402
mean4941.332-4944.799=-3.467
σ0.084-0.092=-0.009
min4941.259-4944.720=-3.461
max4941.426-4944.909=-3.483
mean2961.600-2986.600=-25.000
σ272.859-351.799=-78.940
min2595.000-2485.000=110.000
max3316.000-3294.000=22.000
mean8.450-8.733=-0.283
σ0.032-0.307=-0.275
min8.411-8.435=-0.023
max8.495-9.082=-0.587

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.850-1.897=-0.047
σ0.033-0.092=-0.059
min1.813-1.776=0.036
max1.885-1.993=-0.108

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.903-463.331=2.571
σ575.758-572.199=3.559
min178.022-177.230=0.792
max1329.540-1321.630=7.910
mean81.750-79.750=2.000
σ7.500
min78.000-76.000=2.000
max93.000-91.000=2.000
mean2470.000-2451.000=19.000
σ0.000
min2470.000-2451.000=19.000
max2470.000-2451.000=19.000
mean0.550-0.571=-0.021
σ0.531-0.569=-0.038
min0.269-0.283=-0.014
max1.346-1.424=-0.078
policies=20
mean1780.452-1772.579=7.874
σ0.356-0.334=0.023
min1780.213-1772.354=7.859
max1780.981-1773.071=7.909
mean780.000-760.000=20.000
σ0.000
min780.000-760.000=20.000
max780.000-760.000=20.000
mean2470.000-2451.000=19.000
σ0.000
min2470.000-2451.000=19.000
max2470.000-2451.000=19.000
mean2.767-2.727=0.040
σ0.015-0.010=0.005
min2.751-2.722=0.029
max2.784-2.742=0.042
policies=200
mean17811.215-17732.401=78.814
σ0.409-0.436=-0.027
min17810.906-17732.102=78.804
max17811.818-17733.035=78.782
mean7800.000-7600.000=200.000
σ0.000
min7800.000-7600.000=200.000
max7800.000-7600.000=200.000
mean2470.000-2451.000=19.000
σ0.000
min2470.000-2451.000=19.000
max2470.000-2451.000=19.000
mean27.927-27.722=0.205
σ0.109-0.188=-0.080
min27.833-27.598=0.235
max28.051-27.997=0.054