Compare commits

Home / Compare c08a631a .. e71ee0bb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.701-70.396=0.306
σ0.045-0.045=-0.001
min70.676-70.368=0.308
max70.823-70.519=0.303
mean424.000-413.000=11.000
σ0.000
min424.000-413.000=11.000
max424.000-413.000=11.000
mean0.160-0.157=0.003
σ0.003-0.003=-0.001
min0.158-0.154=0.004
max0.165-0.162=0.002
cache=y
dps=1
iters=10
policies=100
mean21.421-21.144=0.278
σ0.003-0.003=0.001
min21.417-21.140=0.277
max21.426-21.148=0.278
mean424.000-413.000=11.000
σ0.000
min424.000-413.000=11.000
max424.000-413.000=11.000
mean0.066-0.064=0.003
σ0.003-0.002=0.001
min0.064-0.062=0.001
max0.074-0.070=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.461-1752.696=1.765
σ0.361-0.364=-0.003
min1753.885-1752.137=1.748
max1755.041-1753.259=1.781
mean1681.000-1625.800=55.200
σ649.469-593.227=56.242
min634.000-633.000=1.000
max2874.000-2414.000=460.000
mean2.842-2.726=0.116
σ0.125-0.227=-0.102
min2.508-2.283=0.225
max3.033-3.131=-0.098

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.504-270.608=2.896
σ0.006-0.010=-0.004
min273.493-270.597=2.896
max273.510-270.622=2.888
mean2874.000-2414.000=460.000
σ0.000
min2874.000-2414.000=460.000
max2874.000-2414.000=460.000
mean0.377-0.378=-0.001
σ0.009-0.006=0.003
min0.372-0.369=0.002
max0.392-0.386=0.006
iters=5
new-facts=1
prior-facts=6402
mean1933.899-1931.040=2.859
σ0.011-0.010=0.001
min1933.881-1931.027=2.854
max1933.911-1931.049=2.862
mean2874.000-2414.000=460.000
σ0.000
min2874.000-2414.000=460.000
max2874.000-2414.000=460.000
mean2.929-2.989=-0.060
σ0.182-0.156=0.026
min2.738-2.749=-0.011
max3.152-3.162=-0.010
iters=5
new-facts=6402
prior-facts=1
mean4754.483-4751.806=2.677
σ0.971-0.827=0.144
min4753.846-4751.238=2.608
max4756.178-4753.265=2.914
mean2874.000-2414.000=460.000
σ0.000
min2874.000-2414.000=460.000
max2874.000-2414.000=460.000
mean8.399-8.153=0.246
σ0.508-0.626=-0.118
min7.740-7.711=0.029
max8.867-9.132=-0.265
iters=5
new-facts=6402
prior-facts=6402
mean4945.047-4942.160=2.887
σ0.162-0.165=-0.002
min4944.757-4941.868=2.889
max4945.128-4942.256=2.872
mean3083.000-2901.600=181.400
σ284.981-409.925=-124.944
min2874.000-2414.000=460.000
max3530.000-3448.000=82.000
mean8.488-8.396=0.092
σ0.139-0.050=0.090
min8.367-8.351=0.017
max8.674-8.465=0.209

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.107-1.887=-0.781
σ0.141-0.065=0.076
min0.924-1.828=-0.904
max1.252-1.997=-0.744

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.078-467.199=5.879
σ575.924-575.930=-0.006
min185.112-179.232=5.880
max1336.964-1331.094=5.870
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2874.000-2414.000=460.000
σ0.000
min2874.000-2414.000=460.000
max2874.000-2414.000=460.000
mean0.488-0.573=-0.085
σ0.382-0.582=-0.201
min0.293-0.280=0.013
max1.061-1.446=-0.386
policies=20
mean1851.445-1792.610=58.835
σ0.375-0.371=0.005
min1851.165-1792.362=58.803
max1851.991-1793.160=58.831
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2874.000-2414.000=460.000
σ0.000
min2874.000-2414.000=460.000
max2874.000-2414.000=460.000
mean2.941-2.812=0.129
σ0.009-0.056=-0.046
min2.928-2.774=0.154
max2.950-2.894=0.056
policies=200
mean18519.739-17933.032=586.707
σ0.801-0.495=0.306
min18518.910-17932.752=586.158
max18520.605-17933.772=586.833
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2874.000-2414.000=460.000
σ0.000
min2874.000-2414.000=460.000
max2874.000-2414.000=460.000
mean29.023-28.035=0.987
σ0.549-0.043=0.507
min28.633-27.988=0.646
max29.836-28.088=1.748