Compare commits

Home / Compare 9e272b82 .. 5980b17d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.913-54.431=-0.518
σ0.366-0.049=0.317
min53.778-54.394=-0.615
max54.955-54.566=0.389
mean416.800-412.000=4.800
σ0.422-0.000=0.422
min416.000-412.000=4.000
max417.000-412.000=5.000
mean0.136-0.136=0.000
σ0.006-0.005=0.001
min0.129-0.129=-0.000
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.142-43.762=-0.620
σ0.006-0.007=-0.001
min43.132-43.749=-0.618
max43.149-43.776=-0.627
mean417.000-412.200=4.800
σ0.000-0.422=-0.422
min417.000-412.000=5.000
max417.000-413.000=4.000
mean0.121-0.123=-0.002
σ0.003-0.008=-0.005
min0.118-0.115=0.003
max0.128-0.137=-0.010

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.815-1764.584=-772.769
σ1.242-0.364=0.878
min991.227-1764.008=-772.781
max997.032-1765.171=-768.139
mean1067.250-1628.700=-561.450
σ314.142-622.386=-308.244
min623.000-620.000=3.000
max1638.000-2762.000=-1124.000
mean1.543-2.667=-1.123
σ0.094-0.263=-0.169
min1.459-2.313=-0.854
max1.765-3.109=-1.344

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.416-344.929=-59.513
σ0.012-0.068=-0.056
min285.398-344.807=-59.409
max285.430-344.965=-59.535
mean1638.000-2762.000=-1124.000
σ0.000
min1638.000-2762.000=-1124.000
max1638.000-2762.000=-1124.000
mean0.382-0.458=-0.077
σ0.008-0.011=-0.003
min0.373-0.444=-0.071
max0.389-0.470=-0.081
iters=5
new-facts=1
prior-facts=6402
mean1285.359-2007.097=-721.738
σ0.090-0.010=0.080
min1285.316-2007.082=-721.766
max1285.520-2007.105=-721.585
mean1638.000-2762.000=-1124.000
σ0.000
min1638.000-2762.000=-1124.000
max1638.000-2762.000=-1124.000
mean2.061-2.734=-0.673
σ0.243-0.034=0.209
min1.860-2.685=-0.825
max2.400-2.766=-0.366
iters=5
new-facts=6402
prior-facts=1
mean1807.734-4831.981=-3024.247
σ6.993-7.747=-0.755
min1804.327-4828.427=-3024.100
max1820.227-4845.839=-3025.612
mean1638.000-2762.000=-1124.000
σ0.000
min1638.000-2762.000=-1124.000
max1638.000-2762.000=-1124.000
mean4.279-8.459=-4.180
σ0.336-0.549=-0.213
min3.783-7.846=-4.062
max4.680-9.154=-4.474
iters=5
new-facts=6402
prior-facts=6402
mean2070.191-5019.496=-2949.304
σ0.011-0.020=-0.009
min2070.184-5019.475=-2949.291
max2070.210-5019.521=-2949.311
mean1860.000-3004.200=-1144.200
σ196.306-299.670=-103.364
min1638.000-2762.000=-1124.000
max2086.000-3448.000=-1362.000
mean4.446-9.387=-4.940
σ0.120-0.527=-0.407
min4.252-8.619=-4.367
max4.565-9.913=-5.348

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.127-1.078=0.050
σ0.251-0.149=0.102
min0.908-0.927=-0.019
max1.507-1.327=0.180

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.787-466.131=-29.344
σ572.351-574.765=-2.414
min150.602-178.725=-28.123
max1295.314-1328.278=-32.964
mean90.250
σ8.500
min86.000
max103.000
mean1638.000-2762.000=-1124.000
σ0.000
min1638.000-2762.000=-1124.000
max1638.000-2762.000=-1124.000
mean0.529-0.501=0.028
σ0.556-0.445=0.111
min0.247-0.272=-0.025
max1.364-1.169=0.195
policies=20
mean1506.254-1787.532=-281.278
σ0.227-0.376=-0.149
min1506.107-1787.263=-281.156
max1506.593-1788.087=-281.494
mean860.000
σ0.000
min860.000
max860.000
mean1638.000-2762.000=-1124.000
σ0.000
min1638.000-2762.000=-1124.000
max1638.000-2762.000=-1124.000
mean2.511-2.743=-0.232
σ0.022-0.017=0.006
min2.487-2.719=-0.232
max2.535-2.756=-0.221
policies=200
mean15070.374-17882.835=-2812.461
σ0.057-0.490=-0.433
min15070.316-17882.502=-2812.186
max15070.434-17883.563=-2813.129
mean8600.000
σ0.000
min8600.000
max8600.000
mean1638.000-2762.000=-1124.000
σ0.000
min1638.000-2762.000=-1124.000
max1638.000-2762.000=-1124.000
mean25.458-27.785=-2.328
σ0.204-0.196=0.009
min25.254-27.607=-2.354
max25.642-28.053=-2.410