Compare commits

Home / Compare 413c3a76 .. b4602ee5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-33.979=19.935
σ0.367-0.047=0.320
min53.780-33.950=19.830
max54.959-34.110=20.850
mean414.500-415.000=-0.500
σ0.527-0.000=0.527
min414.000-415.000=-1.000
max415.000
mean0.139-0.084=0.055
σ0.004-0.003=0.001
min0.135-0.082=0.053
max0.146-0.091=0.055
cache=y
dps=1
iters=10
policies=100
mean43.142-23.318=19.824
σ0.007-0.003=0.004
min43.130-23.314=19.816
max43.154-23.323=19.831
mean415.000
σ0.000
min415.000
max415.000
mean0.120-0.066=0.054
σ0.003-0.003=-0.000
min0.118-0.064=0.054
max0.127-0.073=0.054

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.811-1757.429=-765.617
σ1.228-0.365=0.864
min991.233-1756.854=-765.622
max996.973-1758.020=-761.047
mean1068.600-1659.250=-590.650
σ316.415-619.162=-302.748
min614.000-667.000=-53.000
max1631.000-2590.000=-959.000
mean1.506-2.377=-0.871
σ0.043-0.188=-0.145
min1.441-2.216=-0.775
max1.604-2.933=-1.329

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.410-326.580=-41.170
σ0.012-0.022=-0.010
min285.391-326.543=-41.152
max285.424-326.598=-41.175
mean1631.000-2590.000=-959.000
σ0.000
min1631.000-2590.000=-959.000
max1631.000-2590.000=-959.000
mean0.377-0.426=-0.049
σ0.007-0.005=0.002
min0.372-0.421=-0.048
max0.389-0.431=-0.042
iters=5
new-facts=1
prior-facts=6402
mean1285.378-1988.739=-703.361
σ0.136-0.014=0.122
min1285.309-1988.723=-703.414
max1285.620-1988.756=-703.136
mean1631.000-2590.000=-959.000
σ0.000
min1631.000-2590.000=-959.000
max1631.000-2590.000=-959.000
mean1.915-2.703=-0.788
σ0.166-0.131=0.035
min1.747-2.551=-0.804
max2.166-2.881=-0.715
iters=5
new-facts=6402
prior-facts=1
mean1807.700-4813.567=-3005.866
σ7.007-7.711=-0.704
min1804.308-4810.072=-3005.765
max1820.216-4827.360=-3007.143
mean1631.000-2590.000=-959.000
σ0.000
min1631.000-2590.000=-959.000
max1631.000-2590.000=-959.000
mean4.102-8.765=-4.663
σ0.298-0.310=-0.012
min3.702-8.269=-4.567
max4.438-9.042=-4.603
iters=5
new-facts=6402
prior-facts=6402
mean2070.195-5001.136=-2930.941
σ0.008-0.021=-0.013
min2070.185-5001.108=-2930.923
max2070.206-5001.160=-2930.954
mean1828.800-2995.400=-1166.600
σ170.894-266.079=-95.186
min1631.000-2608.000=-977.000
max2066.000-3316.000=-1250.000
mean4.528-9.604=-5.076
σ0.067-0.200=-0.133
min4.427-9.347=-4.920
max4.614-9.846=-5.232

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.150-1.233=-0.083
σ0.245-0.378=-0.133
min0.912-0.917=-0.005
max1.541-1.759=-0.219

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.784-464.562=-27.777
σ572.361-574.785=-2.423
min150.599-177.164=-26.565
max1295.327-1326.739=-31.412
mean90.250-88.250=2.000
σ8.500
min86.000-84.000=2.000
max103.000-101.000=2.000
mean1631.000-2590.000=-959.000
σ0.000
min1631.000-2590.000=-959.000
max1631.000-2590.000=-959.000
mean0.529-0.557=-0.029
σ0.562-0.575=-0.012
min0.244-0.269=-0.025
max1.372-1.419=-0.047
policies=20
mean1506.274-1772.002=-265.729
σ0.236-0.360=-0.124
min1506.120-1771.758=-265.637
max1506.625-1772.536=-265.911
mean860.000-840.000=20.000
σ0.000
min860.000-840.000=20.000
max860.000-840.000=20.000
mean1631.000-2590.000=-959.000
σ0.000
min1631.000-2590.000=-959.000
max1631.000-2590.000=-959.000
mean2.517-2.711=-0.194
σ0.009-0.011=-0.002
min2.506-2.700=-0.194
max2.529-2.726=-0.197
policies=200
mean15070.296-17727.482=-2657.187
σ0.099-0.548=-0.449
min15070.190-17727.073=-2656.883
max15070.415-17728.283=-2657.868
mean8600.000-8400.000=200.000
σ0.000
min8600.000-8400.000=200.000
max8600.000-8400.000=200.000
mean1631.000-2590.000=-959.000
σ0.000
min1631.000-2590.000=-959.000
max1631.000-2590.000=-959.000
mean25.521-27.462=-1.941
σ0.095-0.114=-0.019
min25.407-27.305=-1.898
max25.615-27.565=-1.950