Compare commits

Home / Compare 5cb4447f .. d956f5b6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-33.979=19.936
σ0.366-0.050=0.315
min53.781-33.947=19.834
max54.956-34.119=20.837
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.137-0.084=0.053
σ0.006-0.003=0.002
min0.129-0.082=0.048
max0.148-0.091=0.056
cache=y
dps=1
iters=10
policies=100
mean43.141-23.317=19.824
σ0.007-0.003=0.004
min43.133-23.314=19.819
max43.156-23.324=19.832
mean416.000
σ0.000
min416.000
max416.000
mean0.122-0.065=0.058
σ0.007-0.003=0.004
min0.118-0.063=0.054
max0.141-0.072=0.069

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.078-1757.494=-765.416
σ1.243-0.365=0.879
min991.498-1756.921=-765.423
max997.306-1758.080=-760.774
mean1061.350-1647.200=-585.850
σ311.910-634.933=-323.023
min605.000-654.000=-49.000
max1598.000-2832.000=-1234.000
mean1.555-2.377=-0.823
σ0.118-0.110=0.008
min1.470-2.281=-0.811
max1.962-2.671=-0.708

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.675-326.635=-40.960
σ0.015-0.054=-0.039
min285.651-326.539=-40.888
max285.690-326.668=-40.978
mean1598.000-2832.000=-1234.000
σ0.000
min1598.000-2832.000=-1234.000
max1598.000-2832.000=-1234.000
mean0.375-0.423=-0.048
σ0.000-0.001=-0.000
min0.375-0.422=-0.048
max0.376-0.424=-0.048
iters=5
new-facts=1
prior-facts=6402
mean1285.641-1988.804=-703.164
σ0.135-0.008=0.126
min1285.573-1988.792=-703.219
max1285.882-1988.814=-702.932
mean1598.000-2832.000=-1234.000
σ0.000
min1598.000-2832.000=-1234.000
max1598.000-2832.000=-1234.000
mean1.880-2.703=-0.823
σ0.019-0.105=-0.087
min1.863-2.578=-0.715
max1.909-2.831=-0.921
iters=5
new-facts=6402
prior-facts=1
mean1807.983-4813.663=-3005.680
σ7.016-7.776=-0.760
min1804.616-4810.133=-3005.518
max1820.517-4827.572=-3007.055
mean1598.000-2832.000=-1234.000
σ0.000
min1598.000-2832.000=-1234.000
max1598.000-2832.000=-1234.000
mean4.218-8.991=-4.773
σ0.176-0.405=-0.229
min4.000-8.602=-4.603
max4.472-9.591=-5.119
iters=5
new-facts=6402
prior-facts=6402
mean2070.462-5001.211=-2930.749
σ0.010-0.039=-0.029
min2070.448-5001.177=-2930.729
max2070.477-5001.274=-2930.797
mean1844.000-3054.000=-1210.000
σ217.430-216.849=0.581
min1598.000-2832.000=-1234.000
max2086.000-3328.000=-1242.000
mean4.453-9.915=-5.461
σ0.028-0.203=-0.174
min4.412-9.641=-5.230
max4.488-10.195=-5.707

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.247-0.923=0.324
σ0.314-0.008=0.306
min0.903-0.915=-0.012
max1.594-0.935=0.659

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.386-464.629=-27.243
σ572.364-574.767=-2.404
min151.194-177.244=-26.050
max1295.931-1326.780=-30.849
mean90.250-88.250=2.000
σ8.500
min86.000-84.000=2.000
max103.000-101.000=2.000
mean1598.000-2832.000=-1234.000
σ0.000
min1598.000-2832.000=-1234.000
max1598.000-2832.000=-1234.000
mean0.561-0.437=0.124
σ0.612-0.307=0.305
min0.253-0.279=-0.026
max1.478-0.897=0.581
policies=20
mean1512.195-1772.723=-260.529
σ0.245-0.360=-0.114
min1512.032-1772.496=-260.464
max1512.560-1773.259=-260.699
mean860.000-840.000=20.000
σ0.000
min860.000-840.000=20.000
max860.000-840.000=20.000
mean1598.000-2832.000=-1234.000
σ0.000
min1598.000-2832.000=-1234.000
max1598.000-2832.000=-1234.000
mean2.520-2.794=-0.274
σ0.014-0.008=0.006
min2.505-2.788=-0.283
max2.539-2.807=-0.268
policies=200
mean15129.570-17734.030=-2604.460
σ0.083-0.398=-0.316
min15129.465-17733.667=-2604.201
max15129.653-17734.598=-2604.945
mean8600.000-8400.000=200.000
σ0.000
min8600.000-8400.000=200.000
max8600.000-8400.000=200.000
mean1598.000-2832.000=-1234.000
σ0.000
min1598.000-2832.000=-1234.000
max1598.000-2832.000=-1234.000
mean25.622-27.776=-2.154
σ0.110-0.392=-0.281
min25.500-27.387=-1.887
max25.747-28.181=-2.435