Compare commits

Home / Compare 4338f6c5 .. 8712be4d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-33.979=19.935
σ0.368-0.048=0.321
min53.786-33.952=19.834
max54.962-34.111=20.851
mean418.100-413.000=5.100
σ0.316-0.000=0.316
min418.000-413.000=5.000
max419.000-413.000=6.000
mean0.138-0.085=0.053
σ0.006-0.003=0.002
min0.129-0.082=0.048
max0.146-0.091=0.055
cache=y
dps=1
iters=10
policies=100
mean43.141-23.317=19.823
σ0.005-0.002=0.002
min43.132-23.313=19.820
max43.147-23.320=19.826
mean419.000-413.000=6.000
σ0.000
min419.000-413.000=6.000
max419.000-413.000=6.000
mean0.119-0.065=0.054
σ0.004-0.003=0.001
min0.114-0.061=0.053
max0.128-0.072=0.056

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.079-1757.493=-765.414
σ1.241-0.364=0.876
min991.502-1756.921=-765.420
max997.294-1758.084=-760.790
mean1068.450-1653.150=-584.700
σ315.120-636.810=-321.691
min607.000-637.000=-30.000
max1596.000-2824.000=-1228.000
mean1.532-2.392=-0.860
σ0.079-0.137=-0.058
min1.469-2.231=-0.761
max1.819-2.838=-1.019

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.678-326.644=-40.966
σ0.021-0.046=-0.026
min285.652-326.563=-40.911
max285.708-326.679=-40.971
mean1596.000-2824.000=-1228.000
σ0.000
min1596.000-2824.000=-1228.000
max1596.000-2824.000=-1228.000
mean0.382-0.428=-0.046
σ0.007-0.005=0.002
min0.377-0.423=-0.046
max0.394-0.435=-0.040
iters=5
new-facts=1
prior-facts=6402
mean1285.637-1988.791=-703.153
σ0.131-0.020=0.111
min1285.574-1988.773=-703.199
max1285.871-1988.819=-702.948
mean1596.000-2824.000=-1228.000
σ0.000
min1596.000-2824.000=-1228.000
max1596.000-2824.000=-1228.000
mean1.892-2.775=-0.883
σ0.055-0.150=-0.095
min1.836-2.595=-0.759
max1.970-2.925=-0.955
iters=5
new-facts=6402
prior-facts=1
mean1807.984-4813.536=-3005.552
σ7.035-7.793=-0.758
min1804.587-4809.569=-3004.981
max1820.553-4827.468=-3006.915
mean1596.000-2824.000=-1228.000
σ0.000
min1596.000-2824.000=-1228.000
max1596.000-2824.000=-1228.000
mean4.177-8.677=-4.500
σ0.299-0.623=-0.324
min3.848-7.866=-4.019
max4.560-9.298=-4.738
iters=5
new-facts=6402
prior-facts=6402
mean2070.463-5001.213=-2930.750
σ0.003-0.033=-0.030
min2070.460-5001.183=-2930.722
max2070.466-5001.261=-2930.795
mean1855.200-3016.000=-1160.800
σ212.292-261.583=-49.291
min1596.000-2824.000=-1228.000
max2092.000-3423.000=-1331.000
mean4.524-9.916=-5.391
σ0.083-0.162=-0.079
min4.422-9.777=-5.355
max4.629-10.142=-5.512

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.279-0.984=0.295
σ0.333-0.137=0.195
min0.911-0.918=-0.007
max1.737-1.230=0.506

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.386-464.636=-27.250
σ572.361-574.772=-2.411
min151.195-177.239=-26.044
max1295.927-1326.794=-30.866
mean90.250-88.250=2.000
σ8.500
min86.000-84.000=2.000
max103.000-101.000=2.000
mean1596.000-2824.000=-1228.000
σ0.000
min1596.000-2824.000=-1228.000
max1596.000-2824.000=-1228.000
mean0.527-0.436=0.091
σ0.547-0.307=0.240
min0.252-0.279=-0.028
max1.348-0.897=0.451
policies=20
mean1512.211-1772.719=-260.508
σ0.251-0.372=-0.121
min1512.047-1772.461=-260.414
max1512.585-1773.267=-260.682
mean860.000-840.000=20.000
σ0.000
min860.000-840.000=20.000
max860.000-840.000=20.000
mean1596.000-2824.000=-1228.000
σ0.000
min1596.000-2824.000=-1228.000
max1596.000-2824.000=-1228.000
mean2.538-2.808=-0.270
σ0.006-0.004=0.002
min2.531-2.802=-0.271
max2.544-2.812=-0.268
policies=200
mean15129.708-17734.136=-2604.428
σ0.065-0.452=-0.386
min15129.613-17733.817=-2604.204
max15129.761-17734.805=-2605.044
mean8600.000-8400.000=200.000
σ0.000
min8600.000-8400.000=200.000
max8600.000-8400.000=200.000
mean1596.000-2824.000=-1228.000
σ0.000
min1596.000-2824.000=-1228.000
max1596.000-2824.000=-1228.000
mean25.693-28.060=-2.367
σ0.143-0.367=-0.224
min25.515-27.715=-2.200
max25.817-28.457=-2.640