Compare commits

Home / Compare 0ccb444b .. c54fabf5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-33.979=19.935
σ0.365-0.049=0.316
min53.784-33.948=19.837
max54.955-34.114=20.840
mean415.500-415.000=0.500
σ0.527-0.000=0.527
min415.000
max416.000-415.000=1.000
mean0.139-0.085=0.054
σ0.004-0.003=0.000
min0.135-0.082=0.053
max0.146-0.092=0.054
cache=y
dps=1
iters=10
policies=100
mean43.142-23.318=19.824
σ0.005-0.003=0.002
min43.135-23.315=19.821
max43.149-23.323=19.826
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.121-0.065=0.056
σ0.003-0.003=0.000
min0.118-0.063=0.055
max0.126-0.073=0.053

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.078-1757.495=-765.417
σ1.223-0.365=0.858
min991.499-1756.920=-765.421
max997.213-1758.086=-760.873
mean1064.850-1676.150=-611.300
σ318.554-634.448=-315.894
min605.000-665.000=-60.000
max1626.000-2640.000=-1014.000
mean1.512-2.383=-0.871
σ0.067-0.096=-0.028
min1.411-2.278=-0.867
max1.685-2.599=-0.913

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.604-326.633=-41.029
σ0.012-0.061=-0.049
min285.584-326.526=-40.942
max285.613-326.672=-41.059
mean1626.000-2640.000=-1014.000
σ0.000
min1626.000-2640.000=-1014.000
max1626.000-2640.000=-1014.000
mean0.379-0.431=-0.052
σ0.006-0.009=-0.003
min0.374-0.422=-0.048
max0.389-0.445=-0.056
iters=5
new-facts=1
prior-facts=6402
mean1285.570-1988.795=-703.225
σ0.134-0.014=0.120
min1285.506-1988.780=-703.273
max1285.809-1988.811=-703.002
mean1626.000-2640.000=-1014.000
σ0.000
min1626.000-2640.000=-1014.000
max1626.000-2640.000=-1014.000
mean1.893-2.728=-0.835
σ0.097-0.124=-0.026
min1.842-2.614=-0.772
max2.066-2.926=-0.860
iters=5
new-facts=6402
prior-facts=1
mean1807.905-4813.646=-3005.741
σ7.004-7.733=-0.729
min1804.563-4810.143=-3005.579
max1820.420-4827.478=-3007.058
mean1626.000-2640.000=-1014.000
σ0.000
min1626.000-2640.000=-1014.000
max1626.000-2640.000=-1014.000
mean4.172-8.663=-4.491
σ0.145-0.520=-0.376
min3.933-7.850=-3.917
max4.301-9.087=-4.786
iters=5
new-facts=6402
prior-facts=6402
mean2070.390-5001.058=-2930.668
σ0.011-0.197=-0.186
min2070.381-5000.826=-2930.446
max2070.406-5001.224=-2930.818
mean1845.200-2961.200=-1116.000
σ195.302-255.007=-59.706
min1626.000-2640.000=-1014.000
max2092.000-3302.000=-1210.000
mean4.499-9.568=-5.069
σ0.050-0.203=-0.152
min4.448-9.294=-4.847
max4.583-9.766=-5.184

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.321-1.110=0.211
σ0.383-0.235=0.148
min0.913-0.915=-0.002
max1.745-1.496=0.249

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.382-464.633=-27.251
σ572.367-574.778=-2.410
min151.196-177.234=-26.039
max1295.933-1326.800=-30.867
mean90.250-88.250=2.000
σ8.500
min86.000-84.000=2.000
max103.000-101.000=2.000
mean1626.000-2640.000=-1014.000
σ0.000
min1626.000-2640.000=-1014.000
max1626.000-2640.000=-1014.000
mean0.532-0.548=-0.016
σ0.547-0.542=0.005
min0.256-0.270=-0.015
max1.352-1.360=-0.009
policies=20
mean1512.209-1772.658=-260.450
σ0.253-0.353=-0.099
min1512.042-1772.426=-260.384
max1512.586-1773.183=-260.597
mean860.000-840.000=20.000
σ0.000
min860.000-840.000=20.000
max860.000-840.000=20.000
mean1626.000-2640.000=-1014.000
σ0.000
min1626.000-2640.000=-1014.000
max1626.000-2640.000=-1014.000
mean2.533-2.715=-0.182
σ0.020-0.017=0.003
min2.504-2.699=-0.195
max2.549-2.738=-0.190
policies=200
mean15129.564-17733.982=-2604.418
σ0.143-0.581=-0.438
min15129.377-17733.567=-2604.190
max15129.684-17734.842=-2605.159
mean8600.000-8400.000=200.000
σ0.000
min8600.000-8400.000=200.000
max8600.000-8400.000=200.000
mean1626.000-2640.000=-1014.000
σ0.000
min1626.000-2640.000=-1014.000
max1626.000-2640.000=-1014.000
mean25.636-27.532=-1.896
σ0.141-0.159=-0.018
min25.479-27.355=-1.876
max25.805-27.730=-1.925