Compare commits

Home / Compare 819939ce .. 97747a44

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.568-70.566=0.002
σ0.045-0.045=-0.000
min70.544-70.535=0.010
max70.691-70.690=0.002
mean418.600-413.000=5.600
σ0.516-0.000=0.516
min418.000-413.000=5.000
max419.000-413.000=6.000
mean0.159-0.159=-0.000
σ0.003-0.005=-0.002
min0.154-0.151=0.003
max0.164-0.166=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.000
σ0.003-0.002=0.002
min21.282-21.286=-0.004
max21.292-21.291=0.000
mean419.000-413.000=6.000
σ0.000
min419.000-413.000=6.000
max419.000-413.000=6.000
mean0.064-0.064=-0.000
σ0.002-0.003=-0.001
min0.063-0.063=-0.000
max0.069-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.372-1753.374=-0.002
σ0.359-0.361=-0.002
min1752.809-1752.803=0.006
max1753.939-1753.961=-0.021
mean1655.100-1647.300=7.800
σ634.377-641.455=-7.079
min638.000-633.000=5.000
max2854.000-2876.000=-22.000
mean2.795-2.782=0.013
σ0.111-0.215=-0.104
min2.518-2.153=0.365
max3.011-2.991=0.020

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.754-271.754=0.000
σ0.002-0.006=-0.004
min271.752-271.746=0.006
max271.758-271.761=-0.003
mean2854.000-2876.000=-22.000
σ0.000
min2854.000-2876.000=-22.000
max2854.000-2876.000=-22.000
mean0.383-0.380=0.003
σ0.007-0.004=0.003
min0.376-0.378=-0.002
max0.394-0.388=0.006
iters=5
new-facts=1
prior-facts=6402
mean1932.182-1932.172=0.010
σ0.007-0.013=-0.006
min1932.175-1932.154=0.021
max1932.191-1932.185=0.006
mean2854.000-2876.000=-22.000
σ0.000
min2854.000-2876.000=-22.000
max2854.000-2876.000=-22.000
mean2.942-3.023=-0.081
σ0.152-0.070=0.082
min2.786-2.929=-0.143
max3.147-3.099=0.048
iters=5
new-facts=6402
prior-facts=1
mean4752.875-4752.890=-0.015
σ0.890-0.911=-0.022
min4752.107-4752.415=-0.308
max4754.415-4754.517=-0.102
mean2854.000-2876.000=-22.000
σ0.000
min2854.000-2876.000=-22.000
max2854.000-2876.000=-22.000
mean7.935-8.822=-0.887
σ0.310-0.229=0.082
min7.710-8.477=-0.767
max8.481-9.073=-0.592
iters=5
new-facts=6402
prior-facts=6402
mean4943.157-4943.376=-0.219
σ0.324-0.013=0.311
min4942.638-4943.359=-0.721
max4943.390-4943.389=0.001
mean3073.000-3027.800=45.200
σ295.946-176.307=119.639
min2854.000-2876.000=-22.000
max3532.000-3307.000=225.000
mean8.426-8.520=-0.094
σ0.087-0.107=-0.020
min8.345-8.376=-0.031
max8.565-8.632=-0.067

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.997-1.041=-0.044
σ0.123-0.161=-0.038
min0.937-0.938=-0.001
max1.216-1.309=-0.093

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.854-472.857=-0.002
σ575.912-575.916=-0.003
min184.892-184.889=0.003
max1336.723-1336.730=-0.007
mean88.250
σ8.500
min84.000
max101.000
mean2854.000-2876.000=-22.000
σ0.000
min2854.000-2876.000=-22.000
max2854.000-2876.000=-22.000
mean0.450-0.452=-0.002
σ0.308-0.305=0.003
min0.293-0.298=-0.004
max0.912-0.909=0.003
policies=20
mean1849.190-1849.225=-0.034
σ0.371-0.374=-0.004
min1848.916-1848.937=-0.021
max1849.729-1849.766=-0.037
mean840.000
σ0.000
min840.000
max840.000
mean2854.000-2876.000=-22.000
σ0.000
min2854.000-2876.000=-22.000
max2854.000-2876.000=-22.000
mean2.951-2.956=-0.005
σ0.015-0.008=0.007
min2.938-2.948=-0.011
max2.969-2.966=0.002
policies=200
mean18498.629-18498.636=-0.007
σ0.512-0.559=-0.047
min18498.326-18498.252=0.074
max18499.394-18499.462=-0.068
mean8400.000
σ0.000
min8400.000
max8400.000
mean2854.000-2876.000=-22.000
σ0.000
min2854.000-2876.000=-22.000
max2854.000-2876.000=-22.000
mean29.241-29.142=0.099
σ0.618-0.420=0.198
min28.692-28.761=-0.069
max29.868-29.665=0.203