Compare commits

Home / Compare ca08f259 .. 111164ad

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.649-53.646=0.002
σ0.367-0.367=0.000
min53.524-53.516=0.009
max54.692-54.690=0.002
mean414.000-414.600=-0.600
σ0.000-0.516=-0.516
min414.000
max414.000-415.000=-1.000
mean0.138-0.136=0.002
σ0.004-0.005=-0.001
min0.130-0.127=0.003
max0.145-0.144=0.001
cache=y
dps=1
iters=10
policies=100
mean42.944-42.942=0.002
σ0.007-0.006=0.001
min42.935-42.932=0.003
max42.955-42.951=0.004
mean414.400-415.000=-0.600
σ0.516-0.000=0.516
min414.000-415.000=-1.000
max415.000
mean0.121-0.121=0.000
σ0.005-0.003=0.002
min0.115-0.118=-0.003
max0.129-0.127=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.803-991.810=-0.007
σ1.271-1.240=0.031
min991.250-991.222=0.028
max997.155-997.015=0.140
mean1064.550-1071.350=-6.800
σ321.237-319.412=1.824
min568.000-613.000=-45.000
max1632.000-1634.000=-2.000
mean1.526-1.511=0.014
σ0.132-0.058=0.073
min1.362-1.347=0.015
max1.822-1.608=0.214

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.392-285.386=0.006
σ0.007-0.011=-0.003
min285.386-285.371=0.015
max285.401-285.398=0.003
mean1632.000-1634.000=-2.000
σ0.000
min1632.000-1634.000=-2.000
max1632.000-1634.000=-2.000
mean0.382-0.375=0.007
σ0.007-0.010=-0.003
min0.373-0.366=0.007
max0.391-0.386=0.006
iters=5
new-facts=1
prior-facts=6402
mean1285.353-1285.351=0.001
σ0.131-0.130=0.000
min1285.286-1285.287=-0.000
max1285.586-1285.584=0.002
mean1632.000-1634.000=-2.000
σ0.000
min1632.000-1634.000=-2.000
max1632.000-1634.000=-2.000
mean1.964-1.942=0.022
σ0.143-0.164=-0.022
min1.829-1.850=-0.021
max2.151-2.235=-0.084
iters=5
new-facts=6402
prior-facts=1
mean1807.690-1807.667=0.024
σ6.973-7.014=-0.041
min1804.359-1804.316=0.043
max1820.148-1820.198=-0.050
mean1632.000-1634.000=-2.000
σ0.000
min1632.000-1634.000=-2.000
max1632.000-1634.000=-2.000
mean4.140-4.149=-0.009
σ0.070-0.185=-0.115
min4.064-3.983=0.081
max4.206-4.445=-0.240
iters=5
new-facts=6402
prior-facts=6402
mean2070.178-2070.180=-0.001
σ0.018-0.007=0.011
min2070.167-2070.168=-0.001
max2070.211-2070.187=0.023
mean1855.800-1832.400=23.400
σ199.416-170.638=28.778
min1632.000-1634.000=-2.000
max2084.000-2068.000=16.000
mean4.485-4.588=-0.102
σ0.083-0.082=0.001
min4.407-4.504=-0.097
max4.581-4.720=-0.139

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.174-1.206=-0.032
σ0.243-0.327=-0.084
min0.917-0.914=0.003
max1.516-1.757=-0.240

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.774-436.774=-0.000
σ572.360-572.365=-0.005
min150.588-150.586=0.003
max1295.314-1295.322=-0.008
mean90.250
σ8.500
min86.000
max103.000
mean1632.000-1634.000=-2.000
σ0.000
min1632.000-1634.000=-2.000
max1632.000-1634.000=-2.000
mean0.518-0.521=-0.003
σ0.538-0.541=-0.003
min0.245-0.250=-0.004
max1.325-1.332=-0.007
policies=20
mean1506.177-1506.155=0.023
σ0.226-0.233=-0.007
min1506.029-1505.997=0.032
max1506.514-1506.500=0.014
mean860.000
σ0.000
min860.000
max860.000
mean1632.000-1634.000=-2.000
σ0.000
min1632.000-1634.000=-2.000
max1632.000-1634.000=-2.000
mean2.500-2.507=-0.007
σ0.030-0.018=0.012
min2.475-2.484=-0.010
max2.535-2.525=0.010
policies=200
mean15069.481-15069.487=-0.006
σ0.096-0.111=-0.015
min15069.396-15069.357=0.039
max15069.616-15069.591=0.025
mean8600.000
σ0.000
min8600.000
max8600.000
mean1632.000-1634.000=-2.000
σ0.000
min1632.000-1634.000=-2.000
max1632.000-1634.000=-2.000
mean25.422-25.457=-0.035
σ0.090-0.085=0.005
min25.290-25.357=-0.067
max25.486-25.541=-0.055