Compare commits

Home / Compare 08c22884 .. 3cd7ab9f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.971-53.970=0.002
σ0.368-0.368=-0.001
min53.823-53.827=-0.004
max55.017-55.017=-0.000
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.139-0.136=0.003
σ0.003-0.005=-0.001
min0.135-0.130=0.005
max0.145-0.145=0.000
cache=y
dps=1
iters=10
policies=100
mean43.342-43.341=0.001
σ0.007-0.007=0.000
min43.331-43.328=0.004
max43.356-43.354=0.002
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.122-0.122=0.000
σ0.005-0.003=0.002
min0.116-0.119=-0.003
max0.131-0.127=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.896-1016.894=0.002
σ1.162-1.181=-0.019
min1016.322-1016.332=-0.010
max1021.762-1021.832=-0.070
mean1061.600-1059.200=2.400
σ312.597-315.878=-3.281
min589.000-555.000=34.000
max1637.000-1516.000=121.000
mean1.523-1.526=-0.003
σ0.089-0.106=-0.017
min1.435-1.371=0.063
max1.791-1.789=0.002

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.009-302.028=-0.019
σ0.202-0.196=0.006
min301.828-301.861=-0.034
max302.524-302.542=-0.018
mean2043.000-2025.000=18.000
σ0.000
min2043.000-2025.000=18.000
max2043.000-2025.000=18.000
mean0.592-0.598=-0.006
σ0.031-0.007=0.023
min0.519-0.584=-0.065
max0.613-0.608=0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.499-303.520=-0.022
σ0.081-0.048=0.033
min303.366-303.448=-0.082
max303.572-303.573=-0.001
mean1637.000-1516.000=121.000
σ0.000
min1637.000-1516.000=121.000
max1637.000-1516.000=121.000
mean0.390-0.392=-0.002
σ0.006-0.005=0.001
min0.386-0.389=-0.003
max0.401-0.401=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1326.061-1326.059=0.003
σ0.108-0.108=-0.000
min1325.925-1325.924=0.001
max1326.194-1326.199=-0.005
mean1637.000-1516.000=121.000
σ0.000
min1637.000-1516.000=121.000
max1637.000-1516.000=121.000
mean1.893-1.926=-0.033
σ0.067-0.084=-0.017
min1.832-1.827=0.005
max1.982-2.016=-0.035
iters=5
new-facts=6402
prior-facts=1
mean1564.189-1564.106=0.083
σ6.873-6.931=-0.058
min1560.908-1560.758=0.150
max1576.479-1576.498=-0.019
mean1637.000-1516.000=121.000
σ0.000
min1637.000-1516.000=121.000
max1637.000-1516.000=121.000
mean2.479-2.267=0.212
σ0.267-0.277=-0.009
min2.025-2.123=-0.098
max2.737-2.760=-0.023
iters=5
new-facts=6402
prior-facts=6402
mean1894.004-1894.005=-0.001
σ0.065-0.067=-0.002
min1893.889-1893.885=0.005
max1894.045-1894.041=0.005
mean1775.400-1746.600=28.800
σ169.985-204.713=-34.728
min1637.000-1516.000=121.000
max2043.000-2025.000=18.000
mean2.947-2.952=-0.006
σ0.148-0.080=0.068
min2.847-2.875=-0.029
max3.207-3.071=0.136

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.188-1.516=-0.328
σ0.279-0.314=-0.036
min0.911-1.158=-0.247
max1.610-1.819=-0.209

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.704-444.700=0.004
σ575.150-575.139=0.010
min157.124-157.125=-0.001
max1307.429-1307.409=0.019
mean96.250
σ8.500
min92.000
max109.000
mean1637.000-1516.000=121.000
σ0.000
min1637.000-1516.000=121.000
max1637.000-1516.000=121.000
mean0.526-0.544=-0.018
σ0.532-0.557=-0.025
min0.256-0.264=-0.007
max1.324-1.379=-0.055
policies=20
mean1571.540-1571.548=-0.008
σ0.324-0.346=-0.022
min1571.363-1571.328=0.035
max1572.026-1572.064=-0.038
mean920.000
σ0.000
min920.000
max920.000
mean1637.000-1516.000=121.000
σ0.000
min1637.000-1516.000=121.000
max1637.000-1516.000=121.000
mean2.612-2.655=-0.042
σ0.001-0.054=-0.053
min2.611-2.605=0.006
max2.614-2.715=-0.101
policies=200
mean15723.294-15723.263=0.031
σ0.118-0.130=-0.012
min15723.143-15723.153=-0.010
max15723.413-15723.425=-0.012
mean9200.000
σ0.000
min9200.000
max9200.000
mean1637.000-1516.000=121.000
σ0.000
min1637.000-1516.000=121.000
max1637.000-1516.000=121.000
mean26.518-26.511=0.007
σ0.151-0.192=-0.041
min26.382-26.342=0.040
max26.658-26.752=-0.094