Compare commits

Home / Compare d337b734 .. b7680e0f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.823-53.821=0.002
σ0.368-0.368=-0.000
min53.682-53.669=0.013
max54.870-54.869=0.001
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.139-0.138=0.001
σ0.004-0.006=-0.001
min0.130-0.129=0.001
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.208-43.207=0.001
σ0.007-0.006=0.001
min43.194-43.199=-0.005
max43.220-43.215=0.005
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.122-0.122=0.000
σ0.003-0.004=-0.000
min0.118-0.118=0.000
max0.129-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.175-1016.174=0.000
σ1.167-1.168=-0.001
min1015.632-1015.623=0.009
max1021.067-1021.066=0.001
mean1041.050-1049.050=-8.000
σ305.924-296.659=9.265
min549.000-590.000=-41.000
max1612.000-1467.000=145.000
mean1.588-1.549=0.039
σ0.107-0.052=0.055
min1.509-1.488=0.021
max1.907-1.654=0.254

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.473-301.396=0.077
σ0.212-0.203=0.009
min301.347-301.207=0.141
max302.047-301.937=0.110
mean2017.000-2022.000=-5.000
σ0.000
min2017.000-2022.000=-5.000
max2017.000-2022.000=-5.000
mean0.561-0.560=0.001
σ0.035-0.036=-0.001
min0.509-0.516=-0.007
max0.604-0.613=-0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.703-300.693=0.011
σ0.025-0.034=-0.009
min300.673-300.634=0.039
max300.738-300.718=0.020
mean1612.000-1467.000=145.000
σ0.000
min1612.000-1467.000=145.000
max1612.000-1467.000=145.000
mean0.397-0.402=-0.005
σ0.008-0.001=0.007
min0.389-0.400=-0.011
max0.410-0.403=0.006
iters=5
new-facts=1
prior-facts=6402
mean1322.864-1322.875=-0.011
σ0.090-0.095=-0.005
min1322.820-1322.819=0.001
max1323.026-1323.041=-0.015
mean1612.000-1467.000=145.000
σ0.000
min1612.000-1467.000=145.000
max1612.000-1467.000=145.000
mean1.871-1.869=0.002
σ0.066-0.070=-0.003
min1.819-1.812=0.006
max1.981-1.982=-0.000
iters=5
new-facts=6402
prior-facts=1
mean1561.326-1561.284=0.042
σ6.891-6.873=0.017
min1558.034-1557.980=0.054
max1573.648-1573.574=0.074
mean1612.000-1467.000=145.000
σ0.000
min1612.000-1467.000=145.000
max1612.000-1467.000=145.000
mean2.372-2.233=0.139
σ0.352-0.198=0.154
min2.070-2.055=0.014
max2.794-2.542=0.252
iters=5
new-facts=6402
prior-facts=6402
mean1890.790-1890.792=-0.002
σ0.017-0.018=-0.001
min1890.768-1890.771=-0.003
max1890.815-1890.815=0.000
mean1763.800-1716.600=47.200
σ176.032-224.557=-48.525
min1612.000-1467.000=145.000
max2017.000-2022.000=-5.000
mean2.937-3.032=-0.095
σ0.121-0.399=-0.278
min2.852-2.790=0.062
max3.150-3.743=-0.593

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.221-1.577=-0.357
σ0.287-0.212=0.075
min0.916-1.296=-0.379
max1.676-1.798=-0.121

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.048-443.038=0.010
σ573.411-573.401=0.010
min156.333-156.334=-0.001
max1303.165-1303.140=0.025
mean96.250
σ8.500
min92.000
max109.000
mean1612.000-1467.000=145.000
σ0.000
min1612.000-1467.000=145.000
max1612.000-1467.000=145.000
mean0.534-0.540=-0.006
σ0.548-0.554=-0.006
min0.259-0.262=-0.003
max1.356-1.370=-0.014
policies=20
mean1563.634-1563.609=0.025
σ0.337-0.336=0.001
min1563.439-1563.398=0.041
max1564.138-1564.110=0.028
mean920.000
σ0.000
min920.000
max920.000
mean1612.000-1467.000=145.000
σ0.000
min1612.000-1467.000=145.000
max1612.000-1467.000=145.000
mean2.627-2.615=0.012
σ0.018-0.007=0.010
min2.608-2.605=0.003
max2.648-2.623=0.025
policies=200
mean15644.065-15644.171=-0.106
σ0.138-0.060=0.078
min15643.901-15644.119=-0.217
max15644.238-15644.258=-0.020
mean9200.000
σ0.000
min9200.000
max9200.000
mean1612.000-1467.000=145.000
σ0.000
min1612.000-1467.000=145.000
max1612.000-1467.000=145.000
mean26.661-26.480=0.181
σ0.214-0.143=0.071
min26.445-26.333=0.111
max26.929-26.675=0.253