Compare commits

Home / Compare f435ecf7 .. 62a86bd5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.654-53.652=0.002
σ0.367-0.367=0.000
min53.518-53.512=0.006
max54.699-54.696=0.004
mean414.000
σ0.000
min414.000
max414.000
mean0.139-0.135=0.004
σ0.003-0.004=-0.001
min0.135-0.131=0.004
max0.145-0.143=0.002
cache=y
dps=1
iters=10
policies=100
mean42.980-42.980=0.000
σ0.006-0.007=-0.001
min42.969-42.970=-0.000
max42.990-42.992=-0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.120-0.119=0.001
σ0.004-0.005=-0.001
min0.112-0.114=-0.002
max0.126-0.128=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.973-1013.971=0.002
σ1.164-1.172=-0.008
min1013.435-1013.427=0.008
max1018.840-1018.868=-0.027
mean1049.300-1048.900=0.400
σ317.124-316.324=0.800
min583.000-584.000=-1.000
max1653.000
mean1.635-1.621=0.015
σ0.074-0.084=-0.010
min1.562-1.481=0.081
max1.823-1.889=-0.066

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.127-299.096=0.031
σ0.297-0.204=0.093
min298.913-298.946=-0.033
max299.901-299.656=0.245
mean1964.000-1959.000=5.000
σ0.000
min1964.000-1959.000=5.000
max1964.000-1959.000=5.000
mean0.589-0.578=0.011
σ0.024-0.024=0.000
min0.551-0.548=0.003
max0.617-0.619=-0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.674-294.678=-0.003
σ0.011-0.011=0.000
min294.661-294.664=-0.003
max294.691-294.695=-0.004
mean1653.000
σ0.000
min1653.000
max1653.000
mean0.382-0.388=-0.006
σ0.002-0.007=-0.005
min0.380-0.380=0.001
max0.386-0.393=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1316.955-1316.933=0.022
σ0.090-0.091=-0.001
min1316.891-1316.888=0.003
max1317.100-1317.095=0.005
mean1653.000
σ0.000
min1653.000
max1653.000
mean1.908-1.895=0.014
σ0.054-0.056=-0.001
min1.856-1.856=-0.001
max1.974-1.993=-0.019
iters=5
new-facts=6402
prior-facts=1
mean1555.272-1555.299=-0.027
σ6.858-6.893=-0.035
min1551.952-1551.991=-0.039
max1567.533-1567.624=-0.092
mean1653.000
σ0.000
min1653.000
max1653.000
mean2.337-2.335=0.002
σ0.294-0.327=-0.033
min2.129-2.139=-0.010
max2.771-2.915=-0.144
iters=5
new-facts=6402
prior-facts=6402
mean1884.769-1884.771=-0.002
σ0.013-0.016=-0.003
min1884.754-1884.756=-0.001
max1884.786-1884.793=-0.007
mean1775.600-1741.600=34.000
σ129.585-135.236=-5.651
min1653.000
max1964.000-1959.000=5.000
mean2.951-2.910=0.041
σ0.064-0.119=-0.055
min2.896-2.831=0.066
max3.031-3.120=-0.088

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.208-1.180=0.029
σ0.299-0.329=-0.029
min0.913-0.905=0.008
max1.685-1.731=-0.046

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.489-440.569=-0.080
σ573.035-573.035=-0.000
min153.968-154.048=-0.081
max1300.041-1300.122=-0.081
mean96.250
σ8.500
min92.000
max109.000
mean1653.000
σ0.000
min1653.000
max1653.000
mean0.541-0.541=0.000
σ0.542-0.547=-0.004
min0.270-0.268=0.002
max1.355-1.361=-0.006
policies=20
mean1539.856-1540.690=-0.835
σ0.320-0.305=0.014
min1539.673-1540.517=-0.844
max1540.334-1541.148=-0.814
mean920.000
σ0.000
min920.000
max920.000
mean1653.000
σ0.000
min1653.000
max1653.000
mean2.600-2.584=0.016
σ0.024-0.008=0.016
min2.581-2.576=0.005
max2.635-2.595=0.041
policies=200
mean15406.494-15414.837=-8.344
σ0.088-0.063=0.025
min15406.368-15414.800=-8.432
max15406.557-15414.931=-8.374
mean9200.000
σ0.000
min9200.000
max9200.000
mean1653.000
σ0.000
min1653.000
max1653.000
mean26.286-26.111=0.175
σ0.173-0.120=0.054
min26.064-25.981=0.083
max26.486-26.255=0.231