Compare commits

Home / Compare b0dedd66 .. a1e482b8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.619-35.617=0.002
σ0.055-0.055=0.001
min35.587-35.586=0.001
max35.775-35.772=0.004
mean415.000-416.900=-1.900
σ0.000-0.316=-0.316
min415.000-416.000=-1.000
max415.000-417.000=-2.000
mean0.085-0.082=0.003
σ0.003-0.005=-0.002
min0.082-0.077=0.004
max0.092-0.093=-0.001
cache=y
dps=1
iters=10
policies=100
mean24.046-24.046=0.000
σ0.003-0.003=0.000
min24.041-24.042=-0.001
max24.052-24.050=0.002
mean415.700-417.000=-1.300
σ0.483-0.000=0.483
min415.000-417.000=-2.000
max416.000-417.000=-1.000
mean0.068-0.062=0.006
σ0.004-0.001=0.003
min0.066-0.061=0.005
max0.075-0.063=0.012

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.492=-0.002
σ0.364-0.365=-0.001
min1755.916-1755.916=0.000
max1757.085-1757.077=0.008
mean1649.900-1655.400=-5.500
σ641.396-627.443=13.953
min633.000-626.000=7.000
max2829.000-2697.000=132.000
mean2.324-2.337=-0.013
σ0.077-0.112=-0.035
min2.199-2.160=0.039
max2.454-2.580=-0.126

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.767-324.765=0.002
σ0.046-0.054=-0.008
min324.686-324.668=0.017
max324.797-324.794=0.004
mean2829.000-2697.000=132.000
σ0.000
min2829.000-2697.000=132.000
max2829.000-2697.000=132.000
mean0.431-0.424=0.007
σ0.009-0.001=0.009
min0.424-0.424=0.000
max0.442-0.426=0.016
iters=5
new-facts=1
prior-facts=6402
mean1985.321-1985.324=-0.002
σ0.008-0.009=-0.001
min1985.309-1985.309=-0.000
max1985.330-1985.332=-0.002
mean2829.000-2697.000=132.000
σ0.000
min2829.000-2697.000=132.000
max2829.000-2697.000=132.000
mean2.757-2.599=0.158
σ0.108-0.049=0.059
min2.591-2.571=0.019
max2.862-2.686=0.175
iters=5
new-facts=6402
prior-facts=1
mean4808.858-4809.091=-0.232
σ7.128-7.670=-0.542
min4805.636-4805.614=0.022
max4821.609-4822.811=-1.202
mean2829.000-2697.000=132.000
σ0.000
min2829.000-2697.000=132.000
max2829.000-2697.000=132.000
mean8.716-8.926=-0.210
σ0.269-0.251=0.018
min8.258-8.719=-0.461
max8.915-9.325=-0.409
iters=5
new-facts=6402
prior-facts=6402
mean4996.492-4996.628=-0.136
σ0.328-0.023=0.305
min4995.907-4996.604=-0.697
max4996.656-4996.654=0.003
mean3084.200-2967.200=117.000
σ259.030-320.417=-61.387
min2829.000-2697.000=132.000
max3350.000-3443.000=-93.000
mean9.161-8.444=0.717
σ0.329-0.106=0.223
min8.609-8.359=0.251
max9.473-8.628=0.844

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.013-1.032=-0.020
σ0.203-0.121=0.083
min0.913-0.921=-0.009
max1.376-1.218=0.158

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.214-463.216=-0.001
σ574.770-574.769=0.001
min175.813-175.824=-0.011
max1325.370-1325.370=-0.000
mean86.250
σ8.500
min82.000
max99.000
mean2829.000-2697.000=132.000
σ0.000
min2829.000-2697.000=132.000
max2829.000-2697.000=132.000
mean0.471-0.547=-0.076
σ0.375-0.546=-0.171
min0.281-0.273=0.008
max1.033-1.366=-0.332
policies=20
mean1758.507-1758.507=-0.001
σ0.349-0.336=0.013
min1758.278-1758.292=-0.013
max1759.023-1759.008=0.015
mean820.000
σ0.000
min820.000
max820.000
mean2829.000-2697.000=132.000
σ0.000
min2829.000-2697.000=132.000
max2829.000-2697.000=132.000
mean2.800-2.722=0.078
σ0.019-0.023=-0.004
min2.785-2.702=0.082
max2.828-2.748=0.080
policies=200
mean17592.184-17592.158=0.027
σ0.526-0.469=0.057
min17591.812-17591.893=-0.081
max17592.956-17592.858=0.098
mean8200.000
σ0.000
min8200.000
max8200.000
mean2829.000-2697.000=132.000
σ0.000
min2829.000-2697.000=132.000
max2829.000-2697.000=132.000
mean27.810-27.422=0.388
σ0.458-0.116=0.342
min27.405-27.293=0.112
max28.262-27.539=0.723