Compare commits

Home / Compare 10b303f1 .. 3d694594

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean92.510-92.512=-0.002
σ0.053-0.053=-0.001
min92.452-92.464=-0.012
max92.648-92.654=-0.006
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.212-0.216=-0.005
σ0.004-0.004=0.001
min0.205-0.210=-0.005
max0.215-0.221=-0.006
cache=y
dps=1
iters=10
policies=100
mean43.127-43.128=-0.001
σ0.008-0.009=-0.001
min43.115-43.116=-0.001
max43.136-43.140=-0.004
mean416.700-411.000=5.700
σ0.483-0.000=0.483
min416.000-411.000=5.000
max417.000-411.000=6.000
mean0.116-0.116=-0.000
σ0.002-0.002=-0.000
min0.114-0.114=-0.000
max0.121-0.123=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1761.427-1761.427=0.000
σ0.360-0.362=-0.002
min1760.855-1760.857=-0.003
max1762.003-1762.012=-0.009
mean1656.050-1653.400=2.650
σ639.719-632.006=7.713
min630.000-654.000=-24.000
max2789.000-2826.000=-37.000
mean2.582-2.547=0.036
σ0.318-0.345=-0.027
min2.185-2.172=0.014
max3.006-3.168=-0.161

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean328.794-328.787=0.006
σ0.069-0.068=0.002
min328.670-328.667=0.003
max328.834-328.823=0.011
mean2789.000-2826.000=-37.000
σ0.000
min2789.000-2826.000=-37.000
max2789.000-2826.000=-37.000
mean0.441-0.433=0.008
σ0.012-0.002=0.010
min0.433-0.431=0.001
max0.461-0.435=0.026
iters=5
new-facts=1
prior-facts=6402
mean1989.313-1989.330=-0.017
σ0.016-0.005=0.011
min1989.296-1989.324=-0.028
max1989.335-1989.334=0.001
mean2789.000-2826.000=-37.000
σ0.000
min2789.000-2826.000=-37.000
max2789.000-2826.000=-37.000
mean3.107-3.003=0.105
σ0.054-0.085=-0.032
min3.074-2.893=0.181
max3.202-3.093=0.109
iters=5
new-facts=6402
prior-facts=1
mean4813.017-4813.035=-0.018
σ7.778-7.794=-0.015
min4809.419-4809.453=-0.034
max4826.931-4826.976=-0.045
mean2789.000-2826.000=-37.000
σ0.000
min2789.000-2826.000=-37.000
max2789.000-2826.000=-37.000
mean8.777-8.562=0.215
σ0.229-0.453=-0.224
min8.568-7.971=0.597
max9.131-9.223=-0.091
iters=5
new-facts=6402
prior-facts=6402
mean5000.578-5000.585=-0.007
σ0.022-0.025=-0.004
min5000.548-5000.562=-0.014
max5000.604-5000.615=-0.011
mean2977.200-3028.200=-51.000
σ207.952-205.096=2.857
min2789.000-2826.000=-37.000
max3294.000-3309.000=-15.000
mean8.589-8.828=-0.239
σ0.145-0.293=-0.148
min8.435-8.559=-0.124
max8.792-9.284=-0.492

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.036-1.038=-0.001
σ0.266-0.191=0.075
min0.898-0.925=-0.026
max1.512-1.368=0.144

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean470.844-470.840=0.004
σ574.234-574.236=-0.002
min183.712-183.716=-0.004
max1332.196-1332.194=0.001
mean90.250
σ8.500
min86.000
max103.000
mean2789.000-2826.000=-37.000
σ0.000
min2789.000-2826.000=-37.000
max2789.000-2826.000=-37.000
mean0.451-0.448=0.003
σ0.305-0.303=0.002
min0.296-0.294=0.002
max0.909-0.902=0.006
policies=20
mean1837.450-1837.450=0.000
σ0.404-0.400=0.003
min1837.150-1837.158=-0.008
max1838.038-1838.035=0.003
mean860.000
σ0.000
min860.000
max860.000
mean2789.000-2826.000=-37.000
σ0.000
min2789.000-2826.000=-37.000
max2789.000-2826.000=-37.000
mean2.944-2.937=0.007
σ0.004-0.008=-0.004
min2.941-2.929=0.012
max2.949-2.948=0.002
policies=200
mean18381.276-18381.313=-0.036
σ0.604-0.591=0.014
min18380.871-18381.014=-0.144
max18382.170-18382.199=-0.029
mean8600.000
σ0.000
min8600.000
max8600.000
mean2789.000-2826.000=-37.000
σ0.000
min2789.000-2826.000=-37.000
max2789.000-2826.000=-37.000
mean29.030-29.275=-0.245
σ0.298-0.383=-0.085
min28.850-28.904=-0.054
max29.473-29.662=-0.189