Compare commits

Home / Compare d1bcb0cc .. 736452d3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.915=-0.001
σ0.368-0.366=0.002
min53.786-53.781=0.005
max54.960-54.956=0.004
mean413.300-415.000=-1.700
σ0.483-0.000=0.483
min413.000-415.000=-2.000
max414.000-415.000=-1.000
mean0.139-0.137=0.002
σ0.004-0.006=-0.002
min0.135-0.129=0.006
max0.146-0.148=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.142-43.141=0.000
σ0.006-0.007=-0.001
min43.132-43.133=-0.001
max43.150-43.156=-0.006
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.119-0.122=-0.004
σ0.003-0.007=-0.004
min0.115-0.118=-0.003
max0.125-0.141=-0.016

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.079-992.078=0.002
σ1.244-1.243=0.001
min991.497-991.498=-0.001
max997.312-997.306=0.006
mean1060.600-1061.350=-0.750
σ313.072-311.910=1.162
min601.000-605.000=-4.000
max1596.000-1598.000=-2.000
mean1.548-1.555=-0.007
σ0.093-0.118=-0.025
min1.403-1.470=-0.068
max1.811-1.962=-0.151

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.675-285.675=-0.000
σ0.012-0.015=-0.003
min285.662-285.651=0.011
max285.687-285.690=-0.003
mean1596.000-1598.000=-2.000
σ0.000
min1596.000-1598.000=-2.000
max1596.000-1598.000=-2.000
mean0.376-0.375=0.001
σ0.002-0.000=0.001
min0.374-0.375=-0.000
max0.378-0.376=0.002
iters=5
new-facts=1
prior-facts=6402
mean1285.639-1285.641=-0.002
σ0.133-0.135=-0.002
min1285.574-1285.573=0.001
max1285.876-1285.882=-0.006
mean1596.000-1598.000=-2.000
σ0.000
min1596.000-1598.000=-2.000
max1596.000-1598.000=-2.000
mean1.893-1.880=0.013
σ0.065-0.019=0.046
min1.839-1.863=-0.024
max1.999-1.909=0.090
iters=5
new-facts=6402
prior-facts=1
mean1807.972-1807.983=-0.011
σ7.010-7.016=-0.006
min1804.617-1804.616=0.002
max1820.496-1820.517=-0.021
mean1596.000-1598.000=-2.000
σ0.000
min1596.000-1598.000=-2.000
max1596.000-1598.000=-2.000
mean4.164-4.218=-0.055
σ0.143-0.176=-0.033
min3.952-4.000=-0.048
max4.347-4.472=-0.125
iters=5
new-facts=6402
prior-facts=6402
mean2070.461-2070.462=-0.001
σ0.010-0.010=-0.001
min2070.449-2070.448=0.001
max2070.474-2070.477=-0.003
mean1846.800-1844.000=2.800
σ220.506-217.430=3.075
min1596.000-1598.000=-2.000
max2088.000-2086.000=2.000
mean4.450-4.453=-0.003
σ0.069-0.028=0.041
min4.344-4.412=-0.068
max4.520-4.488=0.031

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.172-1.247=-0.075
σ0.249-0.314=-0.064
min0.915-0.903=0.012
max1.557-1.594=-0.037

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.382-437.386=-0.004
σ572.367-572.364=0.003
min151.195-151.194=0.001
max1295.932-1295.931=0.001
mean90.250
σ8.500
min86.000
max103.000
mean1596.000-1598.000=-2.000
σ0.000
min1596.000-1598.000=-2.000
max1596.000-1598.000=-2.000
mean0.536-0.561=-0.025
σ0.562-0.612=-0.050
min0.251-0.253=-0.002
max1.379-1.478=-0.100
policies=20
mean1512.206-1512.195=0.011
σ0.258-0.245=0.013
min1512.033-1512.032=0.001
max1512.590-1512.560=0.030
mean860.000
σ0.000
min860.000
max860.000
mean1596.000-1598.000=-2.000
σ0.000
min1596.000-1598.000=-2.000
max1596.000-1598.000=-2.000
mean2.533-2.520=0.013
σ0.007-0.014=-0.007
min2.528-2.505=0.023
max2.543-2.539=0.005
policies=200
mean15129.575-15129.570=0.005
σ0.080-0.083=-0.002
min15129.517-15129.465=0.051
max15129.694-15129.653=0.041
mean8600.000
σ0.000
min8600.000
max8600.000
mean1596.000-1598.000=-2.000
σ0.000
min1596.000-1598.000=-2.000
max1596.000-1598.000=-2.000
mean25.641-25.622=0.020
σ0.073-0.110=-0.037
min25.571-25.500=0.071
max25.727-25.747=-0.020