Compare commits

Home / Compare cfd42f20 .. 30fedeb8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.773-30.772=0.000
σ0.046-0.046=0.000
min30.748-30.749=-0.000
max30.903-30.902=0.001
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.078-0.076=0.002
σ0.005-0.004=0.001
min0.072-0.071=0.002
max0.085-0.082=0.003
cache=y
dps=1
iters=10
policies=100
mean21.060-21.059=0.001
σ0.002-0.002=-0.000
min21.055-21.054=0.001
max21.063-21.062=0.001
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.066-0.063=0.002
σ0.004-0.003=0.001
min0.063-0.059=0.004
max0.073-0.070=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.237-1713.349=37.887
σ0.365-169.540=-169.175
min1750.665-993.056=757.610
max1751.824-1751.819=0.006
mean1669.550-1609.200=60.350
σ639.584-607.167=32.417
min683.000-631.000=52.000
max2699.000-2426.000=273.000
mean2.802-2.773=0.029
σ0.209-0.310=-0.102
min2.263-1.552=0.711
max3.345-2.981=0.363

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.202-273.200=0.003
σ0.003-0.005=-0.003
min273.200-273.194=0.006
max273.207-273.205=0.001
mean2699.000-2426.000=273.000
σ0.000
min2699.000-2426.000=273.000
max2699.000-2426.000=273.000
mean0.404-0.386=0.018
σ0.009-0.009=0.000
min0.390-0.378=0.013
max0.414-0.397=0.017
iters=5
new-facts=1
prior-facts=6402
mean1933.636-1933.628=0.007
σ0.012-0.005=0.007
min1933.618-1933.626=-0.008
max1933.645-1933.637=0.008
mean2699.000-2426.000=273.000
σ0.000
min2699.000-2426.000=273.000
max2699.000-2426.000=273.000
mean3.035-3.019=0.016
σ0.163-0.076=0.087
min2.770-2.970=-0.201
max3.207-3.150=0.057
iters=5
new-facts=6402
prior-facts=1
mean4754.171-4754.069=0.102
σ0.900-0.965=-0.065
min4753.634-4753.240=0.394
max4755.768-4755.733=0.035
mean2699.000-2426.000=273.000
σ0.000
min2699.000-2426.000=273.000
max2699.000-2426.000=273.000
mean8.235-8.376=-0.141
σ0.679-0.507=0.172
min7.664-7.880=-0.216
max9.217-9.175=0.041
iters=5
new-facts=6402
prior-facts=6402
mean4944.378-4944.522=-0.144
σ0.224-0.199=0.026
min4944.169-4944.189=-0.021
max4944.684-4944.677=0.007
mean3013.400-2943.800=69.600
σ359.261-445.852=-86.591
min2699.000-2426.000=273.000
max3533.000-3531.000=2.000
mean8.369-8.391=-0.023
σ0.104-0.104=0.000
min8.306-8.334=-0.028
max8.553-8.576=-0.023

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.116-1.743=-0.627
σ0.173-0.273=-0.100
min0.949-1.258=-0.309
max1.326-1.918=-0.592

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.205-463.192=0.013
σ572.658-572.656=0.002
min176.871-176.863=0.008
max1322.192-1322.176=0.016
mean77.500
σ7.000
min74.000
max88.000
mean2699.000-2426.000=273.000
σ0.000
min2699.000-2426.000=273.000
max2699.000-2426.000=273.000
mean0.520-0.549=-0.029
σ0.489-0.537=-0.048
min0.273-0.273=0.001
max1.253-1.354=-0.101
policies=20
mean1768.965-1768.920=0.045
σ0.334-0.342=-0.008
min1768.746-1768.700=0.046
max1769.463-1769.430=0.033
mean740.000
σ0.000
min740.000
max740.000
mean2699.000-2426.000=273.000
σ0.000
min2699.000-2426.000=273.000
max2699.000-2426.000=273.000
mean2.756-2.745=0.012
σ0.025-0.038=-0.013
min2.736-2.715=0.021
max2.790-2.798=-0.008
policies=200
mean17696.144-17696.034=0.110
σ0.622-0.564=0.059
min17695.716-17695.615=0.102
max17697.065-17696.861=0.205
mean7400.000
σ0.000
min7400.000
max7400.000
mean2699.000-2426.000=273.000
σ0.000
min2699.000-2426.000=273.000
max2699.000-2426.000=273.000
mean27.637-27.644=-0.007
σ0.199-0.194=0.005
min27.469-27.407=0.062
max27.873-27.824=0.049