Compare commits

Home / Compare d31c69cb .. dd431648

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.966=0.007
σ0.108-0.103=0.005
min35.925-35.923=0.001
max36.280-36.259=0.021
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.074-0.078=-0.004
σ0.005-0.005=0.001
min0.070-0.074=-0.004
max0.083-0.085=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.208-26.209=-0.001
σ0.004-0.005=-0.002
min26.202-26.202=-0.000
max26.215-26.219=-0.005
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.060-0.061=-0.001
σ0.004-0.003=0.001
min0.056-0.059=-0.003
max0.069-0.070=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.365-1756.315=2.050
σ0.370-0.368=0.002
min1757.791-1755.741=2.050
max1758.960-1756.909=2.051
mean1652.950-1658.100=-5.150
σ649.610-632.614=16.996
min669.000-612.000=57.000
max2753.000-2731.000=22.000
mean2.366-2.375=-0.009
σ0.106-0.135=-0.029
min2.174-2.259=-0.085
max2.646-2.823=-0.177

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.509-278.844=0.665
σ0.006-0.010=-0.004
min279.501-278.832=0.669
max279.515-278.857=0.658
mean2753.000-2731.000=22.000
σ0.000
min2753.000-2731.000=22.000
max2753.000-2731.000=22.000
mean0.408-0.409=-0.001
σ0.007-0.001=0.005
min0.404-0.407=-0.004
max0.420-0.410=0.010
iters=5
new-facts=1
prior-facts=6402
mean2178.438-2268.900=-90.462
σ0.014-0.019=-0.004
min2178.426-2268.873=-90.447
max2178.462-2268.922=-90.460
mean2753.000-2731.000=22.000
σ0.000
min2753.000-2731.000=22.000
max2753.000-2731.000=22.000
mean3.347-3.207=0.139
σ0.123-0.168=-0.045
min3.225-2.919=0.306
max3.532-3.352=0.180
iters=5
new-facts=6402
prior-facts=1
mean5056.368-4954.042=102.326
σ0.980-1.057=-0.077
min5055.761-4953.240=102.521
max5058.104-4955.826=102.279
mean2753.000-2731.000=22.000
σ0.000
min2753.000-2731.000=22.000
max2753.000-2731.000=22.000
mean9.120-8.046=1.074
σ0.536-0.392=0.144
min8.210-7.794=0.416
max9.581-8.739=0.842
iters=5
new-facts=6402
prior-facts=6402
mean5193.760-5168.748=25.012
σ0.090-0.210=-0.120
min5193.686-5168.403=25.283
max5193.860-5168.935=24.925
mean3241.400-3365.400=-124.000
σ340.469-410.562=-70.093
min2753.000-2965.000=-212.000
max3683.000-3785.000=-102.000
mean9.028-9.201=-0.173
σ0.390-0.568=-0.178
min8.747-8.540=0.207
max9.700-9.813=-0.112

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.978-1.000=-0.022
σ0.063-0.067=-0.004
min0.941-0.943=-0.002
max1.088-1.073=0.016

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.492-460.358=5.135
σ572.681-572.652=0.030
min179.139-174.024=5.116
max1324.514-1319.335=5.179
mean79.500
σ7.000
min76.000
max90.000
mean2753.000-2731.000=22.000
σ0.000
min2753.000-2731.000=22.000
max2753.000-2731.000=22.000
mean0.563-0.552=0.011
σ0.563-0.556=0.006
min0.278-0.268=0.009
max1.407-1.386=0.021
policies=20
mean1791.697-1740.490=51.207
σ0.342-0.322=0.021
min1791.478-1740.295=51.182
max1792.206-1740.971=51.235
mean760.000
σ0.000
min760.000
max760.000
mean2753.000-2731.000=22.000
σ0.000
min2753.000-2731.000=22.000
max2753.000-2731.000=22.000
mean2.808-2.691=0.118
σ0.007-0.011=-0.004
min2.804-2.676=0.128
max2.819-2.702=0.117
policies=200
mean17923.419-17411.897=511.522
σ0.418-0.536=-0.118
min17923.106-17411.546=511.560
max17924.033-17412.694=511.340
mean7600.000
σ0.000
min7600.000
max7600.000
mean2753.000-2731.000=22.000
σ0.000
min2753.000-2731.000=22.000
max2753.000-2731.000=22.000
mean28.212-27.063=1.149
σ0.121-0.075=0.047
min28.108-26.997=1.111
max28.385-27.170=1.215