Compare commits

Home / Compare 1a537c05 .. f36e86c5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-30.769=0.271
σ0.049-0.046=0.004
min31.005-30.731=0.274
max31.177-30.894=0.283
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.080-0.075=0.005
σ0.003-0.005=-0.002
min0.077-0.069=0.009
max0.086-0.084=0.002
cache=y
dps=1
iters=10
policies=100
mean21.142-21.061=0.081
σ0.003-0.002=0.001
min21.137-21.057=0.080
max21.147-21.064=0.083
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.063-0.064=-0.001
σ0.003-0.003=-0.000
min0.060-0.062=-0.002
max0.071-0.071=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1751.418=-0.007
σ0.359-0.362=-0.002
min1750.845-1750.853=-0.008
max1751.974-1751.998=-0.024
mean1632.700-1655.000=-22.300
σ610.629-617.898=-7.269
min653.000-661.000=-8.000
max2450.000-2494.000=-44.000
mean2.802-2.818=-0.017
σ0.137-0.140=-0.003
min2.417-2.397=0.020
max2.945-3.083=-0.138

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.407-275.758=-2.350
σ0.010-0.008=0.003
min273.399-275.751=-2.352
max273.422-275.766=-2.344
mean2450.000-2494.000=-44.000
σ0.000
min2450.000-2494.000=-44.000
max2450.000-2494.000=-44.000
mean0.402-0.400=0.002
σ0.007-0.007=0.001
min0.391-0.395=-0.004
max0.410-0.412=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.838-2168.282=-234.443
σ0.013-0.011=0.001
min1933.822-2168.263=-234.441
max1933.851-2168.291=-234.440
mean2450.000-2494.000=-44.000
σ0.000
min2450.000-2494.000=-44.000
max2450.000-2494.000=-44.000
mean3.105-2.991=0.115
σ0.133-0.160=-0.027
min2.998-2.793=0.206
max3.279-3.121=0.158
iters=5
new-facts=6402
prior-facts=1
mean4754.250-5047.878=-293.627
σ0.702-0.740=-0.038
min4753.740-5047.225=-293.485
max4755.488-5049.148=-293.661
mean2450.000-2494.000=-44.000
σ0.000
min2450.000-2494.000=-44.000
max2450.000-2494.000=-44.000
mean8.753-8.846=-0.094
σ0.730-0.452=0.279
min7.686-8.286=-0.600
max9.642-9.392=0.250
iters=5
new-facts=6402
prior-facts=6402
mean4944.807-5178.877=-234.070
σ0.086-0.387=-0.300
min4944.739-5178.446=-233.707
max4944.902-5179.342=-234.440
mean2980.000-3221.800=-241.800
σ351.343-383.720=-32.376
min2529.000-2704.000=-175.000
max3317.000-3723.000=-406.000
mean8.676-9.763=-1.087
σ0.170-0.317=-0.147
min8.465-9.414=-0.949
max8.891-10.105=-1.214

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.862-1.747=0.116
σ0.118-0.174=-0.056
min1.695-1.517=0.178
max2.021-1.913=0.108

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.330-463.564=-0.234
σ572.195-572.650=-0.456
min177.231-177.238=-0.007
max1321.622-1322.539=-0.917
mean79.750
σ7.500
min76.000
max91.000
mean2450.000-2494.000=-44.000
σ0.000
min2450.000-2494.000=-44.000
max2450.000-2494.000=-44.000
mean0.579-0.569=0.010
σ0.589-0.586=0.003
min0.279-0.275=0.004
max1.462-1.448=0.014
policies=20
mean1772.580-1772.637=-0.057
σ0.313-0.320=-0.007
min1772.366-1772.413=-0.047
max1773.044-1773.110=-0.066
mean760.000
σ0.000
min760.000
max760.000
mean2450.000-2494.000=-44.000
σ0.000
min2450.000-2494.000=-44.000
max2450.000-2494.000=-44.000
mean2.721-2.730=-0.009
σ0.068-0.012=0.056
min2.620-2.715=-0.094
max2.767-2.742=0.025
policies=200
mean17732.499-17733.056=-0.557
σ0.456-0.497=-0.041
min17732.195-17732.778=-0.583
max17733.178-17733.801=-0.623
mean7600.000
σ0.000
min7600.000
max7600.000
mean2450.000-2494.000=-44.000
σ0.000
min2450.000-2494.000=-44.000
max2450.000-2494.000=-44.000
mean27.731-27.627=0.104
σ0.207-0.146=0.061
min27.449-27.519=-0.071
max27.920-27.839=0.081