Compare commits

Home / Compare a4bd7c7a .. 4da8fc2d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.964-35.963=0.001
σ0.105-0.106=-0.001
min35.919-35.912=0.007
max36.263-36.263=0.000
mean411.000-413.900=-2.900
σ0.000-0.316=-0.316
min411.000-413.000=-2.000
max411.000-414.000=-3.000
mean0.078-0.076=0.002
σ0.004-0.005=-0.001
min0.075-0.070=0.006
max0.087-0.083=0.004
cache=y
dps=1
iters=10
policies=100
mean26.201-26.201=-0.000
σ0.003-0.002=0.000
min26.196-26.198=-0.002
max26.205-26.205=-0.000
mean411.600-414.000=-2.400
σ0.516-0.000=0.516
min411.000-414.000=-3.000
max412.000-414.000=-2.000
mean0.061-0.061=0.001
σ0.004-0.003=0.001
min0.058-0.059=-0.001
max0.068-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.266-1758.263=0.003
σ0.371-0.372=-0.000
min1757.689-1757.686=0.003
max1758.860-1758.857=0.003
mean1653.300-1645.850=7.450
σ620.365-638.968=-18.602
min685.000-673.000=12.000
max2740.000-2730.000=10.000
mean2.364-2.386=-0.023
σ0.112-0.102=0.009
min2.183-2.262=-0.079
max2.584-2.603=-0.019

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.317-279.318=-0.001
σ0.012-0.006=0.005
min279.304-279.310=-0.005
max279.333-279.324=0.009
mean2740.000-2730.000=10.000
σ0.000
min2740.000-2730.000=10.000
max2740.000-2730.000=10.000
mean0.418-0.412=0.006
σ0.012-0.006=0.006
min0.404-0.407=-0.003
max0.433-0.419=0.013
iters=5
new-facts=1
prior-facts=6402
mean2178.263-2178.262=0.002
σ0.012-0.023=-0.012
min2178.250-2178.221=0.029
max2178.274-2178.277=-0.003
mean2740.000-2730.000=10.000
σ0.000
min2740.000-2730.000=10.000
max2740.000-2730.000=10.000
mean3.360-3.332=0.028
σ0.188-0.130=0.058
min3.176-3.232=-0.056
max3.676-3.559=0.117
iters=5
new-facts=6402
prior-facts=1
mean5047.938-5047.799=0.139
σ0.996-1.116=-0.120
min5047.321-5046.722=0.599
max5049.706-5049.687=0.020
mean2740.000-2730.000=10.000
σ0.000
min2740.000-2730.000=10.000
max2740.000-2730.000=10.000
mean8.786-8.799=-0.013
σ0.628-0.540=0.088
min8.108-8.105=0.003
max9.613-9.445=0.167
iters=5
new-facts=6402
prior-facts=6402
mean5185.307-5185.171=0.136
σ0.091-0.259=-0.168
min5185.237-5184.889=0.348
max5185.411-5185.411=0.000
mean3221.600-3191.400=30.200
σ469.708-355.151=114.557
min2740.000-2820.000=-80.000
max3873.000-3735.000=138.000
mean8.721-9.002=-0.281
σ0.161-0.473=-0.312
min8.566-8.611=-0.044
max8.988-9.767=-0.779

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.003-1.032=-0.029
σ0.129-0.072=0.057
min0.941-0.941=0.000
max1.234-1.087=0.147

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.358-465.344=0.013
σ572.654-572.655=-0.001
min179.008-179.007=0.001
max1324.339-1324.327=0.012
mean79.500
σ7.000
min76.000
max90.000
mean2740.000-2730.000=10.000
σ0.000
min2740.000-2730.000=10.000
max2740.000-2730.000=10.000
mean0.498-0.560=-0.062
σ0.422-0.543=-0.121
min0.284-0.282=0.002
max1.131-1.374=-0.243
policies=20
mean1790.334-1790.329=0.005
σ0.317-0.345=-0.027
min1790.117-1790.103=0.014
max1790.805-1790.841=-0.036
mean760.000
σ0.000
min760.000
max760.000
mean2740.000-2730.000=10.000
σ0.000
min2740.000-2730.000=10.000
max2740.000-2730.000=10.000
mean2.798-2.810=-0.012
σ0.023-0.018=0.005
min2.781-2.792=-0.011
max2.831-2.828=0.003
policies=200
mean17909.965-17910.038=-0.073
σ0.581-0.510=0.071
min17909.577-17909.637=-0.060
max17910.825-17910.785=0.040
mean7600.000
σ0.000
min7600.000
max7600.000
mean2740.000-2730.000=10.000
σ0.000
min2740.000-2730.000=10.000
max2740.000-2730.000=10.000
mean28.283-28.260=0.023
σ0.121-0.128=-0.007
min28.119-28.146=-0.027
max28.396-28.385=0.011