Compare commits

Home / Compare 95bbf205 .. 7297c688

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.048-73.032=0.016
σ0.048-0.046=0.002
min73.024-73.005=0.019
max73.182-73.160=0.022
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.171-0.157=0.014
σ0.009-0.006=0.003
min0.158-0.148=0.010
max0.183-0.165=0.018
cache=y
dps=1
iters=10
policies=100
mean23.739-23.731=0.008
σ0.003-0.003=-0.000
min23.734-23.725=0.009
max23.743-23.737=0.006
mean413.000
σ0.000
min413.000
max413.000
mean0.064-0.063=0.001
σ0.004-0.002=0.002
min0.060-0.061=-0.000
max0.072-0.066=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.788-1758.786=0.003
σ0.361-0.360=0.001
min1758.219-1758.208=0.011
max1759.372-1759.367=0.005
mean1651.200-1660.650=-9.450
σ622.441-627.456=-5.015
min671.000-623.000=48.000
max2770.000-2520.000=250.000
mean2.824-2.850=-0.026
σ0.092-0.109=-0.017
min2.640-2.555=0.085
max2.968-3.059=-0.091

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean323.990-324.011=-0.021
σ0.049-0.047=0.002
min323.904-323.927=-0.023
max324.027-324.040=-0.013
mean2770.000-2520.000=250.000
σ0.000
min2770.000-2520.000=250.000
max2770.000-2520.000=250.000
mean0.427-0.425=0.002
σ0.002-0.004=-0.002
min0.426-0.423=0.003
max0.430-0.432=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1984.581-1984.589=-0.009
σ0.020-0.019=0.001
min1984.555-1984.557=-0.002
max1984.603-1984.605=-0.002
mean2770.000-2520.000=250.000
σ0.000
min2770.000-2520.000=250.000
max2770.000-2520.000=250.000
mean2.633-2.676=-0.043
σ0.108-0.170=-0.062
min2.557-2.541=0.016
max2.818-2.895=-0.077
iters=5
new-facts=6402
prior-facts=1
mean4808.259-4808.228=0.031
σ7.770-7.742=0.028
min4804.671-4804.653=0.018
max4822.157-4822.077=0.080
mean2770.000-2520.000=250.000
σ0.000
min2770.000-2520.000=250.000
max2770.000-2520.000=250.000
mean8.771-8.904=-0.133
σ0.284-0.201=0.083
min8.368-8.620=-0.252
max9.083-9.164=-0.080
iters=5
new-facts=6402
prior-facts=6402
mean4995.740-4995.795=-0.056
σ0.172-0.019=0.153
min4995.433-4995.771=-0.338
max4995.830-4995.819=0.011
mean3030.600-2948.000=82.600
σ289.263-267.398=21.865
min2770.000-2588.000=182.000
max3431.000-3288.000=143.000
mean8.607-8.545=0.062
σ0.206-0.057=0.150
min8.443-8.459=-0.016
max8.913-8.614=0.299

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.986-1.582=-0.596
σ0.140-0.202=-0.063
min0.920-1.235=-0.316
max1.236-1.765=-0.529

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.352-468.323=0.030
σ574.229-574.231=-0.002
min181.228-181.202=0.026
max1329.696-1329.670=0.027
mean88.250
σ8.500
min84.000
max101.000
mean2770.000-2520.000=250.000
σ0.000
min2770.000-2520.000=250.000
max2770.000-2520.000=250.000
mean0.445-0.563=-0.118
σ0.304-0.565=-0.261
min0.286-0.268=0.018
max0.901-1.411=-0.510
policies=20
mean1812.630-1812.389=0.240
σ0.384-0.386=-0.002
min1812.359-1812.128=0.231
max1813.194-1812.962=0.232
mean840.000
σ0.000
min840.000
max840.000
mean2770.000-2520.000=250.000
σ0.000
min2770.000-2520.000=250.000
max2770.000-2520.000=250.000
mean2.883-2.805=0.078
σ0.010-0.012=-0.001
min2.875-2.790=0.085
max2.897-2.817=0.080
policies=200
mean18131.674-18131.240=0.434
σ0.473-0.559=-0.086
min18131.379-18130.863=0.516
max18132.371-18132.066=0.305
mean8400.000
σ0.000
min8400.000
max8400.000
mean2770.000-2520.000=250.000
σ0.000
min2770.000-2520.000=250.000
max2770.000-2520.000=250.000
mean28.437-28.396=0.041
σ0.162-0.159=0.003
min28.277-28.204=0.073
max28.663-28.560=0.103