Compare commits

Home / Compare 07979bf6 .. da149a4e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.281-70.280=0.001
σ0.046-0.045=0.001
min70.253-70.252=0.002
max70.408-70.404=0.004
mean414.000
σ0.000
min414.000
max414.000
mean0.160-0.156=0.004
σ0.003-0.003=-0.000
min0.156-0.152=0.004
max0.166-0.162=0.004
cache=y
dps=1
iters=10
policies=100
mean20.992-20.992=-0.000
σ0.003-0.003=0.000
min20.988-20.988=-0.000
max20.996-20.996=-0.000
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.066=-0.001
σ0.002-0.003=-0.001
min0.063-0.063=0.000
max0.071-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.096-1754.095=0.000
σ0.361-0.361=-0.000
min1753.528-1753.529=-0.001
max1754.676-1754.677=-0.001
mean1658.850-1666.250=-7.400
σ632.523-636.457=-3.934
min628.000-677.000=-49.000
max2711.000-2708.000=3.000
mean2.855-2.861=-0.006
σ0.109-0.175=-0.066
min2.599-2.382=0.217
max3.045-3.109=-0.063

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.953-271.595=0.359
σ0.007-0.007=0.000
min271.948-271.586=0.362
max271.965-271.603=0.362
mean2711.000-2708.000=3.000
σ0.000
min2711.000-2708.000=3.000
max2711.000-2708.000=3.000
mean0.384-0.379=0.005
σ0.008-0.001=0.007
min0.378-0.378=0.001
max0.398-0.380=0.018
iters=5
new-facts=1
prior-facts=6402
mean1932.329-1932.002=0.326
σ0.014-0.015=-0.001
min1932.311-1931.976=0.335
max1932.344-1932.013=0.331
mean2711.000-2708.000=3.000
σ0.000
min2711.000-2708.000=3.000
max2711.000-2708.000=3.000
mean2.900-2.506=0.394
σ0.262-0.048=0.215
min2.440-2.459=-0.019
max3.085-2.569=0.516
iters=5
new-facts=6402
prior-facts=1
mean4753.096-4752.787=0.309
σ0.895-0.829=0.065
min4752.580-4752.341=0.239
max4754.687-4754.265=0.422
mean2711.000-2708.000=3.000
σ0.000
min2711.000-2708.000=3.000
max2711.000-2708.000=3.000
mean8.558-8.195=0.364
σ0.378-0.339=0.038
min7.956-7.704=0.252
max8.952-8.536=0.416
iters=5
new-facts=6402
prior-facts=6402
mean4943.489-4943.207=0.282
σ0.164-0.019=0.146
min4943.196-4943.181=0.015
max4943.573-4943.228=0.345
mean2974.200-3030.800=-56.600
σ233.326-232.918=0.409
min2711.000-2708.000=3.000
max3301.000-3327.000=-26.000
mean8.416-8.564=-0.148
σ0.098-0.123=-0.024
min8.247-8.444=-0.196
max8.485-8.715=-0.229

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.997-1.059=-0.062
σ0.141-0.177=-0.036
min0.933-0.932=0.001
max1.249-1.305=-0.056

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.667-468.642=0.025
σ574.938-574.941=-0.003
min181.187-181.163=0.024
max1331.074-1331.054=0.020
mean88.250
σ8.500
min84.000
max101.000
mean2711.000-2708.000=3.000
σ0.000
min2711.000-2708.000=3.000
max2711.000-2708.000=3.000
mean0.562-0.569=-0.007
σ0.539-0.555=-0.016
min0.288-0.285=0.002
max1.370-1.401=-0.031
policies=20
mean1812.212-1811.920=0.293
σ0.383-0.390=-0.007
min1811.946-1811.657=0.289
max1812.776-1812.498=0.279
mean840.000
σ0.000
min840.000
max840.000
mean2711.000-2708.000=3.000
σ0.000
min2711.000-2708.000=3.000
max2711.000-2708.000=3.000
mean2.852-2.832=0.019
σ0.024-0.013=0.011
min2.821-2.823=-0.002
max2.871-2.851=0.020
policies=200
mean18129.066-18126.664=2.402
σ0.612-0.501=0.111
min18128.701-18126.291=2.409
max18129.982-18127.377=2.605
mean8400.000
σ0.000
min8400.000
max8400.000
mean2711.000-2708.000=3.000
σ0.000
min2711.000-2708.000=3.000
max2711.000-2708.000=3.000
mean28.556-28.666=-0.111
σ0.065-0.097=-0.032
min28.465-28.597=-0.132
max28.618-28.805=-0.187