Compare commits

Home / Compare dfce4e88 .. c3cda4c0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.707-70.782=-0.075
σ0.045-0.045=-0.001
min70.681-70.753=-0.072
max70.832-70.908=-0.076
mean411.000-418.000=-7.000
σ0.000
min411.000-418.000=-7.000
max411.000-418.000=-7.000
mean0.161-0.158=0.003
σ0.004-0.004=0.000
min0.156-0.154=0.002
max0.168-0.165=0.004
cache=y
dps=1
iters=10
policies=100
mean21.412-21.493=-0.081
σ0.003-0.002=0.000
min21.408-21.490=-0.082
max21.416-21.497=-0.082
mean411.000-418.000=-7.000
σ0.000
min411.000-418.000=-7.000
max411.000-418.000=-7.000
mean0.065-0.065=-0.000
σ0.002-0.003=-0.001
min0.063-0.063=0.001
max0.071-0.073=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.932-1754.897=0.035
σ0.362-0.360=0.002
min1754.357-1754.332=0.025
max1755.522-1755.477=0.045
mean1652.350-1653.050=-0.700
σ620.187-616.026=4.161
min679.000-652.000=27.000
max2784.000-2492.000=292.000
mean2.810-2.801=0.009
σ0.170-0.185=-0.015
min2.365-2.343=0.022
max3.105-3.208=-0.102

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.792-272.762=0.030
σ0.003-0.009=-0.007
min272.788-272.753=0.035
max272.794-272.774=0.020
mean2784.000-2492.000=292.000
σ0.000
min2784.000-2492.000=292.000
max2784.000-2492.000=292.000
mean0.377-0.395=-0.018
σ0.001-0.012=-0.011
min0.376-0.381=-0.006
max0.379-0.404=-0.025
iters=5
new-facts=1
prior-facts=6402
mean1933.229-1933.127=0.102
σ0.012-0.016=-0.004
min1933.215-1933.106=0.109
max1933.243-1933.146=0.097
mean2784.000-2492.000=292.000
σ0.000
min2784.000-2492.000=292.000
max2784.000-2492.000=292.000
mean2.987-3.062=-0.075
σ0.101-0.035=0.066
min2.878-3.017=-0.139
max3.143-3.104=0.038
iters=5
new-facts=6402
prior-facts=1
mean4756.832-4753.878=2.954
σ7.638-0.895=6.742
min4752.915-4753.328=-0.413
max4770.484-4755.472=15.012
mean2784.000-2492.000=292.000
σ0.000
min2784.000-2492.000=292.000
max2784.000-2492.000=292.000
mean8.755-8.844=-0.089
σ0.252-0.397=-0.145
min8.483-8.511=-0.028
max9.064-9.427=-0.363
iters=5
new-facts=6402
prior-facts=6402
mean4944.381-4944.363=0.017
σ0.168-0.016=0.152
min4944.082-4944.342=-0.260
max4944.480-4944.379=0.101
mean3001.000-2931.600=69.400
σ225.536-370.527=-144.991
min2784.000-2492.000=292.000
max3334.000-3439.000=-105.000
mean8.522-8.456=0.066
σ0.089-0.137=-0.048
min8.421-8.373=0.047
max8.620-8.691=-0.071

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.089-1.732=-0.643
σ0.194-0.133=0.060
min0.910-1.537=-0.628
max1.349-1.906=-0.557

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.332-468.632=-0.300
σ574.238-574.882=-0.644
min181.203-181.187=0.016
max1329.689-1330.955=-1.266
mean88.250
σ8.500
min84.000
max101.000
mean2784.000-2492.000=292.000
σ0.000
min2784.000-2492.000=292.000
max2784.000-2492.000=292.000
mean0.444-0.568=-0.124
σ0.301-0.549=-0.248
min0.291-0.284=0.007
max0.895-1.391=-0.496
policies=20
mean1812.368-1812.176=0.191
σ0.405-0.389=0.016
min1812.095-1811.919=0.176
max1812.962-1812.751=0.211
mean840.000
σ0.000
min840.000
max840.000
mean2784.000-2492.000=292.000
σ0.000
min2784.000-2492.000=292.000
max2784.000-2492.000=292.000
mean2.885-2.839=0.046
σ0.016-0.015=0.001
min2.865-2.820=0.045
max2.902-2.853=0.049
policies=200
mean18129.105-18129.193=-0.088
σ0.464-0.547=-0.083
min18128.725-18128.792=-0.067
max18129.689-18130.001=-0.313
mean8400.000
σ0.000
min8400.000
max8400.000
mean2784.000-2492.000=292.000
σ0.000
min2784.000-2492.000=292.000
max2784.000-2492.000=292.000
mean28.423-28.634=-0.211
σ0.190-0.060=0.130
min28.283-28.556=-0.273
max28.695-28.701=-0.006