Compare commits

Home / Compare 36c1177c .. 9e5b3d72

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.728-70.730=-0.002
σ0.052-0.047=0.005
min70.695-70.704=-0.009
max70.872-70.861=0.011
mean416.000-411.000=5.000
σ0.000
min416.000-411.000=5.000
max416.000-411.000=5.000
mean0.158-0.158=-0.000
σ0.005-0.006=-0.001
min0.152-0.150=0.002
max0.167-0.168=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.445-21.445=0.001
σ0.003-0.003=0.000
min21.442-21.440=0.002
max21.451-21.449=0.002
mean416.000-411.000=5.000
σ0.000
min416.000-411.000=5.000
max416.000-411.000=5.000
mean0.064-0.065=-0.002
σ0.003-0.003=0.001
min0.059-0.064=-0.005
max0.071-0.074=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.286-1754.527=0.758
σ0.358-0.360=-0.003
min1754.723-1753.965=0.758
max1755.858-1755.105=0.753
mean1649.900-1663.650=-13.750
σ631.887-643.462=-11.575
min640.000-610.000=30.000
max2849.000-2732.000=117.000
mean2.888-2.899=-0.011
σ0.177-0.153=0.024
min2.598-2.485=0.113
max3.403-3.151=0.252

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean274.364-273.607=0.757
σ0.014-0.009=0.005
min274.349-273.601=0.749
max274.384-273.622=0.762
mean2849.000-2732.000=117.000
σ0.000
min2849.000-2732.000=117.000
max2849.000-2732.000=117.000
mean0.386-0.385=0.002
σ0.005-0.006=-0.001
min0.383-0.380=0.002
max0.396-0.396=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1934.757-1933.993=0.764
σ0.010-0.006=0.004
min1934.744-1933.987=0.757
max1934.770-1933.999=0.771
mean2849.000-2732.000=117.000
σ0.000
min2849.000-2732.000=117.000
max2849.000-2732.000=117.000
mean3.163-2.887=0.275
σ0.156-0.254=-0.099
min3.018-2.467=0.551
max3.392-3.109=0.284
iters=5
new-facts=6402
prior-facts=1
mean4755.279-4754.756=0.523
σ1.043-0.914=0.129
min4754.536-4754.248=0.288
max4757.078-4756.373=0.705
mean2849.000-2732.000=117.000
σ0.000
min2849.000-2732.000=117.000
max2849.000-2732.000=117.000
mean8.780-8.982=-0.202
σ0.243-0.440=-0.198
min8.508-8.273=0.236
max9.038-9.481=-0.443
iters=5
new-facts=6402
prior-facts=6402
mean4945.977-4945.085=0.893
σ0.014-0.203=-0.189
min4945.960-4944.861=1.099
max4945.992-4945.239=0.752
mean3060.000-2972.200=87.800
σ272.310-219.062=53.248
min2849.000-2732.000=117.000
max3479.000-3285.000=194.000
mean8.425-8.514=-0.090
σ0.116-0.048=0.068
min8.333-8.454=-0.120
max8.627-8.555=0.072

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.025-1.002=0.023
σ0.137-0.141=-0.004
min0.930-0.938=-0.007
max1.249-1.255=-0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.840-472.843=-0.003
σ574.925-574.928=-0.003
min185.368-185.374=-0.006
max1335.228-1335.236=-0.007
mean88.250
σ8.500
min84.000
max101.000
mean2849.000-2732.000=117.000
σ0.000
min2849.000-2732.000=117.000
max2849.000-2732.000=117.000
mean0.484-0.570=-0.086
σ0.370-0.555=-0.185
min0.297-0.291=0.006
max1.039-1.403=-0.364
policies=20
mean1854.005-1853.993=0.012
σ0.370-0.377=-0.007
min1853.734-1853.738=-0.004
max1854.545-1854.550=-0.005
mean840.000
σ0.000
min840.000
max840.000
mean2849.000-2732.000=117.000
σ0.000
min2849.000-2732.000=117.000
max2849.000-2732.000=117.000
mean2.961-2.880=0.081
σ0.014-0.010=0.003
min2.950-2.871=0.079
max2.977-2.895=0.083
policies=200
mean18546.709-18546.607=0.102
σ0.500-0.510=-0.010
min18546.417-18546.297=0.120
max18547.457-18547.363=0.094
mean8400.000
σ0.000
min8400.000
max8400.000
mean2849.000-2732.000=117.000
σ0.000
min2849.000-2732.000=117.000
max2849.000-2732.000=117.000
mean29.345-28.964=0.381
σ0.425-0.113=0.312
min28.938-28.797=0.141
max29.789-29.046=0.743