Compare commits

Home / Compare 339123d0 .. 85ca6517

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.042=-0.002
σ0.050-0.048=0.002
min31.000-31.000=-0.000
max31.179-31.174=0.005
mean414.000
σ0.000
min414.000
max414.000
mean0.079-0.077=0.002
σ0.004-0.004=-0.000
min0.072-0.070=0.003
max0.086-0.085=0.001
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=-0.001
σ0.002-0.003=-0.001
min21.137-21.138=-0.001
max21.145-21.147=-0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.064=0.001
σ0.003-0.003=-0.000
min0.063-0.060=0.004
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.409-1751.411=-0.002
σ0.359-0.361=-0.002
min1750.848-1750.846=0.003
max1751.994-1751.986=0.008
mean1663.100-1640.350=22.750
σ638.992-619.230=19.762
min620.000-650.000=-30.000
max2818.000-2478.000=340.000
mean2.824-2.810=0.014
σ0.153-0.140=0.013
min2.497-2.466=0.031
max3.124-3.048=0.076

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.645-279.075=-7.430
σ0.009-0.011=-0.002
min271.633-279.062=-7.429
max271.654-279.086=-7.432
mean2818.000-2478.000=340.000
σ0.000
min2818.000-2478.000=340.000
max2818.000-2478.000=340.000
mean0.386-0.396=-0.010
σ0.011-0.009=0.003
min0.377-0.388=-0.011
max0.403-0.409=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1932.094-1939.502=-7.407
σ0.015-0.002=0.013
min1932.078-1939.499=-7.421
max1932.109-1939.503=-7.395
mean2818.000-2478.000=340.000
σ0.000
min2818.000-2478.000=340.000
max2818.000-2478.000=340.000
mean2.621-3.018=-0.397
σ0.159-0.102=0.056
min2.425-2.908=-0.482
max2.841-3.173=-0.332
iters=5
new-facts=6402
prior-facts=1
mean4752.579-4759.840=-7.261
σ0.854-0.749=0.105
min4752.061-4758.990=-6.930
max4754.098-4761.046=-6.948
mean2818.000-2478.000=340.000
σ0.000
min2818.000-2478.000=340.000
max2818.000-2478.000=340.000
mean8.500-8.144=0.357
σ0.594-0.594=0.001
min7.732-7.792=-0.060
max9.130-9.181=-0.051
iters=5
new-facts=6402
prior-facts=6402
mean4943.043-4950.392=-7.350
σ0.076-0.203=-0.127
min4942.983-4950.058=-7.075
max4943.128-4950.555=-7.427
mean3061.200-2937.000=124.200
σ314.276-381.737=-67.461
min2818.000-2478.000=340.000
max3542.000-3447.000=95.000
mean8.426-8.413=0.013
σ0.068-0.066=0.003
min8.317-8.311=0.007
max8.498-8.476=0.022

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.090-1.836=-0.746
σ0.113-0.102=0.011
min0.955-1.704=-0.749
max1.269-1.971=-0.702

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.123-463.334=1.789
σ575.767-572.199=3.569
min177.232-177.233=-0.002
max1328.773-1321.631=7.142
mean79.750
σ7.500
min76.000
max91.000
mean2818.000-2478.000=340.000
σ0.000
min2818.000-2478.000=340.000
max2818.000-2478.000=340.000
mean0.444-0.567=-0.124
σ0.311-0.571=-0.260
min0.284-0.276=0.008
max0.911-1.424=-0.513
policies=20
mean1772.604-1772.588=0.016
σ0.330-0.333=-0.003
min1772.353-1772.367=-0.014
max1773.080-1773.082=-0.002
mean760.000
σ0.000
min760.000
max760.000
mean2818.000-2478.000=340.000
σ0.000
min2818.000-2478.000=340.000
max2818.000-2478.000=340.000
mean2.864-2.743=0.121
σ0.108-0.010=0.097
min2.752-2.732=0.019
max3.008-2.754=0.254
policies=200
mean17732.514-17732.440=0.075
σ0.512-0.375=0.137
min17732.209-17732.220=-0.011
max17733.280-17732.999=0.281
mean7600.000
σ0.000
min7600.000
max7600.000
mean2818.000-2478.000=340.000
σ0.000
min2818.000-2478.000=340.000
max2818.000-2478.000=340.000
mean27.846-27.758=0.088
σ0.188-0.121=0.067
min27.733-27.641=0.092
max28.127-27.928=0.199