Compare commits

Home / Compare 30eca2ab .. ac268ee2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-33.979=19.936
σ0.366-0.048=0.319
min53.788-33.951=19.837
max54.958-34.110=20.848
mean416.000
σ0.000
min416.000
max416.000
mean0.140-0.086=0.054
σ0.004-0.004=0.000
min0.137-0.083=0.054
max0.146-0.094=0.053
cache=y
dps=1
iters=10
policies=100
mean43.140-23.318=19.822
σ0.006-0.003=0.003
min43.135-23.313=19.822
max43.149-23.323=19.827
mean416.000
σ0.000
min416.000
max416.000
mean0.119-0.065=0.054
σ0.004-0.004=-0.000
min0.114-0.060=0.054
max0.125-0.074=0.051

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.809-1757.430=-765.621
σ1.252-0.365=0.887
min991.253-1756.856=-765.603
max997.079-1758.024=-760.946
mean1070.550-1664.400=-593.850
σ328.310-621.461=-293.151
min568.000-671.000=-103.000
max1644.000-2590.000=-946.000
mean1.538-2.341=-0.803
σ0.116-0.118=-0.002
min1.452-2.214=-0.761
max1.920-2.719=-0.798

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.412-326.575=-41.162
σ0.011-0.043=-0.032
min285.397-326.499=-41.102
max285.424-326.605=-41.180
mean1644.000-2590.000=-946.000
σ0.000
min1644.000-2590.000=-946.000
max1644.000-2590.000=-946.000
mean0.380-0.425=-0.045
σ0.007-0.008=-0.000
min0.370-0.420=-0.050
max0.389-0.439=-0.050
iters=5
new-facts=1
prior-facts=6402
mean1285.373-1988.737=-703.364
σ0.133-0.011=0.122
min1285.305-1988.723=-703.417
max1285.611-1988.749=-703.138
mean1644.000-2590.000=-946.000
σ0.000
min1644.000-2590.000=-946.000
max1644.000-2590.000=-946.000
mean1.877-2.733=-0.856
σ0.055-0.128=-0.073
min1.829-2.612=-0.783
max1.972-2.885=-0.913
iters=5
new-facts=6402
prior-facts=1
mean1807.753-4813.606=-3005.853
σ6.987-7.742=-0.755
min1804.380-4810.070=-3005.690
max1820.235-4827.454=-3007.218
mean1644.000-2590.000=-946.000
σ0.000
min1644.000-2590.000=-946.000
max1644.000-2590.000=-946.000
mean4.299-8.618=-4.320
σ0.173-0.667=-0.494
min4.067-7.800=-3.732
max4.491-9.437=-4.947
iters=5
new-facts=6402
prior-facts=6402
mean2070.195-5001.135=-2930.941
σ0.011-0.022=-0.011
min2070.183-5001.112=-2930.929
max2070.212-5001.159=-2930.946
mean1844.800-2951.400=-1106.600
σ189.405-349.685=-160.280
min1644.000-2590.000=-946.000
max2087.000-3445.000=-1358.000
mean4.514-9.607=-5.093
σ0.059-0.543=-0.484
min4.439-8.676=-4.237
max4.580-10.002=-5.422

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.189-1.227=-0.039
σ0.339-0.341=-0.002
min0.909-0.906=0.002
max1.762-1.748=0.015

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.787-464.564=-27.778
σ572.365-574.783=-2.419
min150.598-177.169=-26.571
max1295.334-1326.740=-31.406
mean90.250-88.250=2.000
σ8.500
min86.000-84.000=2.000
max103.000-101.000=2.000
mean1644.000-2590.000=-946.000
σ0.000
min1644.000-2590.000=-946.000
max1644.000-2590.000=-946.000
mean0.531-0.537=-0.006
σ0.559-0.533=0.026
min0.250-0.267=-0.017
max1.369-1.335=0.033
policies=20
mean1506.276-1772.030=-265.754
σ0.245-0.362=-0.118
min1506.126-1771.785=-265.659
max1506.642-1772.568=-265.926
mean860.000-840.000=20.000
σ0.000
min860.000-840.000=20.000
max860.000-840.000=20.000
mean1644.000-2590.000=-946.000
σ0.000
min1644.000-2590.000=-946.000
max1644.000-2590.000=-946.000
mean2.532-2.719=-0.187
σ0.026-0.034=-0.008
min2.507-2.691=-0.184
max2.565-2.767=-0.203
policies=200
mean15070.299-17727.478=-2657.179
σ0.123-0.443=-0.320
min15070.140-17727.130=-2656.990
max15070.437-17728.126=-2657.689
mean8600.000-8400.000=200.000
σ0.000
min8600.000-8400.000=200.000
max8600.000-8400.000=200.000
mean1644.000-2590.000=-946.000
σ0.000
min1644.000-2590.000=-946.000
max1644.000-2590.000=-946.000
mean25.610-27.406=-1.796
σ0.216-0.111=0.105
min25.414-27.307=-1.893
max25.880-27.551=-1.672