Compare commits

Home / Compare 43487b8f .. db3b762e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.619-35.618=0.001
σ0.054-0.055=-0.000
min35.585-35.584=0.001
max35.771-35.772=-0.001
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.084-0.086=-0.001
σ0.006-0.003=0.002
min0.077-0.083=-0.006
max0.093-0.093=0.000
cache=y
dps=1
iters=10
policies=100
mean24.048-24.046=0.002
σ0.003-0.003=-0.001
min24.045-24.042=0.002
max24.054-24.052=0.001
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.068-0.065=0.004
σ0.003-0.005=-0.001
min0.066-0.061=0.005
max0.076-0.072=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.489-1756.491=-0.002
σ0.365-0.365=0.000
min1755.915-1755.916=-0.001
max1757.079-1757.080=-0.001
mean1656.400-1646.150=10.250
σ642.334-626.331=16.003
min629.000-632.000=-3.000
max2798.000-2834.000=-36.000
mean2.395-2.343=0.052
σ0.169-0.072=0.097
min2.237-2.249=-0.012
max2.830-2.548=0.282

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.770-324.764=0.006
σ0.038-0.051=-0.013
min324.703-324.674=0.029
max324.790-324.796=-0.006
mean2798.000-2834.000=-36.000
σ0.000
min2798.000-2834.000=-36.000
max2798.000-2834.000=-36.000
mean0.424-0.425=-0.001
σ0.001-0.003=-0.001
min0.422-0.422=-0.000
max0.426-0.429=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1985.321-1985.316=0.005
σ0.020-0.025=-0.005
min1985.295-1985.278=0.017
max1985.342-1985.341=0.001
mean2798.000-2834.000=-36.000
σ0.000
min2798.000-2834.000=-36.000
max2798.000-2834.000=-36.000
mean2.644-2.635=0.009
σ0.140-0.091=0.049
min2.536-2.559=-0.023
max2.859-2.749=0.110
iters=5
new-facts=6402
prior-facts=1
mean4808.984-4809.097=-0.113
σ7.497-7.736=-0.239
min4805.572-4805.582=-0.010
max4822.395-4822.935=-0.540
mean2798.000-2834.000=-36.000
σ0.000
min2798.000-2834.000=-36.000
max2798.000-2834.000=-36.000
mean8.986-9.035=-0.049
σ0.298-0.244=0.054
min8.623-8.714=-0.091
max9.443-9.379=0.065
iters=5
new-facts=6402
prior-facts=6402
mean4996.632-4996.555=0.077
σ0.031-0.166=-0.135
min4996.596-4996.261=0.335
max4996.662-4996.646=0.016
mean3058.600-3017.400=41.200
σ325.674-259.422=66.252
min2798.000-2834.000=-36.000
max3550.000-3431.000=119.000
mean8.615-8.506=0.109
σ0.378-0.064=0.314
min8.422-8.445=-0.023
max9.290-8.614=0.676

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.950-1.028=-0.079
σ0.055-0.125=-0.070
min0.918-0.913=0.005
max1.047-1.218=-0.171

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.213-463.207=0.006
σ574.773-574.771=0.002
min175.814-175.814=0.000
max1325.372-1325.363=0.009
mean86.250
σ8.500
min82.000
max99.000
mean2798.000-2834.000=-36.000
σ0.000
min2798.000-2834.000=-36.000
max2798.000-2834.000=-36.000
mean0.430-0.431=-0.001
σ0.297-0.302=-0.005
min0.278-0.279=-0.001
max0.876-0.884=-0.008
policies=20
mean1758.533-1758.495=0.039
σ0.353-0.353=-0.000
min1758.274-1758.258=0.017
max1759.047-1759.017=0.030
mean820.000
σ0.000
min820.000
max820.000
mean2798.000-2834.000=-36.000
σ0.000
min2798.000-2834.000=-36.000
max2798.000-2834.000=-36.000
mean2.839-2.788=0.050
σ0.110-0.008=0.102
min2.769-2.780=-0.011
max3.003-2.798=0.205
policies=200
mean17592.142-17592.131=0.012
σ0.512-0.514=-0.002
min17591.835-17591.864=-0.029
max17592.907-17592.901=0.006
mean8200.000
σ0.000
min8200.000
max8200.000
mean2798.000-2834.000=-36.000
σ0.000
min2798.000-2834.000=-36.000
max2798.000-2834.000=-36.000
mean27.550-27.865=-0.315
σ0.191-0.423=-0.232
min27.357-27.426=-0.069
max27.799-28.331=-0.532