Compare commits

Home / Compare 39d27a00 .. 4a71567a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.618=-0.000
σ0.054-0.054=-0.000
min35.591-35.589=0.002
max35.770-35.772=-0.002
mean414.700-413.000=1.700
σ0.483-0.000=0.483
min414.000-413.000=1.000
max415.000-413.000=2.000
mean0.086-0.086=-0.000
σ0.004-0.004=-0.000
min0.082-0.082=-0.000
max0.093-0.094=-0.001
cache=y
dps=1
iters=10
policies=100
mean24.047-24.047=-0.000
σ0.002-0.003=-0.001
min24.043-24.044=-0.001
max24.051-24.052=-0.001
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.070-0.069=0.001
σ0.003-0.003=-0.001
min0.067-0.066=0.001
max0.075-0.077=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.489-1756.490=-0.001
σ0.365-0.366=-0.001
min1755.914-1755.915=-0.001
max1757.080-1757.078=0.002
mean1649.750-1625.250=24.500
σ641.589-593.044=48.545
min633.000-657.000=-24.000
max2830.000-2423.000=407.000
mean2.342-2.316=0.026
σ0.072-0.072=-0.000
min2.261-2.250=0.010
max2.512-2.483=0.029

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.775-324.740=0.035
σ0.033-0.048=-0.016
min324.718-324.654=0.064
max324.794-324.765=0.029
mean2830.000-2423.000=407.000
σ0.000
min2830.000-2423.000=407.000
max2830.000-2423.000=407.000
mean0.428-0.433=-0.005
σ0.010-0.008=0.001
min0.420-0.425=-0.005
max0.440-0.445=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1985.329-1985.321=0.007
σ0.012-0.024=-0.011
min1985.308-1985.281=0.028
max1985.342-1985.339=0.003
mean2830.000-2423.000=407.000
σ0.000
min2830.000-2423.000=407.000
max2830.000-2423.000=407.000
mean2.613-2.577=0.036
σ0.104-0.080=0.023
min2.487-2.467=0.021
max2.753-2.677=0.076
iters=5
new-facts=6402
prior-facts=1
mean4809.112-4809.080=0.033
σ7.658-7.729=-0.071
min4805.610-4805.592=0.018
max4822.811-4822.907=-0.096
mean2830.000-2423.000=407.000
σ0.000
min2830.000-2423.000=407.000
max2830.000-2423.000=407.000
mean8.796-9.020=-0.224
σ0.528-0.251=0.277
min8.077-8.823=-0.745
max9.522-9.455=0.067
iters=5
new-facts=6402
prior-facts=6402
mean4996.626-4996.629=-0.004
σ0.031-0.021=0.010
min4996.591-4996.602=-0.011
max4996.663-4996.652=0.011
mean3071.800-2998.400=73.400
σ313.606-257.924=55.682
min2830.000-2615.000=215.000
max3551.000-3306.000=245.000
mean8.678-8.627=0.051
σ0.466-0.152=0.314
min8.417-8.365=0.052
max9.501-8.754=0.747

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.064-1.541=-0.476
σ0.189-0.193=-0.003
min0.912-1.205=-0.294
max1.386-1.668=-0.282

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.213-463.203=0.010
σ574.771-574.767=0.005
min175.818-175.813=0.005
max1325.370-1325.353=0.017
mean86.250
σ8.500
min82.000
max99.000
mean2830.000-2423.000=407.000
σ0.000
min2830.000-2423.000=407.000
max2830.000-2423.000=407.000
mean0.429-0.543=-0.115
σ0.295-0.540=-0.245
min0.278-0.265=0.013
max0.871-1.353=-0.482
policies=20
mean1758.525-1758.470=0.055
σ0.357-0.346=0.011
min1758.293-1758.229=0.064
max1759.055-1758.982=0.073
mean820.000
σ0.000
min820.000
max820.000
mean2830.000-2423.000=407.000
σ0.000
min2830.000-2423.000=407.000
max2830.000-2423.000=407.000
mean2.772-2.716=0.055
σ0.018-0.008=0.010
min2.746-2.707=0.039
max2.783-2.726=0.057
policies=200
mean17592.184-17592.140=0.044
σ0.429-0.504=-0.075
min17591.875-17591.838=0.037
max17592.816-17592.893=-0.077
mean8200.000
σ0.000
min8200.000
max8200.000
mean2830.000-2423.000=407.000
σ0.000
min2830.000-2423.000=407.000
max2830.000-2423.000=407.000
mean27.829-27.424=0.405
σ0.380-0.120=0.260
min27.473-27.307=0.166
max28.232-27.532=0.700