Compare commits

Home / Compare 7ff81529 .. 05a708cc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.778-70.779=-0.002
σ0.052-0.050=0.002
min70.747-70.748=-0.001
max70.922-70.919=0.002
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.158-0.161=-0.003
σ0.006-0.003=0.003
min0.149-0.158=-0.009
max0.166-0.167=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=-0.000
σ0.003-0.002=0.000
min21.488-21.489=-0.001
max21.497-21.496=0.001
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.063-0.065=-0.003
σ0.004-0.002=0.001
min0.059-0.064=-0.004
max0.071-0.071=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.880-1751.881=-0.000
σ0.361-0.363=-0.002
min1751.310-1751.314=-0.004
max1752.464-1752.461=0.002
mean1663.200-1650.500=12.700
σ638.915-642.996=-4.081
min674.000-631.000=43.000
max2694.000-2846.000=-152.000
mean2.806-2.786=0.020
σ0.186-0.185=0.001
min2.237-2.415=-0.178
max3.011-3.003=0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.347-269.374=-0.027
σ0.005-0.008=-0.003
min269.340-269.367=-0.027
max269.353-269.387=-0.034
mean2694.000-2846.000=-152.000
σ0.000
min2694.000-2846.000=-152.000
max2694.000-2846.000=-152.000
mean0.380-0.376=0.004
σ0.006-0.004=0.003
min0.376-0.373=0.003
max0.391-0.382=0.009
iters=5
new-facts=1
prior-facts=6402
mean1929.750-1929.744=0.006
σ0.013-0.024=-0.011
min1929.731-1929.714=0.016
max1929.765-1929.780=-0.015
mean2694.000-2846.000=-152.000
σ0.000
min2694.000-2846.000=-152.000
max2694.000-2846.000=-152.000
mean3.025-2.938=0.087
σ0.220-0.259=-0.039
min2.783-2.483=0.301
max3.387-3.106=0.281
iters=5
new-facts=6402
prior-facts=1
mean4750.510-4750.530=-0.021
σ0.809-0.829=-0.020
min4750.091-4750.114=-0.023
max4751.955-4752.012=-0.057
mean2694.000-2846.000=-152.000
σ0.000
min2694.000-2846.000=-152.000
max2694.000-2846.000=-152.000
mean8.350-8.321=0.029
σ0.392-0.292=0.100
min7.706-7.821=-0.115
max8.728-8.552=0.177
iters=5
new-facts=6402
prior-facts=6402
mean4940.854-4940.980=-0.127
σ0.182-0.024=0.158
min4940.629-4940.950=-0.321
max4940.993-4941.000=-0.007
mean3008.200-3011.800=-3.600
σ339.582-185.334=154.248
min2694.000-2846.000=-152.000
max3506.000-3297.000=209.000
mean8.759-8.451=0.308
σ0.465-0.084=0.380
min8.290-8.307=-0.017
max9.269-8.522=0.747

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.164-1.015=0.150
σ0.269-0.134=0.136
min0.928-0.925=0.002
max1.459-1.235=0.224

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.066-466.066=-0.001
σ574.945-574.923=0.022
min178.589-178.593=-0.005
max1328.483-1328.451=0.032
mean86.250
σ8.500
min82.000
max99.000
mean2694.000-2846.000=-152.000
σ0.000
min2694.000-2846.000=-152.000
max2694.000-2846.000=-152.000
mean0.557-0.475=0.082
σ0.559-0.376=0.184
min0.267-0.282=-0.015
max1.396-1.038=0.358
policies=20
mean1786.147-1786.195=-0.048
σ0.358-0.368=-0.010
min1785.927-1785.933=-0.007
max1786.683-1786.738=-0.056
mean820.000
σ0.000
min820.000
max820.000
mean2694.000-2846.000=-152.000
σ0.000
min2694.000-2846.000=-152.000
max2694.000-2846.000=-152.000
mean2.763-2.857=-0.094
σ0.024-0.006=0.017
min2.731-2.850=-0.118
max2.785-2.865=-0.079
policies=200
mean17868.462-17868.578=-0.116
σ0.506-0.501=0.005
min17868.169-17868.226=-0.058
max17869.220-17869.321=-0.102
mean8200.000
σ0.000
min8200.000
max8200.000
mean2694.000-2846.000=-152.000
σ0.000
min2694.000-2846.000=-152.000
max2694.000-2846.000=-152.000
mean27.849-28.400=-0.551
σ0.070-0.400=-0.330
min27.778-27.843=-0.064
max27.945-28.722=-0.777