Compare commits

Home / Compare 9051ccdf .. cd6e6f2b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.783-70.781=0.001
σ0.045-0.046=-0.001
min70.752-70.751=0.001
max70.907-70.909=-0.002
mean415.000-415.800=-0.800
σ0.000-0.422=-0.422
min415.000
max415.000-416.000=-1.000
mean0.163-0.160=0.003
σ0.005-0.003=0.002
min0.158-0.158=0.000
max0.172-0.165=0.007
cache=y
dps=1
iters=10
policies=100
mean21.492-21.493=-0.001
σ0.003-0.003=0.000
min21.484-21.490=-0.006
max21.495-21.500=-0.005
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.064-0.065=-0.001
σ0.004-0.002=0.001
min0.060-0.063=-0.003
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1754.093=0.002
σ0.359-0.363=-0.003
min1753.521-1753.530=-0.009
max1754.663-1754.683=-0.020
mean1671.650-1676.600=-4.950
σ645.647-644.090=1.557
min624.000-686.000=-62.000
max2743.000-2751.000=-8.000
mean2.768-2.816=-0.048
σ0.233-0.138=0.095
min2.150-2.498=-0.348
max3.030-3.013=0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.953-271.954=-0.001
σ0.007-0.008=-0.001
min271.947-271.944=0.002
max271.966-271.963=0.003
mean2743.000-2751.000=-8.000
σ0.000
min2743.000-2751.000=-8.000
max2743.000-2751.000=-8.000
mean0.383-0.383=-0.000
σ0.007-0.008=-0.002
min0.379-0.377=0.002
max0.395-0.397=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.323-1932.326=-0.003
σ0.015-0.009=0.006
min1932.307-1932.311=-0.004
max1932.341-1932.335=0.006
mean2743.000-2751.000=-8.000
σ0.000
min2743.000-2751.000=-8.000
max2743.000-2751.000=-8.000
mean2.996-3.000=-0.004
σ0.137-0.055=0.082
min2.765-2.919=-0.154
max3.107-3.070=0.037
iters=5
new-facts=6402
prior-facts=1
mean4753.098-4752.936=0.162
σ0.907-0.975=-0.068
min4752.567-4752.145=0.422
max4754.701-4754.637=0.063
mean2743.000-2751.000=-8.000
σ0.000
min2743.000-2751.000=-8.000
max2743.000-2751.000=-8.000
mean8.548-8.780=-0.232
σ0.501-0.246=0.255
min7.943-8.473=-0.530
max9.121-9.132=-0.011
iters=5
new-facts=6402
prior-facts=6402
mean4943.558-4943.564=-0.005
σ0.014-0.017=-0.002
min4943.542-4943.545=-0.003
max4943.572-4943.579=-0.007
mean2996.400-3020.600=-24.200
σ307.126-232.997=74.128
min2743.000-2751.000=-8.000
max3462.000-3320.000=142.000
mean8.386-8.503=-0.118
σ0.055-0.117=-0.061
min8.307-8.357=-0.050
max8.454-8.636=-0.182

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.050-1.059=-0.009
σ0.269-0.148=0.121
min0.914-0.930=-0.017
max1.532-1.294=0.238

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.658-468.643=0.014
σ574.924-574.949=-0.026
min181.194-181.162=0.032
max1331.043-1331.067=-0.024
mean88.250
σ8.500
min84.000
max101.000
mean2743.000-2751.000=-8.000
σ0.000
min2743.000-2751.000=-8.000
max2743.000-2751.000=-8.000
mean0.566-0.590=-0.024
σ0.544-0.607=-0.063
min0.287-0.284=0.003
max1.382-1.501=-0.119
policies=20
mean1812.206-1811.930=0.276
σ0.374-0.376=-0.002
min1811.955-1811.710=0.245
max1812.761-1812.490=0.271
mean840.000
σ0.000
min840.000
max840.000
mean2743.000-2751.000=-8.000
σ0.000
min2743.000-2751.000=-8.000
max2743.000-2751.000=-8.000
mean2.827-2.841=-0.014
σ0.006-0.014=-0.007
min2.821-2.821=-0.000
max2.836-2.851=-0.016
policies=200
mean18129.089-18126.678=2.410
σ0.517-0.602=-0.085
min18128.747-18126.264=2.483
max18129.847-18127.555=2.292
mean8400.000
σ0.000
min8400.000
max8400.000
mean2743.000-2751.000=-8.000
σ0.000
min2743.000-2751.000=-8.000
max2743.000-2751.000=-8.000
mean28.589-28.472=0.116
σ0.150-0.069=0.082
min28.454-28.374=0.080
max28.804-28.531=0.274