Compare commits

Home / Compare c785d73a .. 33450147

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.701-70.700=0.001
σ0.047-0.047=0.001
min70.668-70.670=-0.002
max70.832-70.829=0.003
mean412.000-411.600=0.400
σ0.000-0.516=-0.516
min412.000-411.000=1.000
max412.000
mean0.159-0.159=0.001
σ0.006-0.005=0.001
min0.151-0.151=0.000
max0.169-0.170=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.408-21.409=-0.000
σ0.003-0.002=0.000
min21.402-21.405=-0.003
max21.412-21.413=-0.002
mean412.000
σ0.000
min412.000
max412.000
mean0.066-0.063=0.003
σ0.003-0.004=-0.001
min0.064-0.059=0.005
max0.073-0.070=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.930-1754.929=0.002
σ0.359-0.361=-0.003
min1754.364-1754.357=0.007
max1755.502-1755.515=-0.013
mean1637.100-1663.300=-26.200
σ604.508-617.559=-13.051
min622.000
max2434.000-2485.000=-51.000
mean2.834-2.809=0.025
σ0.109-0.132=-0.023
min2.561-2.520=0.042
max2.997-2.982=0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.758-272.754=0.004
σ0.004-0.007=-0.003
min272.752-272.748=0.004
max272.761-272.762=-0.000
mean2434.000-2485.000=-51.000
σ0.000
min2434.000-2485.000=-51.000
max2434.000-2485.000=-51.000
mean0.379-0.382=-0.003
σ0.001-0.004=-0.003
min0.378-0.379=-0.001
max0.380-0.389=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1933.160-1933.167=-0.007
σ0.020-0.010=0.010
min1933.140-1933.153=-0.012
max1933.183-1933.181=0.002
mean2434.000-2485.000=-51.000
σ0.000
min2434.000-2485.000=-51.000
max2434.000-2485.000=-51.000
mean3.040-3.151=-0.110
σ0.213-0.252=-0.039
min2.720-2.841=-0.121
max3.287-3.426=-0.139
iters=5
new-facts=6402
prior-facts=1
mean4756.793-4756.887=-0.093
σ7.667-7.283=0.384
min4752.967-4753.555=-0.588
max4770.501-4769.915=0.586
mean2434.000-2485.000=-51.000
σ0.000
min2434.000-2485.000=-51.000
max2434.000-2485.000=-51.000
mean8.714-8.057=0.657
σ0.320-0.330=-0.010
min8.329-7.704=0.625
max9.164-8.460=0.704
iters=5
new-facts=6402
prior-facts=6402
mean4944.329-4944.322=0.006
σ0.161-0.174=-0.013
min4944.044-4944.013=0.031
max4944.428-4944.417=0.012
mean2962.000-2935.000=27.000
σ413.952-402.008=11.944
min2444.000-2485.000=-41.000
max3517.000-3466.000=51.000
mean8.534-8.435=0.099
σ0.196-0.115=0.081
min8.346-8.338=0.008
max8.788-8.631=0.156

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.693-1.626=0.066
σ0.079-0.202=-0.122
min1.590-1.356=0.235
max1.777-1.803=-0.026

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.318-468.317=0.000
σ574.256-574.255=0.001
min181.185-181.187=-0.002
max1329.702-1329.700=0.002
mean88.250
σ8.500
min84.000
max101.000
mean2434.000-2485.000=-51.000
σ0.000
min2434.000-2485.000=-51.000
max2434.000-2485.000=-51.000
mean0.566-0.582=-0.016
σ0.563-0.593=-0.031
min0.284-0.285=-0.001
max1.410-1.471=-0.061
policies=20
mean1812.144-1812.178=-0.034
σ0.374-0.387=-0.014
min1811.897-1811.924=-0.027
max1812.696-1812.752=-0.055
mean840.000
σ0.000
min840.000
max840.000
mean2434.000-2485.000=-51.000
σ0.000
min2434.000-2485.000=-51.000
max2434.000-2485.000=-51.000
mean2.815-2.820=-0.005
σ0.025-0.009=0.016
min2.788-2.812=-0.024
max2.843-2.832=0.011
policies=200
mean18128.966-18128.882=0.085
σ0.511-0.603=-0.092
min18128.544-18128.467=0.078
max18129.693-18129.777=-0.084
mean8400.000
σ0.000
min8400.000
max8400.000
mean2434.000-2485.000=-51.000
σ0.000
min2434.000-2485.000=-51.000
max2434.000-2485.000=-51.000
mean28.429-28.374=0.055
σ0.042-0.099=-0.057
min28.368-28.236=0.132
max28.460-28.460=-0.000