Compare commits

Home / Compare b4b8cc9e .. 7497726c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.373=0.001
σ0.045-0.045=0.001
min70.347-70.342=0.005
max70.501-70.496=0.005
mean410.000-415.000=-5.000
σ0.000
min410.000-415.000=-5.000
max410.000-415.000=-5.000
mean0.159-0.159=-0.000
σ0.004-0.005=-0.001
min0.155-0.151=0.004
max0.166-0.166=0.000
cache=y
dps=1
iters=10
policies=100
mean21.141-21.141=0.000
σ0.002-0.001=0.001
min21.138-21.138=0.000
max21.145-21.143=0.002
mean410.000-415.000=-5.000
σ0.000
min410.000-415.000=-5.000
max410.000-415.000=-5.000
mean0.064-0.063=0.002
σ0.003-0.004=-0.001
min0.063-0.058=0.005
max0.071-0.069=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.385-1752.387=-0.002
σ0.362-0.362=-0.000
min1751.816-1751.817=-0.001
max1752.971-1752.968=0.003
mean1656.400-1639.050=17.350
σ638.601-602.601=36.000
min620.000-625.000=-5.000
max2787.000-2432.000=355.000
mean2.808-2.853=-0.045
σ0.120-0.113=0.007
min2.394-2.589=-0.195
max3.000-3.031=-0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.126-270.129=-0.003
σ0.009-0.006=0.003
min270.115-270.123=-0.008
max270.139-270.137=0.001
mean2787.000-2432.000=355.000
σ0.000
min2787.000-2432.000=355.000
max2787.000-2432.000=355.000
mean0.373-0.380=-0.008
σ0.001-0.006=-0.005
min0.371-0.372=-0.001
max0.375-0.389=-0.015
iters=5
new-facts=1
prior-facts=6402
mean1930.588-1930.591=-0.003
σ0.020-0.016=0.003
min1930.558-1930.564=-0.006
max1930.606-1930.608=-0.002
mean2787.000-2432.000=355.000
σ0.000
min2787.000-2432.000=355.000
max2787.000-2432.000=355.000
mean2.521-2.556=-0.035
σ0.144-0.107=0.036
min2.436-2.469=-0.033
max2.775-2.676=0.099
iters=5
new-facts=6402
prior-facts=1
mean4750.976-4751.129=-0.153
σ1.050-0.949=0.101
min4750.046-4750.492=-0.446
max4752.776-4752.789=-0.013
mean2787.000-2432.000=355.000
σ0.000
min2787.000-2432.000=355.000
max2787.000-2432.000=355.000
mean8.617-8.285=0.331
σ0.307-0.638=-0.331
min8.246-7.751=0.496
max9.028-9.052=-0.024
iters=5
new-facts=6402
prior-facts=6402
mean4941.563-4941.482=0.082
σ0.077-0.225=-0.148
min4941.472-4941.101=0.371
max4941.629-4941.629=-0.000
mean2995.600-2971.000=24.600
σ207.823-435.568=-227.745
min2787.000-2480.000=307.000
max3304.000-3565.000=-261.000
mean8.650-8.403=0.247
σ0.284-0.096=0.189
min8.391-8.322=0.069
max9.135-8.557=0.578

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.055-1.828=-0.773
σ0.111-0.088=0.023
min0.946-1.736=-0.789
max1.215-1.971=-0.756

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.359-466.351=0.008
σ575.927-575.922=0.005
min178.392-178.387=0.004
max1330.249-1330.233=0.015
mean84.000
σ8.000
min80.000
max96.000
mean2787.000-2432.000=355.000
σ0.000
min2787.000-2432.000=355.000
max2787.000-2432.000=355.000
mean0.446-0.565=-0.119
σ0.309-0.566=-0.257
min0.285-0.278=0.007
max0.909-1.413=-0.505
policies=20
mean1784.260-1784.208=0.052
σ0.372-0.362=0.010
min1784.013-1783.967=0.046
max1784.809-1784.745=0.064
mean800.000
σ0.000
min800.000
max800.000
mean2787.000-2432.000=355.000
σ0.000
min2787.000-2432.000=355.000
max2787.000-2432.000=355.000
mean2.857-2.800=0.057
σ0.113-0.033=0.081
min2.761-2.763=-0.002
max3.019-2.839=0.180
policies=200
mean17848.684-17848.806=-0.123
σ0.407-0.465=-0.058
min17848.446-17848.509=-0.063
max17849.289-17849.500=-0.210
mean8000.000
σ0.000
min8000.000
max8000.000
mean2787.000-2432.000=355.000
σ0.000
min2787.000-2432.000=355.000
max2787.000-2432.000=355.000
mean27.960-27.997=-0.037
σ0.065-0.044=0.021
min27.884-27.953=-0.068
max28.023-28.059=-0.036