Compare commits

Home / Compare a6aed75d .. 01805f58

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.379-70.379=-0.000
σ0.044-0.045=-0.000
min70.353-70.352=0.001
max70.502-70.504=-0.001
mean415.000-416.400=-1.400
σ0.000-0.516=-0.516
min415.000-416.000=-1.000
max415.000-417.000=-2.000
mean0.158-0.160=-0.003
σ0.004-0.003=0.001
min0.150-0.157=-0.007
max0.164-0.166=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=0.000
σ0.003-0.002=0.000
min21.140-21.141=-0.001
max21.148-21.147=0.000
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.064-0.064=-0.000
σ0.002-0.002=-0.000
min0.062-0.062=-0.000
max0.070-0.071=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.386-1752.385=0.001
σ0.359-0.364=-0.005
min1751.819-1751.818=0.002
max1752.987-1752.972=0.016
mean1658.800-1655.100=3.700
σ628.920-643.327=-14.406
min619.000-624.000=-5.000
max2773.000-2793.000=-20.000
mean2.826-2.804=0.022
σ0.144-0.204=-0.060
min2.515-2.173=0.342
max3.080-3.332=-0.252

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.123-270.129=-0.006
σ0.006-0.014=-0.009
min270.116-270.110=0.006
max270.130-270.149=-0.020
mean2773.000-2793.000=-20.000
σ0.000
min2773.000-2793.000=-20.000
max2773.000-2793.000=-20.000
mean0.373-0.375=-0.001
σ0.004-0.005=-0.001
min0.370-0.371=-0.001
max0.380-0.383=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1930.585-1930.590=-0.005
σ0.015-0.011=0.003
min1930.568-1930.572=-0.004
max1930.605-1930.600=0.006
mean2773.000-2793.000=-20.000
σ0.000
min2773.000-2793.000=-20.000
max2773.000-2793.000=-20.000
mean2.636-2.523=0.113
σ0.254-0.131=0.123
min2.398-2.403=-0.006
max3.054-2.693=0.361
iters=5
new-facts=6402
prior-facts=1
mean4751.036-4751.028=0.008
σ0.863-0.897=-0.035
min4750.258-4750.196=0.062
max4752.515-4752.557=-0.043
mean2773.000-2793.000=-20.000
σ0.000
min2773.000-2793.000=-20.000
max2773.000-2793.000=-20.000
mean7.967-8.046=-0.080
σ0.255-0.395=-0.140
min7.752-7.630=0.122
max8.402-8.640=-0.238
iters=5
new-facts=6402
prior-facts=6402
mean4941.385-4941.528=-0.142
σ0.276-0.084=0.192
min4940.904-4941.446=-0.542
max4941.612-4941.628=-0.016
mean3041.200-3060.600=-19.400
σ325.362-333.346=-7.983
min2773.000-2793.000=-20.000
max3526.000-3567.000=-41.000
mean8.433-8.522=-0.089
σ0.084-0.360=-0.276
min8.337-8.217=0.120
max8.544-9.113=-0.569

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.043-1.042=0.000
σ0.131-0.116=0.015
min0.952-0.931=0.021
max1.259-1.211=0.047

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.364-466.373=-0.009
σ575.941-575.932=0.008
min178.391-178.401=-0.010
max1330.275-1330.271=0.004
mean84.250
σ8.500
min80.000
max97.000
mean2773.000-2793.000=-20.000
σ0.000
min2773.000-2793.000=-20.000
max2773.000-2793.000=-20.000
mean0.444-0.441=0.004
σ0.309-0.306=0.003
min0.285-0.285=0.000
max0.907-0.899=0.008
policies=20
mean1784.249-1784.274=-0.025
σ0.341-0.368=-0.027
min1784.010-1784.029=-0.019
max1784.744-1784.819=-0.075
mean800.000
σ0.000
min800.000
max800.000
mean2773.000-2793.000=-20.000
σ0.000
min2773.000-2793.000=-20.000
max2773.000-2793.000=-20.000
mean2.838-2.844=-0.006
σ0.119-0.101=0.018
min2.763-2.768=-0.005
max3.016-2.984=0.032
policies=200
mean17848.774-17848.751=0.023
σ0.420-0.578=-0.158
min17848.446-17848.360=0.086
max17849.388-17849.608=-0.219
mean8000.000
σ0.000
min8000.000
max8000.000
mean2773.000-2793.000=-20.000
σ0.000
min2773.000-2793.000=-20.000
max2773.000-2793.000=-20.000
mean28.012-27.893=0.119
σ0.116-0.132=-0.016
min27.931-27.797=0.134
max28.183-28.088=0.095