Compare commits

Home / Compare 59579e3a .. 5dd006c6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.972-53.975=-0.003
σ0.365-0.365=0.000
min53.840-53.847=-0.007
max55.010-55.013=-0.003
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.138-0.144=-0.006
σ0.005-0.010=-0.005
min0.132-0.136=-0.003
max0.146-0.165=-0.019
cache=y
dps=1
iters=10
policies=100
mean43.177-43.182=-0.005
σ0.006-0.005=0.000
min43.165-43.171=-0.007
max43.186-43.188=-0.002
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.121-0.140=-0.019
σ0.004-0.007=-0.003
min0.115-0.125=-0.010
max0.127-0.146=-0.019

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean994.837-994.846=-0.010
σ1.228-1.251=-0.024
min994.270-994.265=0.005
max1000.005-1000.113=-0.107
mean1056.900-1054.250=2.650
σ303.669-315.195=-11.525
min640.000-568.000=72.000
max1523.000-1622.000=-99.000
mean1.452-1.471=-0.018
σ0.063-0.085=-0.023
min1.302-1.328=-0.027
max1.584-1.674=-0.089

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.294-297.263=0.030
σ0.010-0.010=-0.000
min297.282-297.251=0.031
max297.309-297.279=0.030
mean1523.000-1622.000=-99.000
σ0.000
min1523.000-1622.000=-99.000
max1523.000-1622.000=-99.000
mean0.389-0.382=0.007
σ0.009-0.003=0.006
min0.384-0.380=0.005
max0.405-0.387=0.018
iters=5
new-facts=1
prior-facts=6402
mean1298.539-1298.545=-0.006
σ0.132-0.136=-0.005
min1298.472-1298.479=-0.007
max1298.775-1298.789=-0.014
mean1523.000-1622.000=-99.000
σ0.000
min1523.000-1622.000=-99.000
max1523.000-1622.000=-99.000
mean1.945-1.930=0.015
σ0.210-0.141=0.069
min1.818-1.761=0.057
max2.317-2.148=0.169
iters=5
new-facts=6402
prior-facts=1
mean1820.748-1820.729=0.019
σ7.084-7.077=0.007
min1817.386-1817.338=0.048
max1833.406-1833.374=0.032
mean1523.000-1622.000=-99.000
σ0.000
min1523.000-1622.000=-99.000
max1523.000-1622.000=-99.000
mean4.152-4.102=0.050
σ0.347-0.407=-0.060
min3.894-3.820=0.074
max4.755-4.803=-0.048
iters=5
new-facts=6402
prior-facts=6402
mean2083.371-2083.373=-0.002
σ0.008-0.003=0.005
min2083.359-2083.369=-0.010
max2083.380-2083.377=0.003
mean1851.000-1831.200=19.800
σ212.276-174.203=38.073
min1584.000-1622.000=-38.000
max2087.000-2071.000=16.000
mean4.559-4.486=0.073
σ0.230-0.022=0.208
min4.419-4.461=-0.042
max4.965-4.520=0.445

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.490-1.199=0.291
σ0.319-0.370=-0.051
min0.949-0.914=0.035
max1.747-1.802=-0.054

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.373-440.382=-0.009
σ572.870-572.880=-0.010
min153.930-153.937=-0.006
max1299.678-1299.701=-0.023
mean94.250
σ8.500
min90.000
max107.000
mean1523.000-1622.000=-99.000
σ0.000
min1523.000-1622.000=-99.000
max1523.000-1622.000=-99.000
mean0.529-0.546=-0.016
σ0.548-0.558=-0.010
min0.255-0.260=-0.005
max1.351-1.382=-0.032
policies=20
mean1539.596-1539.601=-0.005
σ0.303-0.302=0.001
min1539.392-1539.408=-0.015
max1540.046-1540.051=-0.005
mean900.000
σ0.000
min900.000
max900.000
mean1523.000-1622.000=-99.000
σ0.000
min1523.000-1622.000=-99.000
max1523.000-1622.000=-99.000
mean2.563-2.562=0.001
σ0.014-0.010=0.004
min2.544-2.556=-0.013
max2.577-2.577=0.001
policies=200
mean15403.939-15404.000=-0.060
σ0.120-0.058=0.062
min15403.771-15403.919=-0.148
max15404.038-15404.042=-0.004
mean9000.000
σ0.000
min9000.000
max9000.000
mean1523.000-1622.000=-99.000
σ0.000
min1523.000-1622.000=-99.000
max1523.000-1622.000=-99.000
mean25.937-25.902=0.035
σ0.099-0.236=-0.137
min25.831-25.600=0.231
max26.046-26.126=-0.079