Compare commits

Home / Compare 05a9003c .. 85bc16e2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.706-53.704=0.002
σ0.365-0.363=0.001
min53.569-53.571=-0.002
max54.743-54.738=0.005
mean416.100-416.000=0.100
σ0.316-0.000=0.316
min416.000
max417.000-416.000=1.000
mean0.139-0.138=0.001
σ0.004-0.004=0.001
min0.134-0.133=0.001
max0.144-0.145=-0.000
cache=y
dps=1
iters=10
policies=100
mean42.977-42.978=-0.001
σ0.006-0.005=0.001
min42.964-42.971=-0.006
max42.985-42.986=-0.001
mean417.000
σ0.000
min417.000
max417.000
mean0.119-0.119=-0.000
σ0.005-0.003=0.002
min0.112-0.115=-0.003
max0.128-0.125=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean994.903-994.904=-0.000
σ1.198-1.166=0.032
min994.373-994.358=0.014
max999.927-999.795=0.132
mean1058.850-1080.600=-21.750
σ312.110-333.473=-21.363
min599.000-597.000=2.000
max1601.000-1638.000=-37.000
mean1.453-1.440=0.013
σ0.079-0.076=0.002
min1.388-1.381=0.007
max1.694-1.715=-0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.316-297.312=0.004
σ0.012-0.012=0.000
min297.298-297.295=0.003
max297.331-297.326=0.005
mean1601.000-1638.000=-37.000
σ0.000
min1601.000-1638.000=-37.000
max1601.000-1638.000=-37.000
mean0.389-0.392=-0.003
σ0.002-0.006=-0.004
min0.387-0.386=0.001
max0.391-0.400=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1298.674-1298.673=0.001
σ0.100-0.083=0.017
min1298.509-1298.528=-0.019
max1298.758-1298.729=0.029
mean1601.000-1638.000=-37.000
σ0.000
min1601.000-1638.000=-37.000
max1601.000-1638.000=-37.000
mean1.986-1.889=0.097
σ0.166-0.064=0.102
min1.839-1.823=0.017
max2.257-1.985=0.273
iters=5
new-facts=6402
prior-facts=1
mean1718.881-1718.874=0.007
σ6.901-6.889=0.012
min1715.691-1715.695=-0.004
max1731.223-1731.194=0.030
mean1601.000-1638.000=-37.000
σ0.000
min1601.000-1638.000=-37.000
max1601.000-1638.000=-37.000
mean2.912-2.978=-0.066
σ0.313-0.207=0.106
min2.623-2.806=-0.183
max3.447-3.301=0.146
iters=5
new-facts=6402
prior-facts=6402
mean1981.611-1981.589=0.022
σ0.009-0.041=-0.032
min1981.604-1981.516=0.088
max1981.625-1981.609=0.017
mean1782.200-1850.600=-68.400
σ175.706-207.390=-31.684
min1601.000-1638.000=-37.000
max1967.000-2098.000=-131.000
mean3.126-3.184=-0.057
σ0.050-0.077=-0.027
min3.083-3.108=-0.025
max3.213-3.303=-0.090

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.300-1.271=0.028
σ0.423-0.347=0.076
min0.934-0.909=0.025
max1.788-1.627=0.161

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.376-440.374=0.002
σ572.880-572.879=0.001
min153.924-153.927=-0.003
max1299.695-1299.693=0.003
mean94.250
σ8.500
min90.000
max107.000
mean1601.000-1638.000=-37.000
σ0.000
min1601.000-1638.000=-37.000
max1601.000-1638.000=-37.000
mean0.529-0.548=-0.018
σ0.547-0.564=-0.017
min0.255-0.264=-0.008
max1.350-1.394=-0.044
policies=20
mean1539.547-1539.520=0.027
σ0.356-0.316=0.040
min1539.332-1539.317=0.015
max1540.077-1539.990=0.088
mean900.000
σ0.000
min900.000
max900.000
mean1601.000-1638.000=-37.000
σ0.000
min1601.000-1638.000=-37.000
max1601.000-1638.000=-37.000
mean2.645-2.584=0.061
σ0.058-0.041=0.016
min2.602-2.546=0.056
max2.729-2.642=0.087
policies=200
mean15403.437-15403.070=0.367
σ0.137-0.101=0.036
min15403.317-15402.953=0.364
max15403.564-15403.196=0.368
mean9000.000
σ0.000
min9000.000
max9000.000
mean1601.000-1638.000=-37.000
σ0.000
min1601.000-1638.000=-37.000
max1601.000-1638.000=-37.000
mean25.995-25.980=0.015
σ0.116-0.164=-0.048
min25.891-25.823=0.067
max26.104-26.190=-0.087