Compare commits

Home / Compare cc1efa92 .. 723994cb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.710-53.704=0.006
σ0.365-0.363=0.002
min53.569-53.571=-0.003
max54.750-54.738=0.012
mean416.000
σ0.000
min416.000
max416.000
mean0.139-0.138=0.001
σ0.003-0.004=-0.001
min0.136-0.133=0.003
max0.145-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean42.977-42.978=-0.001
σ0.006-0.005=0.001
min42.969-42.971=-0.001
max42.986-42.986=0.001
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.121-0.119=0.002
σ0.003-0.003=0.001
min0.118-0.115=0.003
max0.129-0.125=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean995.215-994.904=0.311
σ1.218-1.166=0.052
min994.689-994.358=0.331
max1000.325-999.795=0.530
mean1073.050-1080.600=-7.550
σ319.946-333.473=-13.527
min595.000-597.000=-2.000
max1632.000-1638.000=-6.000
mean1.492-1.440=0.052
σ0.072-0.076=-0.005
min1.405-1.381=0.025
max1.670-1.715=-0.044

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.316-297.312=0.004
σ0.003-0.012=-0.008
min297.312-297.295=0.017
max297.319-297.326=-0.007
mean1632.000-1638.000=-6.000
σ0.000
min1632.000-1638.000=-6.000
max1632.000-1638.000=-6.000
mean0.388-0.392=-0.004
σ0.000-0.006=-0.006
min0.388-0.386=0.002
max0.389-0.400=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1299.020-1298.673=0.347
σ0.069-0.083=-0.014
min1298.902-1298.528=0.374
max1299.067-1298.729=0.338
mean1632.000-1638.000=-6.000
σ0.000
min1632.000-1638.000=-6.000
max1632.000-1638.000=-6.000
mean1.916-1.889=0.027
σ0.118-0.064=0.054
min1.833-1.823=0.011
max2.124-1.985=0.140
iters=5
new-facts=6402
prior-facts=1
mean1719.185-1718.874=0.311
σ6.860-6.889=-0.028
min1715.996-1715.695=0.301
max1731.454-1731.194=0.261
mean1632.000-1638.000=-6.000
σ0.000
min1632.000-1638.000=-6.000
max1632.000-1638.000=-6.000
mean2.943-2.978=-0.035
σ0.252-0.207=0.046
min2.602-2.806=-0.204
max3.214-3.301=-0.087
iters=5
new-facts=6402
prior-facts=6402
mean1981.915-1981.589=0.326
σ0.029-0.041=-0.012
min1981.869-1981.516=0.353
max1981.941-1981.609=0.332
mean1803.000-1850.600=-47.600
σ200.858-207.390=-6.532
min1632.000-1638.000=-6.000
max2101.000-2098.000=3.000
mean3.405-3.184=0.221
σ0.392-0.077=0.315
min3.091-3.108=-0.017
max4.077-3.303=0.774

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.183-1.271=-0.089
σ0.315-0.347=-0.032
min0.915-0.909=0.005
max1.678-1.627=0.051

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.457-440.374=0.083
σ573.037-572.879=0.158
min153.929-153.927=0.002
max1300.012-1299.693=0.320
mean94.250
σ8.500
min90.000
max107.000
mean1632.000-1638.000=-6.000
σ0.000
min1632.000-1638.000=-6.000
max1632.000-1638.000=-6.000
mean0.559-0.548=0.012
σ0.609-0.564=0.045
min0.252-0.264=-0.012
max1.473-1.394=0.079
policies=20
mean1539.571-1539.520=0.050
σ0.293-0.316=-0.023
min1539.383-1539.317=0.066
max1540.006-1539.990=0.016
mean900.000
σ0.000
min900.000
max900.000
mean1632.000-1638.000=-6.000
σ0.000
min1632.000-1638.000=-6.000
max1632.000-1638.000=-6.000
mean2.549-2.584=-0.035
σ0.013-0.041=-0.028
min2.537-2.546=-0.009
max2.565-2.642=-0.077
policies=200
mean15403.662-15403.070=0.592
σ0.124-0.101=0.023
min15403.501-15402.953=0.548
max15403.764-15403.196=0.568
mean9000.000
σ0.000
min9000.000
max9000.000
mean1632.000-1638.000=-6.000
σ0.000
min1632.000-1638.000=-6.000
max1632.000-1638.000=-6.000
mean26.160-25.980=0.180
σ0.310-0.164=0.145
min25.826-25.823=0.003
max26.470-26.190=0.280