Compare commits

Home / Compare 1982fc79 .. 1cbfc410

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.039=0.002
σ0.049-0.048=0.002
min30.997-31.006=-0.009
max31.175-31.171=0.004
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.075-0.081=-0.006
σ0.004-0.004=0.001
min0.070-0.077=-0.007
max0.081-0.087=-0.006
cache=y
dps=1
iters=10
policies=100
mean21.143-21.140=0.002
σ0.003-0.002=0.001
min21.138-21.137=0.000
max21.149-21.144=0.005
mean415.600-414.000=1.600
σ0.516-0.000=0.516
min415.000-414.000=1.000
max416.000-414.000=2.000
mean0.064-0.065=-0.001
σ0.002-0.003=-0.001
min0.062-0.063=-0.001
max0.069-0.072=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.409=0.002
σ0.360-0.361=-0.001
min1750.842-1750.842=-0.001
max1751.972-1751.994=-0.022
mean1662.050-1653.600=8.450
σ623.264-645.438=-22.174
min661.000-650.000=11.000
max2508.000-2849.000=-341.000
mean2.857-2.761=0.096
σ0.121-0.191=-0.070
min2.465-2.476=-0.011
max3.103-3.240=-0.137

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.072-279.068=0.003
σ0.011-0.002=0.009
min279.058-279.065=-0.007
max279.086-279.070=0.016
mean2508.000-2849.000=-341.000
σ0.000
min2508.000-2849.000=-341.000
max2508.000-2849.000=-341.000
mean0.393-0.387=0.006
σ0.012-0.001=0.010
min0.384-0.386=-0.001
max0.413-0.389=0.023
iters=5
new-facts=1
prior-facts=6402
mean1939.507-1939.518=-0.011
σ0.007-0.015=-0.008
min1939.494-1939.504=-0.009
max1939.513-1939.542=-0.029
mean2508.000-2849.000=-341.000
σ0.000
min2508.000-2849.000=-341.000
max2508.000-2849.000=-341.000
mean3.013-2.932=0.081
σ0.116-0.163=-0.047
min2.879-2.651=0.228
max3.195-3.067=0.128
iters=5
new-facts=6402
prior-facts=1
mean4760.028-4759.954=0.073
σ0.899-0.880=0.019
min4759.549-4759.160=0.389
max4761.631-4761.469=0.163
mean2508.000-2849.000=-341.000
σ0.000
min2508.000-2849.000=-341.000
max2508.000-2849.000=-341.000
mean8.355-8.073=0.282
σ0.649-0.356=0.294
min7.681-7.752=-0.070
max9.271-8.469=0.802
iters=5
new-facts=6402
prior-facts=6402
mean4950.465-4950.383=0.082
σ0.074-0.116=-0.042
min4950.403-4950.218=0.185
max4950.546-4950.546=0.000
mean2952.800-3078.800=-126.000
σ407.743-304.552=103.191
min2508.000-2849.000=-341.000
max3497.000-3551.000=-54.000
mean8.457-8.464=-0.007
σ0.088-0.194=-0.106
min8.374-8.201=0.173
max8.606-8.632=-0.027

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.717-1.102=0.615
σ0.185-0.231=-0.046
min1.434-0.933=0.501
max1.923-1.496=0.427

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.335-463.342=-0.007
σ572.197-572.201=-0.005
min177.233-177.230=0.002
max1321.630-1321.644=-0.014
mean79.750
σ7.500
min76.000
max91.000
mean2508.000-2849.000=-341.000
σ0.000
min2508.000-2849.000=-341.000
max2508.000-2849.000=-341.000
mean0.567-0.439=0.129
σ0.572-0.307=0.265
min0.280-0.284=-0.004
max1.426-0.899=0.527
policies=20
mean1772.585-1772.619=-0.034
σ0.334-0.349=-0.015
min1772.362-1772.345=0.017
max1773.081-1773.126=-0.046
mean760.000
σ0.000
min760.000
max760.000
mean2508.000-2849.000=-341.000
σ0.000
min2508.000-2849.000=-341.000
max2508.000-2849.000=-341.000
mean2.746-2.845=-0.099
σ0.018-0.017=0.001
min2.724-2.823=-0.099
max2.760-2.864=-0.104
policies=200
mean17732.462-17732.522=-0.060
σ0.530-0.385=0.145
min17732.114-17732.230=-0.116
max17733.251-17733.089=0.162
mean7600.000
σ0.000
min7600.000
max7600.000
mean2508.000-2849.000=-341.000
σ0.000
min2508.000-2849.000=-341.000
max2508.000-2849.000=-341.000
mean27.704-28.303=-0.599
σ0.154-0.562=-0.408
min27.600-27.717=-0.117
max27.933-28.910=-0.977