Compare commits

Home / Compare 85e4e02d .. b71773de

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.375-70.375=-0.000
σ0.057-0.057=0.000
min70.335-70.343=-0.007
max70.533-70.534=-0.001
mean416.000
σ0.000
min416.000
max416.000
mean0.160-0.160=0.000
σ0.003-0.003=0.000
min0.157-0.155=0.002
max0.167-0.166=0.000
cache=y
dps=1
iters=10
policies=100
mean21.143-21.142=0.000
σ0.002-0.003=-0.001
min21.140-21.140=0.000
max21.145-21.149=-0.004
mean416.000
σ0.000
min416.000
max416.000
mean0.063-0.064=-0.001
σ0.003-0.003=-0.000
min0.057-0.061=-0.004
max0.068-0.072=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.202-1752.201=0.002
σ0.361-0.360=0.001
min1751.630-1751.631=-0.001
max1752.781-1752.783=-0.002
mean1638.850-1664.300=-25.450
σ615.634-627.235=-11.600
min647.000-685.000=-38.000
max2467.000-2762.000=-295.000
mean2.845-2.824=0.021
σ0.069-0.116=-0.047
min2.734-2.431=0.303
max2.983-2.960=0.023

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.937-269.931=0.006
σ0.008-0.009=-0.001
min269.926-269.923=0.003
max269.948-269.944=0.004
mean2467.000-2762.000=-295.000
σ0.000
min2467.000-2762.000=-295.000
max2467.000-2762.000=-295.000
mean0.382-0.373=0.009
σ0.006-0.006=-0.000
min0.378-0.370=0.008
max0.393-0.384=0.009
iters=5
new-facts=1
prior-facts=6402
mean1930.389-1930.385=0.003
σ0.024-0.016=0.008
min1930.353-1930.366=-0.014
max1930.410-1930.406=0.005
mean2467.000-2762.000=-295.000
σ0.000
min2467.000-2762.000=-295.000
max2467.000-2762.000=-295.000
mean2.552-2.605=-0.052
σ0.157-0.305=-0.148
min2.439-2.373=0.066
max2.816-3.140=-0.323
iters=5
new-facts=6402
prior-facts=1
mean4750.821-4750.612=0.210
σ0.835-1.112=-0.277
min4750.264-4749.169=1.095
max4752.284-4752.286=-0.003
mean2467.000-2762.000=-295.000
σ0.000
min2467.000-2762.000=-295.000
max2467.000-2762.000=-295.000
mean8.807-8.634=0.173
σ0.349-0.302=0.046
min8.464-8.305=0.159
max9.261-9.029=0.232
iters=5
new-facts=6402
prior-facts=6402
mean4941.330-4941.334=-0.004
σ0.084-0.087=-0.003
min4941.258-4941.255=0.003
max4941.423-4941.428=-0.005
mean2960.000-3031.600=-71.600
σ272.881-228.977=43.904
min2594.000-2762.000=-168.000
max3316.000-3304.000=12.000
mean8.415-8.754=-0.339
σ0.043-0.400=-0.358
min8.349-8.362=-0.013
max8.460-9.359=-0.898

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.747-1.063=0.684
σ0.149-0.128=0.021
min1.492-0.944=0.548
max1.844-1.260=0.584

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.909-465.921=-0.012
σ575.769-575.784=-0.015
min178.020-178.018=0.002
max1329.563-1329.598=-0.034
mean81.750
σ7.500
min78.000
max93.000
mean2467.000-2762.000=-295.000
σ0.000
min2467.000-2762.000=-295.000
max2467.000-2762.000=-295.000
mean0.567-0.556=0.010
σ0.581-0.547=0.034
min0.271-0.278=-0.007
max1.438-1.376=0.062
policies=20
mean1780.440-1780.454=-0.014
σ0.352-0.346=0.006
min1780.229-1780.218=0.011
max1780.965-1780.967=-0.002
mean780.000
σ0.000
min780.000
max780.000
mean2467.000-2762.000=-295.000
σ0.000
min2467.000-2762.000=-295.000
max2467.000-2762.000=-295.000
mean2.761-2.750=0.011
σ0.022-0.026=-0.004
min2.728-2.732=-0.004
max2.777-2.789=-0.011
policies=200
mean17811.414-17811.549=-0.135
σ0.576-0.509=0.066
min17811.045-17811.258=-0.213
max17812.264-17812.311=-0.047
mean7800.000
σ0.000
min7800.000
max7800.000
mean2467.000-2762.000=-295.000
σ0.000
min2467.000-2762.000=-295.000
max2467.000-2762.000=-295.000
mean27.813-27.910=-0.097
σ0.039-0.217=-0.178
min27.754-27.769=-0.015
max27.835-28.228=-0.393