Compare commits

Home / Compare afc3f9f1 .. 819939ce

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.392=0.174
σ0.045-0.044=0.001
min70.535-70.366=0.169
max70.690-70.515=0.174
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.159-0.160=-0.001
σ0.005-0.003=0.002
min0.151-0.158=-0.006
max0.166-0.167=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.288-21.146=0.141
σ0.002-0.009=-0.008
min21.286-21.141=0.144
max21.291-21.172=0.119
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.064-0.063=0.001
σ0.003-0.003=-0.000
min0.063-0.058=0.004
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1752.393=0.981
σ0.361-0.360=0.001
min1752.803-1751.825=0.978
max1753.961-1752.962=0.999
mean1647.300-1657.400=-10.100
σ641.455-628.194=13.261
min633.000-619.000=14.000
max2876.000-2773.000=103.000
mean2.782-2.793=-0.011
σ0.215-0.188=0.026
min2.153-2.259=-0.106
max2.991-3.076=-0.085

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.754-270.240=1.514
σ0.006-0.006=-0.000
min271.746-270.230=1.517
max271.761-270.246=1.515
mean2876.000-2773.000=103.000
σ0.000
min2876.000-2773.000=103.000
max2876.000-2773.000=103.000
mean0.380-0.379=0.001
σ0.004-0.007=-0.003
min0.378-0.371=0.007
max0.388-0.391=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.172-1930.698=1.474
σ0.013-0.018=-0.005
min1932.154-1930.674=1.479
max1932.185-1930.716=1.469
mean2876.000-2773.000=103.000
σ0.000
min2876.000-2773.000=103.000
max2876.000-2773.000=103.000
mean3.023-2.627=0.396
σ0.070-0.282=-0.212
min2.929-2.457=0.472
max3.099-3.118=-0.019
iters=5
new-facts=6402
prior-facts=1
mean4752.890-4751.350=1.539
σ0.911-0.927=-0.016
min4752.415-4750.876=1.539
max4754.517-4753.007=1.509
mean2876.000-2773.000=103.000
σ0.000
min2876.000-2773.000=103.000
max2876.000-2773.000=103.000
mean8.822-8.889=-0.067
σ0.229-0.218=0.010
min8.477-8.572=-0.095
max9.073-9.136=-0.063
iters=5
new-facts=6402
prior-facts=6402
mean4943.376-4941.798=1.579
σ0.013-0.151=-0.138
min4943.359-4941.530=1.829
max4943.389-4941.896=1.494
mean3027.800-3021.600=6.200
σ176.307-223.290=-46.983
min2876.000-2773.000=103.000
max3307.000-3309.000=-2.000
mean8.520-8.605=-0.085
σ0.107-0.131=-0.024
min8.376-8.450=-0.074
max8.632-8.760=-0.128

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.041-1.049=-0.008
σ0.161-0.278=-0.117
min0.938-0.916=0.022
max1.309-1.546=-0.237

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.857-466.753=6.104
σ575.916-575.931=-0.016
min184.889-178.783=6.106
max1336.730-1330.649=6.081
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2876.000-2773.000=103.000
σ0.000
min2876.000-2773.000=103.000
max2876.000-2773.000=103.000
mean0.452-0.445=0.006
σ0.305-0.305=-0.000
min0.298-0.289=0.009
max0.909-0.902=0.006
policies=20
mean1849.225-1788.119=61.106
σ0.374-0.336=0.038
min1848.937-1787.875=61.063
max1849.766-1788.607=61.159
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2876.000-2773.000=103.000
σ0.000
min2876.000-2773.000=103.000
max2876.000-2773.000=103.000
mean2.956-2.849=0.107
σ0.008-0.097=-0.089
min2.948-2.774=0.174
max2.966-2.991=-0.024
policies=200
mean18498.636-17888.181=610.455
σ0.559-0.523=0.036
min18498.252-17887.840=610.413
max18499.462-17888.960=610.502
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2876.000-2773.000=103.000
σ0.000
min2876.000-2773.000=103.000
max2876.000-2773.000=103.000
mean29.142-28.065=1.077
σ0.420-0.111=0.309
min28.761-27.973=0.789
max29.665-28.217=1.447