Compare commits

Home / Compare 8dfc0283 .. 7dc7d7f9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.782=0.000
σ0.048-0.046=0.002
min70.754-70.754=-0.001
max70.914-70.909=0.006
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.159-0.159=0.000
σ0.004-0.005=-0.000
min0.152-0.152=0.000
max0.164-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=-0.000
σ0.002-0.002=-0.000
min21.489-21.488=0.000
max21.496-21.495=0.001
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.065-0.065=0.000
σ0.003-0.003=0.000
min0.063-0.063=0.000
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1754.092=0.001
σ0.359-0.360=-0.000
min1753.529-1753.529=0.000
max1754.679-1754.673=0.005
mean1657.600-1660.100=-2.500
σ630.138-625.754=4.384
min626.000-669.000=-43.000
max2773.000-2671.000=102.000
mean2.827-2.812=0.015
σ0.193-0.084=0.108
min2.181-2.668=-0.487
max3.097-2.950=0.147

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.954-271.955=-0.000
σ0.006-0.008=-0.002
min271.947-271.948=-0.002
max271.961-271.968=-0.006
mean2773.000-2671.000=102.000
σ0.000
min2773.000-2671.000=102.000
max2773.000-2671.000=102.000
mean0.384-0.382=0.003
σ0.008-0.009=-0.001
min0.380-0.377=0.003
max0.398-0.397=0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.324-1932.316=0.008
σ0.013-0.007=0.007
min1932.311-1932.306=0.005
max1932.340-1932.325=0.015
mean2773.000-2671.000=102.000
σ0.000
min2773.000-2671.000=102.000
max2773.000-2671.000=102.000
mean2.978-3.027=-0.049
σ0.136-0.071=0.066
min2.746-2.937=-0.190
max3.078-3.099=-0.022
iters=5
new-facts=6402
prior-facts=1
mean4753.090-4752.969=0.121
σ0.913-0.957=-0.044
min4752.599-4752.116=0.483
max4754.714-4754.617=0.097
mean2773.000-2671.000=102.000
σ0.000
min2773.000-2671.000=102.000
max2773.000-2671.000=102.000
mean8.569-8.682=-0.113
σ0.425-0.226=0.198
min7.941-8.386=-0.444
max8.917-8.912=0.005
iters=5
new-facts=6402
prior-facts=6402
mean4943.557-4943.557=-0.000
σ0.011-0.016=-0.005
min4943.544-4943.539=0.005
max4943.570-4943.571=-0.001
mean2972.000-2961.800=10.200
σ234.710-247.323=-12.613
min2773.000-2671.000=102.000
max3341.000-3317.000=24.000
mean8.382-8.442=-0.060
σ0.082-0.093=-0.011
min8.285-8.337=-0.051
max8.509-8.566=-0.057

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.016-1.191=-0.175
σ0.138-0.333=-0.195
min0.923-0.927=-0.005
max1.245-1.738=-0.493

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.661-468.641=0.020
σ574.888-574.901=-0.013
min181.208-181.184=0.024
max1330.993-1330.992=0.000
mean88.250
σ8.500
min84.000
max101.000
mean2773.000-2671.000=102.000
σ0.000
min2773.000-2671.000=102.000
max2773.000-2671.000=102.000
mean0.447-0.563=-0.116
σ0.297-0.546=-0.249
min0.297-0.284=0.013
max0.892-1.382=-0.490
policies=20
mean1812.307-1812.172=0.135
σ0.314-0.381=-0.068
min1812.106-1811.918=0.189
max1812.775-1812.736=0.039
mean840.000
σ0.000
min840.000
max840.000
mean2773.000-2671.000=102.000
σ0.000
min2773.000-2671.000=102.000
max2773.000-2671.000=102.000
mean2.919-2.837=0.082
σ0.117-0.018=0.099
min2.831-2.813=0.018
max3.083-2.857=0.226
policies=200
mean18129.205-18129.080=0.125
σ0.492-0.406=0.087
min18128.813-18128.795=0.018
max18129.922-18129.673=0.249
mean8400.000
σ0.000
min8400.000
max8400.000
mean2773.000-2671.000=102.000
σ0.000
min2773.000-2671.000=102.000
max2773.000-2671.000=102.000
mean28.616-28.592=0.025
σ0.089-0.095=-0.006
min28.533-28.488=0.045
max28.742-28.697=0.045