Compare commits

Home / Compare b33d9e7d .. 147a49d3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.385-70.380=0.006
σ0.047-0.049=-0.002
min70.358-70.349=0.009
max70.516-70.515=0.000
mean413.000
σ0.000
min413.000
max413.000
mean0.159-0.160=-0.001
σ0.004-0.003=0.001
min0.154-0.156=-0.003
max0.164-0.165=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.142-21.144=-0.003
σ0.003-0.003=0.000
min21.137-21.141=-0.004
max21.146-21.149=-0.003
mean413.000
σ0.000
min413.000
max413.000
mean0.065-0.065=0.001
σ0.002-0.002=-0.000
min0.063-0.062=0.001
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.387=0.007
σ0.359-0.363=-0.004
min1751.823-1751.820=0.003
max1752.958-1752.973=-0.015
mean1652.600-1648.500=4.100
σ644.553-632.189=12.364
min631.000-626.000=5.000
max2855.000-2773.000=82.000
mean2.807-2.818=-0.011
σ0.167-0.199=-0.032
min2.444-2.311=0.132
max3.005-3.172=-0.167

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.144-270.125=0.019
σ0.006-0.007=-0.001
min270.133-270.117=0.016
max270.149-270.133=0.015
mean2855.000-2773.000=82.000
σ0.000
min2855.000-2773.000=82.000
max2855.000-2773.000=82.000
mean0.376-0.375=0.001
σ0.001-0.004=-0.004
min0.375-0.371=0.004
max0.377-0.382=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1930.607-1930.588=0.019
σ0.011-0.019=-0.008
min1930.593-1930.567=0.026
max1930.622-1930.609=0.012
mean2855.000-2773.000=82.000
σ0.000
min2855.000-2773.000=82.000
max2855.000-2773.000=82.000
mean2.554-2.571=-0.017
σ0.119-0.158=-0.039
min2.453-2.444=0.009
max2.727-2.795=-0.068
iters=5
new-facts=6402
prior-facts=1
mean4751.274-4751.134=0.141
σ0.867-0.802=0.065
min4750.743-4750.661=0.082
max4752.814-4752.558=0.256
mean2855.000-2773.000=82.000
σ0.000
min2855.000-2773.000=82.000
max2855.000-2773.000=82.000
mean8.732-8.141=0.591
σ0.323-0.402=-0.079
min8.455-7.763=0.692
max9.272-8.667=0.605
iters=5
new-facts=6402
prior-facts=6402
mean4941.696-4941.533=0.163
σ0.148-0.082=0.066
min4941.433-4941.455=-0.022
max4941.782-4941.634=0.148
mean3074.600-3028.200=46.400
σ225.324-299.916=-74.592
min2855.000-2773.000=82.000
max3305.000-3470.000=-165.000
mean8.773-8.629=0.144
σ0.298-0.374=-0.076
min8.428-8.264=0.164
max9.228-9.181=0.047

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.988-1.083=-0.095
σ0.147-0.115=0.033
min0.912-0.934=-0.022
max1.251-1.257=-0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.381-466.356=0.025
σ575.936-575.923=0.013
min178.403-178.388=0.015
max1330.284-1330.240=0.044
mean84.250-84.000=0.250
σ8.500-8.000=0.500
min80.000
max97.000-96.000=1.000
mean2855.000-2773.000=82.000
σ0.000
min2855.000-2773.000=82.000
max2855.000-2773.000=82.000
mean0.445-0.421=0.024
σ0.304-0.263=0.041
min0.290-0.285=0.004
max0.901-0.815=0.085
policies=20
mean1784.361-1784.241=0.121
σ0.361-0.319=0.043
min1784.111-1784.012=0.098
max1784.893-1784.702=0.191
mean800.000
σ0.000
min800.000
max800.000
mean2855.000-2773.000=82.000
σ0.000
min2855.000-2773.000=82.000
max2855.000-2773.000=82.000
mean2.863-2.819=0.043
σ0.006-0.087=-0.081
min2.856-2.773=0.083
max2.870-2.949=-0.079
policies=200
mean17849.741-17848.823=0.918
σ0.539-0.429=0.109
min17849.460-17848.513=0.947
max17850.549-17849.459=1.090
mean8000.000
σ0.000
min8000.000
max8000.000
mean2855.000-2773.000=82.000
σ0.000
min2855.000-2773.000=82.000
max2855.000-2773.000=82.000
mean28.474-28.073=0.402
σ0.531-0.130=0.401
min27.938-27.990=-0.053
max28.982-28.266=0.716