Compare commits

Home / Compare f0d92be3 .. c44e267c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.049-73.048=0.001
σ0.048-0.048=-0.000
min73.023-73.023=0.000
max73.183-73.183=-0.000
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.162-0.162=0.000
σ0.003-0.003=0.000
min0.159-0.157=0.002
max0.168-0.167=0.001
cache=y
dps=1
iters=10
policies=100
mean23.740-23.740=-0.000
σ0.002-0.002=-0.001
min23.737-23.737=0.000
max23.743-23.745=-0.002
mean413.700-415.000=-1.300
σ0.483-0.000=0.483
min413.000-415.000=-2.000
max414.000-415.000=-1.000
mean0.063-0.066=-0.002
σ0.004-0.002=0.002
min0.059-0.064=-0.005
max0.073-0.073=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.788-1758.788=0.000
σ0.362-0.363=-0.001
min1758.212-1758.212=-0.001
max1759.373-1759.383=-0.010
mean1658.200-1644.650=13.550
σ624.781-626.223=-1.442
min625.000-621.000=4.000
max2515.000-2776.000=-261.000
mean2.822-2.771=0.051
σ0.143-0.151=-0.007
min2.266-2.340=-0.074
max2.969-3.027=-0.058

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.016-324.011=0.005
σ0.044-0.052=-0.008
min323.939-323.918=0.021
max324.046-324.039=0.007
mean2515.000-2776.000=-261.000
σ0.000
min2515.000-2776.000=-261.000
max2515.000-2776.000=-261.000
mean0.426-0.437=-0.011
σ0.001-0.010=-0.010
min0.425-0.425=0.000
max0.427-0.450=-0.024
iters=5
new-facts=1
prior-facts=6402
mean1984.584-1984.592=-0.008
σ0.023-0.014=0.009
min1984.548-1984.577=-0.029
max1984.602-1984.608=-0.006
mean2515.000-2776.000=-261.000
σ0.000
min2515.000-2776.000=-261.000
max2515.000-2776.000=-261.000
mean2.702-2.612=0.089
σ0.277-0.164=0.113
min2.516-2.465=0.052
max3.190-2.840=0.350
iters=5
new-facts=6402
prior-facts=1
mean4808.225-4808.141=0.084
σ7.777-7.894=-0.117
min4804.722-4804.176=0.547
max4822.136-4822.254=-0.118
mean2515.000-2776.000=-261.000
σ0.000
min2515.000-2776.000=-261.000
max2515.000-2776.000=-261.000
mean8.591-9.138=-0.547
σ0.299-0.213=0.086
min8.078-8.902=-0.824
max8.856-9.465=-0.608
iters=5
new-facts=6402
prior-facts=6402
mean4995.666-4995.808=-0.143
σ0.174-0.022=0.152
min4995.468-4995.783=-0.315
max4995.810-4995.836=-0.027
mean2964.600-3036.200=-71.600
σ251.960-207.865=44.095
min2642.000-2776.000=-134.000
max3303.000-3321.000=-18.000
mean8.575-8.686=-0.111
σ0.073-0.263=-0.190
min8.487-8.455=0.031
max8.643-9.088=-0.444

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.562-1.104=0.458
σ0.230-0.136=0.094
min1.223-0.930=0.293
max1.759-1.242=0.517

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.332-468.353=-0.021
σ574.235-574.249=-0.014
min181.211-181.226=-0.015
max1329.684-1329.726=-0.042
mean88.250
σ8.500
min84.000
max101.000
mean2515.000-2776.000=-261.000
σ0.000
min2515.000-2776.000=-261.000
max2515.000-2776.000=-261.000
mean0.562-0.482=0.080
σ0.560-0.375=0.185
min0.281-0.291=-0.010
max1.401-1.045=0.357
policies=20
mean1812.428-1812.612=-0.185
σ0.386-0.390=-0.004
min1812.157-1812.338=-0.181
max1812.998-1813.184=-0.186
mean840.000
σ0.000
min840.000
max840.000
mean2515.000-2776.000=-261.000
σ0.000
min2515.000-2776.000=-261.000
max2515.000-2776.000=-261.000
mean2.817-2.908=-0.091
σ0.018-0.036=-0.018
min2.802-2.879=-0.077
max2.842-2.960=-0.118
policies=200
mean18131.468-18131.517=-0.049
σ0.588-0.421=0.167
min18131.093-18131.169=-0.077
max18132.345-18132.082=0.263
mean8400.000
σ0.000
min8400.000
max8400.000
mean2515.000-2776.000=-261.000
σ0.000
min2515.000-2776.000=-261.000
max2515.000-2776.000=-261.000
mean28.265-28.419=-0.155
σ0.040-0.198=-0.158
min28.220-28.247=-0.027
max28.302-28.637=-0.335