Compare commits

Home / Compare 66cca786 .. 9abb04d1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.564=0.002
σ0.049-0.050=-0.000
min70.534-70.536=-0.002
max70.702-70.704=-0.002
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.157-0.159=-0.002
σ0.005-0.005=0.000
min0.150-0.152=-0.001
max0.166-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.288-21.291=-0.004
σ0.003-0.010=-0.007
min21.284-21.284=-0.000
max21.294-21.319=-0.025
mean415.000-413.600=1.400
σ0.000-0.516=-0.516
min415.000-413.000=2.000
max415.000-414.000=1.000
mean0.065-0.065=-0.001
σ0.002-0.003=-0.001
min0.063-0.062=0.000
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.569-1753.567=0.002
σ0.361-0.361=0.000
min1752.998-1752.999=-0.001
max1754.152-1754.138=0.014
mean1654.950-1667.800=-12.850
σ643.194-633.549=9.645
min627.000-677.000=-50.000
max2886.000-2702.000=184.000
mean2.810-2.764=0.046
σ0.231-0.212=0.019
min2.180-2.176=0.003
max3.023-3.009=0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.015-271.994=0.021
σ0.006-0.015=-0.009
min272.005-271.983=0.022
max272.020-272.020=0.000
mean2886.000-2702.000=184.000
σ0.000
min2886.000-2702.000=184.000
max2886.000-2702.000=184.000
mean0.384-0.390=-0.006
σ0.009-0.005=0.004
min0.377-0.382=-0.005
max0.400-0.394=0.006
iters=5
new-facts=1
prior-facts=6402
mean1932.436-1932.433=0.003
σ0.015-0.005=0.010
min1932.410-1932.428=-0.017
max1932.445-1932.438=0.007
mean2886.000-2702.000=184.000
σ0.000
min2886.000-2702.000=184.000
max2886.000-2702.000=184.000
mean2.974-3.030=-0.056
σ0.120-0.042=0.078
min2.775-2.977=-0.202
max3.080-3.088=-0.008
iters=5
new-facts=6402
prior-facts=1
mean4753.103-4753.244=-0.141
σ0.955-0.821=0.134
min4752.272-4752.788=-0.516
max4754.748-4754.709=0.039
mean2886.000-2702.000=184.000
σ0.000
min2886.000-2702.000=184.000
max2886.000-2702.000=184.000
mean8.249-7.967=0.281
σ0.425-0.381=0.044
min7.850-7.696=0.154
max8.904-8.635=0.269
iters=5
new-facts=6402
prior-facts=6402
mean4943.598-4943.626=-0.028
σ0.037-0.009=0.028
min4943.536-4943.614=-0.077
max4943.634-4943.635=-0.001
mean3095.400-3021.200=74.200
σ292.037-364.022=-71.984
min2886.000-2702.000=184.000
max3554.000-3546.000=8.000
mean8.410-8.441=-0.032
σ0.130-0.131=-0.001
min8.264-8.359=-0.096
max8.613-8.672=-0.059

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.055-1.199=-0.144
σ0.281-0.381=-0.100
min0.925-0.928=-0.003
max1.557-1.844=-0.287

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.086-473.085=0.000
σ575.925-575.922=0.003
min185.111-185.118=-0.007
max1336.973-1336.968=0.005
mean88.250
σ8.500
min84.000
max101.000
mean2886.000-2702.000=184.000
σ0.000
min2886.000-2702.000=184.000
max2886.000-2702.000=184.000
mean0.485-0.563=-0.077
σ0.374-0.552=-0.178
min0.298-0.285=0.013
max1.046-1.391=-0.345
policies=20
mean1851.454-1851.414=0.040
σ0.347-0.362=-0.015
min1851.195-1851.181=0.014
max1851.959-1851.952=0.007
mean840.000
σ0.000
min840.000
max840.000
mean2886.000-2702.000=184.000
σ0.000
min2886.000-2702.000=184.000
max2886.000-2702.000=184.000
mean2.946-2.855=0.091
σ0.005-0.015=-0.010
min2.938-2.841=0.098
max2.950-2.871=0.078
policies=200
mean18521.077-18521.050=0.027
σ0.534-0.556=-0.022
min18520.716-18520.689=0.027
max18521.863-18521.871=-0.008
mean8400.000
σ0.000
min8400.000
max8400.000
mean2886.000-2702.000=184.000
σ0.000
min2886.000-2702.000=184.000
max2886.000-2702.000=184.000
mean29.333-28.770=0.563
σ0.396-0.018=0.377
min28.981-28.751=0.231
max29.777-28.788=0.989