Compare commits

Home / Compare bf91fffa .. 76c5976c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.964-35.963=0.001
σ0.105-0.108=-0.002
min35.909-35.910=-0.001
max36.262-36.268=-0.007
mean413.000
σ0.000
min413.000
max413.000
mean0.076-0.074=0.003
σ0.003-0.005=-0.002
min0.074-0.070=0.004
max0.084-0.082=0.002
cache=y
dps=1
iters=10
policies=100
mean26.201-26.203=-0.002
σ0.002-0.003=-0.001
min26.198-26.196=0.002
max26.205-26.207=-0.001
mean413.000
σ0.000
min413.000
max413.000
mean0.058-0.061=-0.003
σ0.002-0.002=0.000
min0.056-0.060=-0.004
max0.064-0.067=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.924-1756.923=0.001
σ0.368-0.368=0.001
min1756.353-1756.351=0.002
max1757.524-1757.520=0.004
mean1658.400-1639.550=18.850
σ640.793-622.790=18.003
min609.000
max2684.000-2644.000=40.000
mean2.379-2.388=-0.009
σ0.178-0.129=0.049
min2.237-2.265=-0.029
max3.075-2.748=0.326

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.437-279.437=-0.000
σ0.007-0.010=-0.003
min279.425-279.430=-0.005
max279.444-279.455=-0.012
mean2684.000-2644.000=40.000
σ0.000
min2684.000-2644.000=40.000
max2684.000-2644.000=40.000
mean0.415-0.417=-0.001
σ0.005-0.007=-0.002
min0.411-0.408=0.003
max0.422-0.425=-0.003
iters=5
new-facts=1
prior-facts=6402
mean2269.495-2269.493=0.002
σ0.005-0.016=-0.011
min2269.489-2269.465=0.023
max2269.500-2269.503=-0.003
mean2684.000-2644.000=40.000
σ0.000
min2684.000-2644.000=40.000
max2684.000-2644.000=40.000
mean2.923-2.984=-0.061
σ0.119-0.240=-0.121
min2.820-2.796=0.024
max3.129-3.405=-0.276
iters=5
new-facts=6402
prior-facts=1
mean4954.602-4954.855=-0.253
σ1.047-0.853=0.194
min4953.832-4954.433=-0.602
max4956.394-4956.378=0.017
mean2684.000-2644.000=40.000
σ0.000
min2684.000-2644.000=40.000
max2684.000-2644.000=40.000
mean8.166-8.033=0.133
σ0.200-0.334=-0.134
min7.961-7.771=0.190
max8.495-8.598=-0.103
iters=5
new-facts=6402
prior-facts=6402
mean5169.367-5169.371=-0.004
σ0.148-0.147=0.001
min5169.148-5169.155=-0.006
max5169.507-5169.518=-0.011
mean3436.200-3385.200=51.000
σ462.994-460.877=2.117
min2821.000-2808.000=13.000
max4041.000-4008.000=33.000
mean9.322-9.335=-0.013
σ0.450-0.373=0.077
min8.609-9.068=-0.459
max9.755-9.968=-0.213

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.063-1.148=-0.085
σ0.104-0.222=-0.117
min0.952-0.933=0.019
max1.217-1.456=-0.239

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean461.587-461.588=-0.001
σ572.654-572.651=0.003
min175.252-175.255=-0.003
max1320.567-1320.564=0.003
mean77.500
σ7.000
min74.000
max88.000
mean2684.000-2644.000=40.000
σ0.000
min2684.000-2644.000=40.000
max2684.000-2644.000=40.000
mean0.557-0.548=0.009
σ0.561-0.552=0.009
min0.274-0.270=0.005
max1.398-1.376=0.022
policies=20
mean1752.816-1752.812=0.004
σ0.343-0.334=0.009
min1752.601-1752.596=0.006
max1753.327-1753.307=0.019
mean740.000
σ0.000
min740.000
max740.000
mean2684.000-2644.000=40.000
σ0.000
min2684.000-2644.000=40.000
max2684.000-2644.000=40.000
mean2.738-2.716=0.022
σ0.035-0.015=0.019
min2.700-2.695=0.005
max2.784-2.731=0.053
policies=200
mean17534.566-17534.735=-0.169
σ0.449-0.507=-0.059
min17534.192-17534.439=-0.246
max17535.212-17535.494=-0.282
mean7400.000
σ0.000
min7400.000
max7400.000
mean2684.000-2644.000=40.000
σ0.000
min2684.000-2644.000=40.000
max2684.000-2644.000=40.000
mean27.481-27.272=0.209
σ0.136-0.143=-0.008
min27.320-27.094=0.226
max27.637-27.412=0.224