Compare commits

Home / Compare 46e9b847 .. 35bed1aa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.375=-0.000
σ0.058-0.057=0.001
min70.341-70.335=0.006
max70.536-70.533=0.003
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.159-0.160=-0.001
σ0.003-0.003=-0.000
min0.156-0.157=-0.001
max0.165-0.167=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.000
σ0.003-0.002=0.001
min21.138-21.140=-0.001
max21.148-21.145=0.003
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.064-0.063=0.000
σ0.004-0.003=0.001
min0.059-0.057=0.002
max0.072-0.068=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.201-1752.202=-0.001
σ0.363-0.361=0.002
min1751.625-1751.630=-0.005
max1752.788-1752.781=0.007
mean1665.700-1638.850=26.850
σ631.467-615.634=15.833
min686.000-647.000=39.000
max2791.000-2467.000=324.000
mean2.819-2.845=-0.026
σ0.143-0.069=0.075
min2.337-2.734=-0.397
max3.006-2.983=0.022

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.933-269.937=-0.004
σ0.006-0.008=-0.002
min269.926-269.926=0.001
max269.941-269.948=-0.007
mean2791.000-2467.000=324.000
σ0.000
min2791.000-2467.000=324.000
max2791.000-2467.000=324.000
mean0.377-0.382=-0.005
σ0.009-0.006=0.003
min0.370-0.378=-0.008
max0.392-0.393=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1930.387-1930.389=-0.001
σ0.009-0.024=-0.015
min1930.377-1930.353=0.024
max1930.394-1930.410=-0.016
mean2791.000-2467.000=324.000
σ0.000
min2791.000-2467.000=324.000
max2791.000-2467.000=324.000
mean2.670-2.552=0.117
σ0.176-0.157=0.019
min2.473-2.439=0.034
max2.904-2.816=0.088
iters=5
new-facts=6402
prior-facts=1
mean4750.879-4750.821=0.057
σ0.862-0.835=0.027
min4750.355-4750.264=0.092
max4752.411-4752.284=0.128
mean2791.000-2467.000=324.000
σ0.000
min2791.000-2467.000=324.000
max2791.000-2467.000=324.000
mean8.481-8.807=-0.325
σ0.457-0.349=0.108
min7.862-8.464=-0.601
max9.020-9.261=-0.240
iters=5
new-facts=6402
prior-facts=6402
mean4941.198-4941.330=-0.133
σ0.190-0.084=0.106
min4940.937-4941.258=-0.321
max4941.421-4941.423=-0.002
mean3086.400-2960.000=126.400
σ330.262-272.881=57.381
min2791.000-2594.000=197.000
max3558.000-3316.000=242.000
mean8.814-8.415=0.399
σ0.326-0.043=0.283
min8.602-8.349=0.253
max9.391-8.460=0.931

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.060-1.747=-0.687
σ0.124-0.149=-0.025
min0.942-1.492=-0.550
max1.246-1.844=-0.598

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.917-465.909=0.008
σ575.780-575.769=0.011
min178.023-178.020=0.003
max1329.587-1329.563=0.024
mean81.750
σ7.500
min78.000
max93.000
mean2791.000-2467.000=324.000
σ0.000
min2791.000-2467.000=324.000
max2791.000-2467.000=324.000
mean0.442-0.567=-0.124
σ0.306-0.581=-0.276
min0.287-0.271=0.016
max0.901-1.438=-0.538
policies=20
mean1780.525-1780.440=0.085
σ0.370-0.352=0.017
min1780.267-1780.229=0.038
max1781.068-1780.965=0.103
mean780.000
σ0.000
min780.000
max780.000
mean2791.000-2467.000=324.000
σ0.000
min2791.000-2467.000=324.000
max2791.000-2467.000=324.000
mean2.855-2.761=0.094
σ0.097-0.022=0.075
min2.765-2.728=0.037
max2.987-2.777=0.209
policies=200
mean17811.506-17811.414=0.092
σ0.495-0.576=-0.081
min17811.211-17811.045=0.166
max17812.245-17812.264=-0.019
mean7800.000
σ0.000
min7800.000
max7800.000
mean2791.000-2467.000=324.000
σ0.000
min2791.000-2467.000=324.000
max2791.000-2467.000=324.000
mean27.889-27.813=0.076
σ0.144-0.039=0.104
min27.770-27.754=0.016
max28.098-27.835=0.263