Compare commits

Home / Compare 1b58ae5d .. 492c5093

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.373-70.374=-0.001
σ0.058-0.056=0.001
min70.334-70.335=-0.000
max70.534-70.531=0.003
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.155-0.160=-0.004
σ0.005-0.003=0.002
min0.147-0.157=-0.009
max0.163-0.165=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.144-21.142=0.002
σ0.002-0.003=-0.000
min21.139-21.138=0.000
max21.146-21.146=0.001
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.065-0.060=0.005
σ0.004-0.003=0.000
min0.062-0.058=0.005
max0.072-0.067=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.199-1752.200=-0.001
σ0.361-0.363=-0.002
min1751.629-1751.640=-0.011
max1752.785-1752.782=0.003
mean1658.900-1651.050=7.850
σ622.327-642.954=-20.627
min644.000-629.000=15.000
max2504.000-2845.000=-341.000
mean2.784-2.824=-0.041
σ0.082-0.183=-0.102
min2.503-2.320=0.182
max2.868-3.036=-0.168

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.933-269.911=0.022
σ0.009-0.009=0.000
min269.919-269.901=0.017
max269.942-269.920=0.022
mean2504.000-2845.000=-341.000
σ0.000
min2504.000-2845.000=-341.000
max2504.000-2845.000=-341.000
mean0.378-0.384=-0.006
σ0.009-0.003=0.006
min0.371-0.382=-0.012
max0.392-0.390=0.002
iters=5
new-facts=1
prior-facts=6402
mean1930.391-1930.400=-0.008
σ0.012-0.008=0.003
min1930.378-1930.390=-0.012
max1930.404-1930.413=-0.009
mean2504.000-2845.000=-341.000
σ0.000
min2504.000-2845.000=-341.000
max2504.000-2845.000=-341.000
mean2.593-2.508=0.085
σ0.170-0.060=0.110
min2.441-2.454=-0.013
max2.816-2.603=0.213
iters=5
new-facts=6402
prior-facts=1
mean4750.943-4750.909=0.034
σ0.767-0.823=-0.056
min4750.515-4750.415=0.099
max4752.308-4752.371=-0.063
mean2504.000-2845.000=-341.000
σ0.000
min2504.000-2845.000=-341.000
max2504.000-2845.000=-341.000
mean8.058-8.442=-0.384
σ0.336-0.685=-0.348
min7.677-7.715=-0.039
max8.535-9.357=-0.822
iters=5
new-facts=6402
prior-facts=6402
mean4941.322-4941.333=-0.010
σ0.078-0.087=-0.008
min4941.249-4941.264=-0.014
max4941.421-4941.437=-0.016
mean2959.600-3040.200=-80.600
σ434.573-199.547=235.025
min2504.000-2845.000=-341.000
max3557.000-3317.000=240.000
mean8.398-8.637=-0.239
σ0.152-0.203=-0.051
min8.204-8.483=-0.279
max8.626-8.906=-0.280

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.560-1.039=0.521
σ0.129-0.136=-0.007
min1.422-0.952=0.470
max1.717-1.264=0.453

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.911-465.914=-0.003
σ575.765-575.763=0.002
min178.021-178.023=-0.003
max1329.558-1329.558=-0.000
mean81.750
σ7.500
min78.000
max93.000
mean2504.000-2845.000=-341.000
σ0.000
min2504.000-2845.000=-341.000
max2504.000-2845.000=-341.000
mean0.561-0.446=0.115
σ0.562-0.312=0.251
min0.278-0.285=-0.008
max1.404-0.913=0.491
policies=20
mean1780.457-1780.516=-0.059
σ0.347-0.357=-0.011
min1780.229-1780.243=-0.014
max1780.972-1781.034=-0.062
mean780.000
σ0.000
min780.000
max780.000
mean2504.000-2845.000=-341.000
σ0.000
min2504.000-2845.000=-341.000
max2504.000-2845.000=-341.000
mean2.762-2.859=-0.098
σ0.023-0.008=0.015
min2.742-2.850=-0.109
max2.789-2.870=-0.082
policies=200
mean17811.427-17811.470=-0.043
σ0.447-0.567=-0.120
min17811.046-17811.056=-0.010
max17812.074-17812.308=-0.234
mean7800.000
σ0.000
min7800.000
max7800.000
mean2504.000-2845.000=-341.000
σ0.000
min2504.000-2845.000=-341.000
max2504.000-2845.000=-341.000
mean27.783-28.321=-0.539
σ0.136-0.571=-0.435
min27.618-27.796=-0.178
max27.948-28.842=-0.894