Compare commits

Home / Compare 142787a5 .. 8c29c71d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.393-70.390=0.003
σ0.043-0.049=-0.005
min70.368-70.359=0.009
max70.514-70.526=-0.012
mean410.200-415.000=-4.800
σ0.422-0.000=0.422
min410.000-415.000=-5.000
max411.000-415.000=-4.000
mean0.161-0.160=0.001
σ0.003-0.004=-0.001
min0.157-0.156=0.001
max0.165-0.168=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.147-21.145=0.003
σ0.012-0.003=0.009
min21.137-21.141=-0.004
max21.181-21.149=0.032
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.065-0.064=0.001
σ0.003-0.002=0.001
min0.063-0.062=0.001
max0.072-0.070=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.697-1752.393=0.304
σ0.360-0.361=-0.001
min1752.133-1751.827=0.306
max1753.283-1752.989=0.295
mean1656.800-1654.800=2.000
σ634.611-629.221=5.390
min614.000-617.000=-3.000
max2768.000-2771.000=-3.000
mean2.816-2.842=-0.026
σ0.163-0.153=0.010
min2.489-2.511=-0.022
max3.182-3.117=0.065

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.588-270.140=0.448
σ0.017-0.009=0.009
min270.576-270.128=0.448
max270.618-270.151=0.468
mean2768.000-2771.000=-3.000
σ0.000
min2768.000-2771.000=-3.000
max2768.000-2771.000=-3.000
mean0.382-0.378=0.004
σ0.006-0.005=0.001
min0.379-0.372=0.007
max0.392-0.384=0.008
iters=5
new-facts=1
prior-facts=6402
mean1931.041-1930.609=0.432
σ0.006-0.008=-0.002
min1931.033-1930.598=0.435
max1931.048-1930.619=0.429
mean2768.000-2771.000=-3.000
σ0.000
min2768.000-2771.000=-3.000
max2768.000-2771.000=-3.000
mean2.962-2.517=0.446
σ0.156-0.102=0.054
min2.697-2.450=0.247
max3.077-2.691=0.385
iters=5
new-facts=6402
prior-facts=1
mean4751.846-4751.318=0.529
σ0.808-0.908=-0.100
min4751.379-4750.802=0.577
max4753.288-4752.933=0.354
mean2768.000-2771.000=-3.000
σ0.000
min2768.000-2771.000=-3.000
max2768.000-2771.000=-3.000
mean7.975-8.477=-0.502
σ0.318-0.526=-0.207
min7.733-7.614=0.119
max8.531-9.000=-0.468
iters=5
new-facts=6402
prior-facts=6402
mean4942.230-4941.695=0.535
σ0.023-0.154=-0.131
min4942.205-4941.423=0.782
max4942.260-4941.785=0.475
mean3032.000-3014.000=18.000
σ319.601-236.541=83.060
min2768.000-2771.000=-3.000
max3513.000-3328.000=185.000
mean8.346-8.626=-0.280
σ0.141-0.245=-0.104
min8.186-8.394=-0.208
max8.562-9.009=-0.447

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.022-1.088=-0.065
σ0.139-0.142=-0.003
min0.931-0.934=-0.004
max1.252-1.322=-0.070

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.206-466.375=0.831
σ575.926-575.936=-0.011
min179.238-178.401=0.837
max1331.094-1330.280=0.814
mean86.250-84.250=2.000
σ8.500
min82.000-80.000=2.000
max99.000-97.000=2.000
mean2768.000-2771.000=-3.000
σ0.000
min2768.000-2771.000=-3.000
max2768.000-2771.000=-3.000
mean0.446-0.440=0.006
σ0.302-0.304=-0.002
min0.292-0.284=0.008
max0.899-0.897=0.002
policies=20
mean1792.624-1784.323=8.301
σ0.325-0.316=0.009
min1792.382-1784.104=8.278
max1793.101-1784.782=8.320
mean820.000-800.000=20.000
σ0.000
min820.000-800.000=20.000
max820.000-800.000=20.000
mean2768.000-2771.000=-3.000
σ0.000
min2768.000-2771.000=-3.000
max2768.000-2771.000=-3.000
mean2.843-2.824=0.019
σ0.112-0.089=0.023
min2.783-2.756=0.027
max3.011-2.954=0.057
policies=200
mean17932.839-17849.642=83.198
σ0.438-0.512=-0.074
min17932.524-17849.353=83.171
max17933.483-17850.409=83.074
mean8200.000-8000.000=200.000
σ0.000
min8200.000-8000.000=200.000
max8200.000-8000.000=200.000
mean2768.000-2771.000=-3.000
σ0.000
min2768.000-2771.000=-3.000
max2768.000-2771.000=-3.000
mean28.147-27.990=0.157
σ0.098-0.198=-0.100
min28.076-27.843=0.233
max28.292-28.283=0.009