Compare commits

Home / Compare d7c7cf66 .. e62e7284

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.560-70.558=0.001
σ0.048-0.047=0.000
min70.530-70.530=-0.000
max70.692-70.690=0.002
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.162-0.156=0.005
σ0.003-0.006=-0.003
min0.158-0.148=0.010
max0.168-0.167=0.000
cache=y
dps=1
iters=10
policies=100
mean21.287-21.287=0.000
σ0.003-0.002=0.000
min21.283-21.284=-0.001
max21.292-21.291=0.001
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.064-0.064=-0.000
σ0.003-0.002=0.001
min0.060-0.063=-0.002
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.069-1753.070=-0.001
σ0.361-0.362=-0.001
min1752.498-1752.501=-0.003
max1753.656-1753.658=-0.002
mean1657.750-1661.250=-3.500
σ631.708-634.850=-3.141
min618.000-619.000=-1.000
max2767.000-2785.000=-18.000
mean2.746-2.818=-0.072
σ0.183-0.106=0.077
min2.293-2.624=-0.331
max2.954-3.035=-0.081

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.288-271.289=-0.001
σ0.007-0.007=0.000
min271.276-271.279=-0.003
max271.295-271.297=-0.002
mean2767.000-2785.000=-18.000
σ0.000
min2767.000-2785.000=-18.000
max2767.000-2785.000=-18.000
mean0.378-0.379=-0.001
σ0.006-0.006=0.000
min0.369-0.373=-0.004
max0.385-0.389=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1931.710-1931.722=-0.012
σ0.016-0.011=0.005
min1931.690-1931.710=-0.020
max1931.728-1931.736=-0.008
mean2767.000-2785.000=-18.000
σ0.000
min2767.000-2785.000=-18.000
max2767.000-2785.000=-18.000
mean2.875-2.864=0.012
σ0.121-0.187=-0.065
min2.688-2.629=0.059
max2.982-3.059=-0.077
iters=5
new-facts=6402
prior-facts=1
mean4752.343-4752.434=-0.091
σ0.937-0.855=0.082
min4751.516-4751.998=-0.482
max4753.955-4753.961=-0.006
mean2767.000-2785.000=-18.000
σ0.000
min2767.000-2785.000=-18.000
max2767.000-2785.000=-18.000
mean8.332-8.573=-0.241
σ0.476-0.267=0.209
min7.734-8.251=-0.516
max8.978-8.858=0.120
iters=5
new-facts=6402
prior-facts=6402
mean4942.842-4942.776=0.066
σ0.162-0.196=-0.034
min4942.554-4942.548=0.005
max4942.931-4942.928=0.003
mean3022.800-3027.200=-4.400
σ224.380-220.719=3.661
min2767.000-2785.000=-18.000
max3307.000-3310.000=-3.000
mean8.552-8.681=-0.129
σ0.145-0.213=-0.068
min8.385-8.405=-0.020
max8.728-8.996=-0.268

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.017-1.019=-0.002
σ0.142-0.139=0.003
min0.921-0.924=-0.003
max1.252-1.242=0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.029-467.027=0.002
σ575.925-575.928=-0.003
min179.057-179.051=0.006
max1330.917-1330.920=-0.003
mean84.250
σ8.500
min80.000
max97.000
mean2767.000-2785.000=-18.000
σ0.000
min2767.000-2785.000=-18.000
max2767.000-2785.000=-18.000
mean0.463-0.446=0.017
σ0.367-0.335=0.032
min0.280-0.277=0.003
max1.014-0.949=0.065
policies=20
mean1790.880-1790.872=0.008
σ0.352-0.342=0.011
min1790.636-1790.637=-0.001
max1791.403-1791.380=0.024
mean800.000
σ0.000
min800.000
max800.000
mean2767.000-2785.000=-18.000
σ0.000
min2767.000-2785.000=-18.000
max2767.000-2785.000=-18.000
mean2.766-2.759=0.007
σ0.019-0.011=0.009
min2.743-2.748=-0.005
max2.790-2.773=0.018
policies=200
mean17915.298-17915.242=0.056
σ0.523-0.502=0.021
min17914.881-17914.808=0.073
max17916.064-17915.967=0.097
mean8000.000
σ0.000
min8000.000
max8000.000
mean2767.000-2785.000=-18.000
σ0.000
min2767.000-2785.000=-18.000
max2767.000-2785.000=-18.000
mean28.039-28.041=-0.003
σ0.104-0.194=-0.090
min27.923-27.835=0.087
max28.173-28.231=-0.058