Compare commits

Home / Compare 773348d0 .. e0a68f55

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.958-30.769=0.188
σ0.048-0.049=-0.001
min30.921-30.726=0.195
max31.091-30.904=0.187
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.078-0.079=-0.001
σ0.004-0.004=-0.000
min0.074-0.076=-0.002
max0.084-0.085=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.060-21.061=-0.001
σ0.003-0.003=0.000
min21.055-21.056=-0.001
max21.064-21.065=-0.001
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.063-0.062=0.001
σ0.003-0.003=-0.000
min0.061-0.058=0.003
max0.070-0.068=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.419=-0.008
σ0.361-0.360=0.001
min1750.841-1750.851=-0.010
max1751.996-1751.992=0.004
mean1636.100-1648.450=-12.350
σ600.743-622.010=-21.266
min641.000-682.000=-41.000
max2443.000-2647.000=-204.000
mean2.817-2.787=0.031
σ0.171-0.206=-0.035
min2.323-2.369=-0.047
max3.032-3.067=-0.035

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.766-275.762=0.004
σ0.009-0.009=-0.001
min275.758-275.752=0.007
max275.777-275.772=0.005
mean2443.000-2647.000=-204.000
σ0.000
min2443.000-2647.000=-204.000
max2443.000-2647.000=-204.000
mean0.407-0.405=0.002
σ0.011-0.010=0.001
min0.397-0.396=0.001
max0.420-0.418=0.002
iters=5
new-facts=1
prior-facts=6402
mean2168.292-2168.279=0.013
σ0.013-0.015=-0.003
min2168.274-2168.260=0.015
max2168.307-2168.293=0.014
mean2443.000-2647.000=-204.000
σ0.000
min2443.000-2647.000=-204.000
max2443.000-2647.000=-204.000
mean2.843-2.955=-0.113
σ0.193-0.154=0.039
min2.700-2.768=-0.067
max3.182-3.134=0.048
iters=5
new-facts=6402
prior-facts=1
mean5048.159-5047.986=0.173
σ0.895-0.634=0.261
min5047.657-5047.605=0.052
max5049.754-5049.101=0.653
mean2443.000-2647.000=-204.000
σ0.000
min2443.000-2647.000=-204.000
max2443.000-2647.000=-204.000
mean8.480-8.882=-0.402
σ0.382-0.476=-0.093
min8.062-8.144=-0.082
max9.050-9.410=-0.360
iters=5
new-facts=6402
prior-facts=6402
mean5179.232-5179.161=0.071
σ0.080-0.126=-0.046
min5179.158-5178.962=0.197
max5179.320-5179.310=0.010
mean3195.400-3236.200=-40.800
σ505.378-339.342=166.036
min2580.000-2789.000=-209.000
max3867.000-3685.000=182.000
mean9.814-9.886=-0.071
σ0.205-0.265=-0.061
min9.552-9.438=0.114
max9.991-10.150=-0.159

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.813-1.186=0.627
σ0.071-0.228=-0.158
min1.741-0.953=0.788
max1.911-1.544=0.367

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.330-463.564=-0.233
σ572.198-572.650=-0.452
min177.230-177.234=-0.004
max1321.627-1322.539=-0.911
mean79.750
σ7.500
min76.000
max91.000
mean2443.000-2647.000=-204.000
σ0.000
min2443.000-2647.000=-204.000
max2443.000-2647.000=-204.000
mean0.560-0.554=0.006
σ0.548-0.556=-0.008
min0.284-0.275=0.009
max1.381-1.387=-0.006
policies=20
mean1772.566-1772.612=-0.046
σ0.335-0.332=0.003
min1772.340-1772.393=-0.053
max1773.063-1773.106=-0.043
mean760.000
σ0.000
min760.000
max760.000
mean2443.000-2647.000=-204.000
σ0.000
min2443.000-2647.000=-204.000
max2443.000-2647.000=-204.000
mean2.757-2.751=0.006
σ0.008-0.007=0.001
min2.747-2.745=0.002
max2.766-2.759=0.007
policies=200
mean17732.494-17732.921=-0.427
σ0.532-0.412=0.120
min17732.119-17732.627=-0.509
max17733.281-17733.523=-0.242
mean7600.000
σ0.000
min7600.000
max7600.000
mean2443.000-2647.000=-204.000
σ0.000
min2443.000-2647.000=-204.000
max2443.000-2647.000=-204.000
mean27.837-27.792=0.045
σ0.181-0.112=0.069
min27.683-27.695=-0.012
max28.083-27.904=0.178