Compare commits

Home / Compare 02f4eaf2 .. 0d2708ee

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.768=0.000
σ0.048-0.049=-0.001
min30.731-30.725=0.006
max30.902-30.904=-0.002
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.078-0.076=0.002
σ0.003-0.005=-0.002
min0.076-0.069=0.006
max0.085-0.086=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.060-21.060=-0.000
σ0.002-0.002=-0.000
min21.057-21.057=0.000
max21.064-21.064=0.000
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.063-0.061=0.003
σ0.002-0.003=-0.001
min0.062-0.058=0.004
max0.069-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.419-1751.419=-0.000
σ0.359-0.361=-0.002
min1750.850-1750.848=0.002
max1752.004-1752.001=0.003
mean1654.550-1659.150=-4.600
σ623.533-621.871=1.662
min684.000-640.000=44.000
max2651.000-2505.000=146.000
mean2.840-2.779=0.061
σ0.166-0.132=0.034
min2.440-2.347=0.092
max3.122-2.922=0.200

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.751-275.753=-0.001
σ0.013-0.014=-0.001
min275.741-275.738=0.002
max275.766-275.772=-0.005
mean2651.000-2505.000=146.000
σ0.000
min2651.000-2505.000=146.000
max2651.000-2505.000=146.000
mean0.394-0.394=-0.001
σ0.010-0.009=0.001
min0.385-0.387=-0.002
max0.407-0.408=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2168.289-2168.285=0.004
σ0.006-0.006=-0.000
min2168.283-2168.279=0.004
max2168.297-2168.295=0.002
mean2651.000-2505.000=146.000
σ0.000
min2651.000-2505.000=146.000
max2651.000-2505.000=146.000
mean2.999-2.936=0.063
σ0.164-0.127=0.037
min2.807-2.762=0.045
max3.252-3.092=0.160
iters=5
new-facts=6402
prior-facts=1
mean5047.980-5048.042=-0.062
σ0.643-1.062=-0.419
min5047.530-5046.944=0.586
max5049.114-5049.809=-0.695
mean2651.000-2505.000=146.000
σ0.000
min2651.000-2505.000=146.000
max2651.000-2505.000=146.000
mean8.772-9.007=-0.235
σ0.368-0.857=-0.490
min8.223-8.064=0.159
max9.180-10.148=-0.969
iters=5
new-facts=6402
prior-facts=6402
mean5179.242-5179.245=-0.002
σ0.081-0.082=-0.000
min5179.163-5179.169=-0.006
max5179.336-5179.341=-0.005
mean3227.400-3264.200=-36.800
σ389.764-378.325=11.439
min2685.000-2732.000=-47.000
max3720.000-3726.000=-6.000
mean10.064-10.038=0.027
σ0.063-0.192=-0.129
min9.992-9.708=0.284
max10.140-10.175=-0.035

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.238-1.702=-0.465
σ0.330-0.167=0.162
min0.960-1.425=-0.465
max1.795-1.873=-0.079

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.576-463.567=0.009
σ572.668-572.653=0.015
min177.236-177.235=0.001
max1322.578-1322.547=0.031
mean79.750
σ7.500
min76.000
max91.000
mean2651.000-2505.000=146.000
σ0.000
min2651.000-2505.000=146.000
max2651.000-2505.000=146.000
mean0.543-0.561=-0.018
σ0.529-0.559=-0.030
min0.275-0.278=-0.002
max1.336-1.400=-0.064
policies=20
mean1772.624-1772.633=-0.009
σ0.318-0.317=0.001
min1772.418-1772.417=0.001
max1773.098-1773.103=-0.005
mean760.000
σ0.000
min760.000
max760.000
mean2651.000-2505.000=146.000
σ0.000
min2651.000-2505.000=146.000
max2651.000-2505.000=146.000
mean2.756-2.754=0.002
σ0.007-0.008=-0.002
min2.747-2.745=0.002
max2.762-2.765=-0.002
policies=200
mean17732.935-17732.887=0.048
σ0.587-0.613=-0.026
min17732.520-17732.495=0.025
max17733.802-17733.790=0.011
mean7600.000
σ0.000
min7600.000
max7600.000
mean2651.000-2505.000=146.000
σ0.000
min2651.000-2505.000=146.000
max2651.000-2505.000=146.000
mean27.835-27.704=0.131
σ0.192-0.162=0.031
min27.663-27.522=0.140
max28.032-27.916=0.116