Compare commits

Home / Compare 41e13900 .. ef7335e2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=-0.000
σ0.050-0.048=0.002
min33.947-33.950=-0.003
max34.119-34.113=0.007
mean416.000
σ0.000
min416.000
max416.000
mean0.084-0.084=-0.000
σ0.003-0.003=0.000
min0.082-0.082=-0.000
max0.091-0.091=0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.001
σ0.003-0.003=0.000
min23.314-23.313=0.001
max23.324-23.322=0.002
mean416.000
σ0.000
min416.000
max416.000
mean0.065-0.062=0.003
σ0.003-0.003=-0.000
min0.063-0.060=0.004
max0.072-0.068=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.494-1757.494=0.000
σ0.365-0.365=-0.000
min1756.921-1756.919=0.002
max1758.080-1758.083=-0.003
mean1647.200-1650.150=-2.950
σ634.933-631.039=3.894
min654.000-637.000=17.000
max2832.000-2836.000=-4.000
mean2.377-2.382=-0.005
σ0.110-0.084=0.027
min2.281-2.277=0.004
max2.671-2.597=0.073

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.635-326.634=0.001
σ0.054-0.054=-0.000
min326.539-326.537=0.002
max326.668-326.668=0.001
mean2832.000-2836.000=-4.000
σ0.000
min2832.000-2836.000=-4.000
max2832.000-2836.000=-4.000
mean0.423-0.432=-0.009
σ0.001-0.009=-0.008
min0.422-0.426=-0.004
max0.424-0.446=-0.022
iters=5
new-facts=1
prior-facts=6402
mean1988.804-1988.810=-0.006
σ0.008-0.007=0.001
min1988.792-1988.802=-0.009
max1988.814-1988.818=-0.004
mean2832.000-2836.000=-4.000
σ0.000
min2832.000-2836.000=-4.000
max2832.000-2836.000=-4.000
mean2.703-2.682=0.021
σ0.105-0.141=-0.035
min2.578-2.558=0.020
max2.831-2.901=-0.071
iters=5
new-facts=6402
prior-facts=1
mean4813.663-4813.635=0.028
σ7.776-7.727=0.049
min4810.133-4810.135=-0.002
max4827.572-4827.457=0.115
mean2832.000-2836.000=-4.000
σ0.000
min2832.000-2836.000=-4.000
max2832.000-2836.000=-4.000
mean8.991-8.724=0.267
σ0.405-0.471=-0.066
min8.602-7.929=0.673
max9.591-9.096=0.495
iters=5
new-facts=6402
prior-facts=6402
mean5001.211-5001.211=0.001
σ0.039-0.025=0.015
min5001.177-5001.183=-0.006
max5001.274-5001.241=0.033
mean3054.000-3058.400=-4.400
σ216.849-229.052=-12.203
min2832.000-2836.000=-4.000
max3328.000-3390.000=-62.000
mean9.915-9.846=0.068
σ0.203-0.215=-0.012
min9.641-9.649=-0.007
max10.195-10.156=0.039

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.923-0.970=-0.048
σ0.008-0.070=-0.062
min0.915-0.909=0.006
max0.935-1.052=-0.117

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.629-464.638=-0.009
σ574.767-574.772=-0.005
min177.244-177.239=0.005
max1326.780-1326.796=-0.016
mean88.250
σ8.500
min84.000
max101.000
mean2832.000-2836.000=-4.000
σ0.000
min2832.000-2836.000=-4.000
max2832.000-2836.000=-4.000
mean0.437-0.436=0.001
σ0.307-0.305=0.002
min0.279-0.282=-0.004
max0.897-0.893=0.004
policies=20
mean1772.723-1772.709=0.014
σ0.360-0.359=0.001
min1772.496-1772.460=0.035
max1773.259-1773.240=0.019
mean840.000
σ0.000
min840.000
max840.000
mean2832.000-2836.000=-4.000
σ0.000
min2832.000-2836.000=-4.000
max2832.000-2836.000=-4.000
mean2.794-2.801=-0.006
σ0.008-0.012=-0.003
min2.788-2.785=0.003
max2.807-2.814=-0.007
policies=200
mean17734.030-17734.124=-0.094
σ0.398-0.455=-0.057
min17733.667-17733.849=-0.183
max17734.598-17734.804=-0.206
mean8400.000
σ0.000
min8400.000
max8400.000
mean2832.000-2836.000=-4.000
σ0.000
min2832.000-2836.000=-4.000
max2832.000-2836.000=-4.000
mean27.776-28.011=-0.235
σ0.392-0.413=-0.022
min27.387-27.629=-0.242
max28.181-28.480=-0.298