Compare commits

Home / Compare 401f4eb9 .. 95f5cb5a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.980=-0.000
σ0.048-0.049=-0.000
min33.952-33.950=0.002
max34.114-34.114=-0.001
mean416.000
σ0.000
min416.000
max416.000
mean0.084-0.085=-0.000
σ0.004-0.003=0.000
min0.082-0.082=-0.001
max0.092-0.092=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.316-23.318=-0.002
σ0.002-0.003=-0.000
min23.312-23.315=-0.002
max23.320-23.322=-0.002
mean416.000
σ0.000
min416.000
max416.000
mean0.064-0.067=-0.003
σ0.003-0.003=0.000
min0.060-0.064=-0.004
max0.069-0.073=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.431-1757.431=0.000
σ0.365-0.365=0.000
min1756.855-1756.854=0.001
max1758.022-1758.021=0.002
mean1647.500-1651.050=-3.550
σ625.552-625.691=-0.139
min637.000-640.000=-3.000
max2838.000-2839.000=-1.000
mean2.361-2.363=-0.002
σ0.090-0.089=0.000
min2.222-2.264=-0.043
max2.646-2.649=-0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.572-326.570=0.003
σ0.051-0.058=-0.007
min326.484-326.468=0.015
max326.610-326.615=-0.005
mean2838.000-2839.000=-1.000
σ0.000
min2838.000-2839.000=-1.000
max2838.000-2839.000=-1.000
mean0.422-0.424=-0.002
σ0.002-0.004=-0.002
min0.419-0.421=-0.002
max0.424-0.432=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1988.742-1988.738=0.003
σ0.006-0.012=-0.006
min1988.732-1988.723=0.008
max1988.748-1988.752=-0.004
mean2838.000-2839.000=-1.000
σ0.000
min2838.000-2839.000=-1.000
max2838.000-2839.000=-1.000
mean2.754-2.719=0.034
σ0.175-0.136=0.039
min2.656-2.601=0.055
max3.066-2.946=0.120
iters=5
new-facts=6402
prior-facts=1
mean4813.602-4813.608=-0.006
σ7.724-7.681=0.043
min4810.044-4810.073=-0.029
max4827.418-4827.347=0.071
mean2838.000-2839.000=-1.000
σ0.000
min2838.000-2839.000=-1.000
max2838.000-2839.000=-1.000
mean8.470-8.618=-0.148
σ0.430-0.491=-0.060
min8.083-7.846=0.237
max9.165-9.211=-0.046
iters=5
new-facts=6402
prior-facts=6402
mean5001.052-5001.092=-0.040
σ0.164-0.157=0.007
min5000.761-5000.813=-0.052
max5001.142-5001.177=-0.035
mean3068.600-3052.600=16.000
σ314.593-188.520=126.073
min2838.000-2839.000=-1.000
max3558.000-3320.000=238.000
mean9.690-10.096=-0.406
σ0.236-0.300=-0.064
min9.302-9.669=-0.366
max9.914-10.449=-0.535

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.924-1.039=-0.115
σ0.008-0.129=-0.121
min0.918-0.921=-0.003
max0.938-1.237=-0.298

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.565-464.567=-0.002
σ574.766-574.772=-0.006
min177.177-177.172=0.005
max1326.714-1326.725=-0.011
mean88.250
σ8.500
min84.000
max101.000
mean2838.000-2839.000=-1.000
σ0.000
min2838.000-2839.000=-1.000
max2838.000-2839.000=-1.000
mean0.433-0.432=0.001
σ0.307-0.306=0.001
min0.277-0.277=-0.001
max0.894-0.891=0.002
policies=20
mean1772.076-1772.048=0.028
σ0.364-0.364=-0.001
min1771.837-1771.801=0.036
max1772.616-1772.589=0.027
mean840.000
σ0.000
min840.000
max840.000
mean2838.000-2839.000=-1.000
σ0.000
min2838.000-2839.000=-1.000
max2838.000-2839.000=-1.000
mean2.788-2.777=0.011
σ0.018-0.010=0.009
min2.766-2.764=0.002
max2.807-2.786=0.021
policies=200
mean17727.649-17727.601=0.047
σ0.454-0.493=-0.039
min17727.278-17727.260=0.019
max17728.312-17728.332=-0.021
mean8400.000
σ0.000
min8400.000
max8400.000
mean2838.000-2839.000=-1.000
σ0.000
min2838.000-2839.000=-1.000
max2838.000-2839.000=-1.000
mean27.924-28.005=-0.081
σ0.470-0.349=0.121
min27.509-27.568=-0.058
max28.396-28.413=-0.017