Compare commits

Home / Compare 22628cf6 .. bdd3add1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.617=0.001
σ0.054-0.054=0.001
min35.589-35.586=0.003
max35.772-35.769=0.003
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.086-0.080=0.006
σ0.004-0.004=0.000
min0.082-0.076=0.006
max0.094-0.088=0.006
cache=y
dps=1
iters=10
policies=100
mean24.047-24.046=0.001
σ0.003-0.004=-0.001
min24.044-24.038=0.006
max24.052-24.051=0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.069-0.066=0.003
σ0.003-0.004=-0.001
min0.066-0.061=0.005
max0.077-0.071=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.491=-0.001
σ0.366-0.365=0.001
min1755.915-1755.916=-0.001
max1757.078-1757.079=-0.001
mean1625.250-1647.050=-21.800
σ593.044-639.374=-46.330
min657.000-625.000=32.000
max2423.000-2822.000=-399.000
mean2.316-2.328=-0.012
σ0.072-0.075=-0.002
min2.250-2.221=0.029
max2.483-2.549=-0.067

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.740-324.766=-0.026
σ0.048-0.053=-0.005
min324.654-324.671=-0.017
max324.765-324.794=-0.028
mean2423.000-2822.000=-399.000
σ0.000
min2423.000-2822.000=-399.000
max2423.000-2822.000=-399.000
mean0.433-0.431=0.002
σ0.008-0.010=-0.001
min0.425-0.423=0.002
max0.445-0.442=0.003
iters=5
new-facts=1
prior-facts=6402
mean1985.321-1985.317=0.004
σ0.024-0.022=0.002
min1985.281-1985.297=-0.016
max1985.339-1985.343=-0.004
mean2423.000-2822.000=-399.000
σ0.000
min2423.000-2822.000=-399.000
max2423.000-2822.000=-399.000
mean2.577-2.636=-0.059
σ0.080-0.134=-0.053
min2.467-2.518=-0.051
max2.677-2.812=-0.135
iters=5
new-facts=6402
prior-facts=1
mean4809.080-4809.120=-0.040
σ7.729-7.705=0.024
min4805.592-4805.573=0.019
max4822.907-4822.903=0.004
mean2423.000-2822.000=-399.000
σ0.000
min2423.000-2822.000=-399.000
max2423.000-2822.000=-399.000
mean9.020-8.833=0.187
σ0.251-0.473=-0.222
min8.823-7.993=0.830
max9.455-9.127=0.329
iters=5
new-facts=6402
prior-facts=6402
mean4996.629-4996.626=0.003
σ0.021-0.024=-0.002
min4996.602-4996.593=0.009
max4996.652-4996.653=-0.002
mean2998.400-3054.400=-56.000
σ257.924-303.324=-45.400
min2615.000-2822.000=-207.000
max3306.000-3520.000=-214.000
mean8.627-8.512=0.115
σ0.152-0.122=0.030
min8.365-8.410=-0.045
max8.754-8.723=0.031

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.541-0.978=0.562
σ0.193-0.068=0.125
min1.205-0.921=0.285
max1.668-1.058=0.610

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.203-463.210=-0.008
σ574.767-574.773=-0.006
min175.813-175.814=-0.001
max1325.353-1325.369=-0.017
mean86.250
σ8.500
min82.000
max99.000
mean2423.000-2822.000=-399.000
σ0.000
min2423.000-2822.000=-399.000
max2423.000-2822.000=-399.000
mean0.543-0.434=0.110
σ0.540-0.301=0.239
min0.265-0.280=-0.015
max1.353-0.886=0.468
policies=20
mean1758.470-1758.505=-0.035
σ0.346-0.353=-0.007
min1758.229-1758.269=-0.040
max1758.982-1759.030=-0.048
mean820.000
σ0.000
min820.000
max820.000
mean2423.000-2822.000=-399.000
σ0.000
min2423.000-2822.000=-399.000
max2423.000-2822.000=-399.000
mean2.716-2.780=-0.063
σ0.008-0.006=0.002
min2.707-2.771=-0.063
max2.726-2.783=-0.057
policies=200
mean17592.140-17592.135=0.005
σ0.504-0.487=0.017
min17591.838-17591.828=0.011
max17592.893-17592.861=0.033
mean8200.000
σ0.000
min8200.000
max8200.000
mean2423.000-2822.000=-399.000
σ0.000
min2423.000-2822.000=-399.000
max2423.000-2822.000=-399.000
mean27.424-27.803=-0.379
σ0.120-0.378=-0.258
min27.307-27.465=-0.158
max27.532-28.224=-0.692