Compare commits

Home / Compare e2f8ed07 .. 18897979

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.047-73.047=-0.000
σ0.051-0.044=0.007
min73.021-73.023=-0.003
max73.190-73.169=0.021
mean415.000
σ0.000
min415.000
max415.000
mean0.157-0.166=-0.009
σ0.005-0.007=-0.002
min0.148-0.157=-0.009
max0.163-0.175=-0.012
cache=y
dps=1
iters=10
policies=100
mean23.740-23.739=0.001
σ0.002-0.003=-0.001
min23.736-23.736=0.000
max23.743-23.744=-0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.063-0.066=-0.003
σ0.004-0.003=0.002
min0.059-0.064=-0.005
max0.072-0.074=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.788-1758.787=0.001
σ0.365-0.362=0.002
min1758.215-1758.220=-0.005
max1759.374-1759.374=0.000
mean1641.250-1656.950=-15.700
σ630.498-632.840=-2.342
min622.000-616.000=6.000
max2806.000-2892.000=-86.000
mean2.681-2.825=-0.143
σ0.268-0.163=0.105
min2.155-2.515=-0.361
max3.019-3.086=-0.067

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.019-324.019=0.000
σ0.043-0.041=0.002
min323.943-323.946=-0.003
max324.048-324.042=0.006
mean2806.000-2892.000=-86.000
σ0.000
min2806.000-2892.000=-86.000
max2806.000-2892.000=-86.000
mean0.424-0.426=-0.002
σ0.000-0.006=-0.005
min0.424-0.422=0.002
max0.425-0.436=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1984.569-1984.590=-0.021
σ0.014-0.019=-0.006
min1984.549-1984.566=-0.017
max1984.583-1984.607=-0.024
mean2806.000-2892.000=-86.000
σ0.000
min2806.000-2892.000=-86.000
max2806.000-2892.000=-86.000
mean2.641-2.593=0.048
σ0.141-0.092=0.049
min2.557-2.497=0.060
max2.892-2.745=0.146
iters=5
new-facts=6402
prior-facts=1
mean4808.170-4808.240=-0.071
σ7.862-7.758=0.105
min4804.069-4804.676=-0.607
max4822.219-4822.117=0.102
mean2806.000-2892.000=-86.000
σ0.000
min2806.000-2892.000=-86.000
max2806.000-2892.000=-86.000
mean8.749-8.737=0.012
σ0.628-0.223=0.405
min7.668-8.422=-0.753
max9.281-8.998=0.283
iters=5
new-facts=6402
prior-facts=6402
mean4995.796-4995.738=0.059
σ0.024-0.162=-0.138
min4995.772-4995.451=0.321
max4995.829-4995.832=-0.003
mean3032.200-3089.000=-56.800
σ268.012-261.532=6.480
min2806.000-2892.000=-86.000
max3420.000-3486.000=-66.000
mean8.585-8.545=0.040
σ0.282-0.209=0.073
min8.352-8.410=-0.057
max9.066-8.913=0.153

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.002-0.973=0.030
σ0.138-0.141=-0.003
min0.912-0.903=0.009
max1.229-1.224=0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.358-468.353=0.005
σ574.237-574.230=0.006
min181.223-181.230=-0.007
max1329.713-1329.698=0.014
mean88.250
σ8.500
min84.000
max101.000
mean2806.000-2892.000=-86.000
σ0.000
min2806.000-2892.000=-86.000
max2806.000-2892.000=-86.000
mean0.394-0.441=-0.047
σ0.211-0.307=-0.096
min0.277-0.286=-0.008
max0.709-0.901=-0.192
policies=20
mean1812.617-1812.651=-0.034
σ0.401-0.399=0.002
min1812.334-1812.370=-0.037
max1813.206-1813.235=-0.029
mean840.000
σ0.000
min840.000
max840.000
mean2806.000-2892.000=-86.000
σ0.000
min2806.000-2892.000=-86.000
max2806.000-2892.000=-86.000
mean2.884-2.870=0.015
σ0.014-0.014=0.000
min2.873-2.849=0.024
max2.902-2.877=0.025
policies=200
mean18131.652-18132.420=-0.768
σ0.506-0.883=-0.376
min18131.177-18131.267=-0.090
max18132.249-18133.170=-0.921
mean8400.000
σ0.000
min8400.000
max8400.000
mean2806.000-2892.000=-86.000
σ0.000
min2806.000-2892.000=-86.000
max2806.000-2892.000=-86.000
mean28.465-28.716=-0.251
σ0.217-0.224=-0.007
min28.140-28.487=-0.347
max28.592-28.947=-0.355