Compare commits

Home / Compare 110d1290 .. f630abfd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.045-70.707=2.338
σ0.048-0.045=0.003
min73.021-70.677=2.344
max73.180-70.834=2.346
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.157-0.161=-0.004
σ0.005-0.003=0.001
min0.151-0.158=-0.007
max0.164-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.741-21.412=2.329
σ0.002-0.003=-0.001
min23.738-21.407=2.330
max23.744-21.416=2.328
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.066-0.065=0.001
σ0.003-0.002=0.000
min0.064-0.064=0.000
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.788-1754.931=3.857
σ0.360-0.360=0.000
min1758.212-1754.355=3.857
max1759.371-1755.514=3.857
mean1658.400-1661.800=-3.400
σ621.403-621.237=0.166
min624.000
max2497.000-2513.000=-16.000
mean2.841-2.815=0.026
σ0.106-0.128=-0.022
min2.545-2.485=0.060
max2.983-2.940=0.043

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.015-272.788=51.226
σ0.055-0.009=0.046
min323.916-272.784=51.133
max324.042-272.804=51.238
mean2497.000-2513.000=-16.000
σ0.000
min2497.000-2513.000=-16.000
max2497.000-2513.000=-16.000
mean0.427-0.382=0.045
σ0.006-0.009=-0.003
min0.421-0.377=0.045
max0.437-0.398=0.039
iters=5
new-facts=1
prior-facts=6402
mean1984.586-1933.218=51.369
σ0.021-0.018=0.003
min1984.558-1933.193=51.365
max1984.611-1933.238=51.373
mean2497.000-2513.000=-16.000
σ0.000
min2497.000-2513.000=-16.000
max2497.000-2513.000=-16.000
mean2.598-3.071=-0.473
σ0.064-0.090=-0.026
min2.551-3.008=-0.457
max2.701-3.229=-0.528
iters=5
new-facts=6402
prior-facts=1
mean4808.240-4756.886=51.354
σ7.805-7.296=0.509
min4804.701-4753.589=51.112
max4822.202-4769.937=52.265
mean2497.000-2513.000=-16.000
σ0.000
min2497.000-2513.000=-16.000
max2497.000-2513.000=-16.000
mean8.931-8.278=0.653
σ0.293-0.373=-0.080
min8.604-7.737=0.867
max9.393-8.612=0.781
iters=5
new-facts=6402
prior-facts=6402
mean4995.738-4944.449=51.289
σ0.175-0.021=0.154
min4995.426-4944.422=51.004
max4995.828-4944.473=51.355
mean2993.000-2920.800=72.200
σ274.557-366.784=-92.227
min2619.000-2513.000=106.000
max3316.000-3429.000=-113.000
mean8.707-8.408=0.298
σ0.255-0.102=0.152
min8.424-8.253=0.171
max9.120-8.535=0.586

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.637-1.534=0.103
σ0.235-0.187=0.048
min1.227-1.227=-0.000
max1.823-1.731=0.092

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.326-468.305=0.021
σ574.232-574.232=-0.001
min181.209-181.186=0.023
max1329.673-1329.653=0.020
mean88.250
σ8.500
min84.000
max101.000
mean2497.000-2513.000=-16.000
σ0.000
min2497.000-2513.000=-16.000
max2497.000-2513.000=-16.000
mean0.554-0.564=-0.009
σ0.534-0.561=-0.028
min0.285-0.281=0.004
max1.355-1.406=-0.051
policies=20
mean1812.433-1812.159=0.275
σ0.388-0.375=0.013
min1812.168-1811.919=0.249
max1813.005-1812.716=0.290
mean840.000
σ0.000
min840.000
max840.000
mean2497.000-2513.000=-16.000
σ0.000
min2497.000-2513.000=-16.000
max2497.000-2513.000=-16.000
mean2.821-2.800=0.021
σ0.012-0.017=-0.005
min2.809-2.778=0.031
max2.837-2.821=0.016
policies=200
mean18131.707-18128.972=2.735
σ0.523-0.502=0.021
min18131.420-18128.694=2.726
max18132.491-18129.725=2.767
mean8400.000
σ0.000
min8400.000
max8400.000
mean2497.000-2513.000=-16.000
σ0.000
min2497.000-2513.000=-16.000
max2497.000-2513.000=-16.000
mean28.370-28.312=0.058
σ0.057-0.054=0.002
min28.301-28.243=0.059
max28.432-28.370=0.061