Compare commits

Home / Compare f71139da .. 98aa01ad

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-70.702=-35.440
σ0.055-0.046=0.008
min35.229-70.669=-35.440
max35.416-70.830=-35.414
mean413.900-414.000=-0.100
σ0.316-0.000=0.316
min413.000-414.000=-1.000
max414.000
mean0.083-0.158=-0.075
σ0.004-0.005=-0.001
min0.077-0.150=-0.073
max0.089-0.166=-0.077
cache=y
dps=1
iters=10
policies=100
mean23.769-21.408=2.361
σ0.003-0.002=0.001
min23.765-21.406=2.359
max23.774-21.412=2.362
mean414.000
σ0.000
min414.000
max414.000
mean0.068-0.065=0.003
σ0.003-0.002=0.001
min0.066-0.064=0.002
max0.075-0.071=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1754.932=1.553
σ0.364-0.361=0.003
min1755.910-1754.356=1.554
max1757.068-1755.518=1.550
mean1656.750-1646.700=10.050
σ636.909-623.440=13.470
min678.000-624.000=54.000
max2845.000-2768.000=77.000
mean2.341-2.811=-0.470
σ0.077-0.198=-0.121
min2.256-2.268=-0.012
max2.506-3.109=-0.603

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.715-272.790=51.925
σ0.035-0.006=0.029
min324.654-272.780=51.874
max324.736-272.795=51.941
mean2845.000-2768.000=77.000
σ0.000
min2845.000-2768.000=77.000
max2845.000-2768.000=77.000
mean0.425-0.378=0.047
σ0.002-0.002=-0.000
min0.423-0.376=0.046
max0.427-0.381=0.046
iters=5
new-facts=1
prior-facts=6402
mean1985.264-1933.225=52.039
σ0.014-0.007=0.007
min1985.247-1933.215=52.032
max1985.277-1933.232=52.045
mean2845.000-2768.000=77.000
σ0.000
min2845.000-2768.000=77.000
max2845.000-2768.000=77.000
mean2.600-3.033=-0.433
σ0.080-0.142=-0.061
min2.533-2.936=-0.403
max2.737-3.278=-0.541
iters=5
new-facts=6402
prior-facts=1
mean4808.763-4756.871=51.892
σ7.786-7.774=0.012
min4804.829-4753.178=51.652
max4822.683-4770.775=51.907
mean2845.000-2768.000=77.000
σ0.000
min2845.000-2768.000=77.000
max2845.000-2768.000=77.000
mean8.671-8.954=-0.283
σ0.571-0.654=-0.083
min7.801-7.897=-0.096
max9.223-9.636=-0.413
iters=5
new-facts=6402
prior-facts=6402
mean4996.460-4944.390=52.070
σ0.017-0.164=-0.147
min4996.442-4944.098=52.344
max4996.484-4944.471=52.013
mean3067.000-3047.200=19.800
σ296.500-272.025=24.474
min2845.000-2768.000=77.000
max3525.000-3427.000=98.000
mean8.568-8.574=-0.006
σ0.138-0.198=-0.060
min8.454-8.363=0.091
max8.754-8.868=-0.114

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.995-1.034=-0.039
σ0.132-0.128=0.004
min0.908-0.918=-0.009
max1.209-1.229=-0.020

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.972-468.329=-5.357
σ574.253-574.225=0.028
min175.834-181.206=-5.372
max1324.352-1329.667=-5.315
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2845.000-2768.000=77.000
σ0.000
min2845.000-2768.000=77.000
max2845.000-2768.000=77.000
mean0.434-0.445=-0.011
σ0.298-0.301=-0.003
min0.284-0.292=-0.008
max0.880-0.896=-0.016
policies=20
mean1758.695-1812.367=-53.672
σ0.348-0.397=-0.049
min1758.463-1812.085=-53.622
max1759.210-1812.950=-53.740
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2845.000-2768.000=77.000
σ0.000
min2845.000-2768.000=77.000
max2845.000-2768.000=77.000
mean2.790-2.882=-0.092
σ0.010-0.014=-0.004
min2.780-2.862=-0.082
max2.804-2.893=-0.089
policies=200
mean17593.367-18129.101=-535.734
σ0.522-0.477=0.045
min17592.702-18128.710=-536.008
max17593.869-18129.783=-535.914
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2845.000-2768.000=77.000
σ0.000
min2845.000-2768.000=77.000
max2845.000-2768.000=77.000
mean27.895-28.486=-0.592
σ0.317-0.242=0.075
min27.485-28.247=-0.762
max28.235-28.747=-0.512