Compare commits

Home / Compare 0d444e5e .. 7e434c7d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.046-73.046=0.000
σ0.049-0.049=-0.001
min73.022-73.022=0.000
max73.184-73.186=-0.002
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.161-0.162=-0.001
σ0.003-0.003=-0.001
min0.158-0.156=0.002
max0.166-0.168=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.740-23.739=0.001
σ0.003-0.003=0.000
min23.734-23.736=-0.002
max23.744-23.744=0.000
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.064-0.060=0.004
σ0.003-0.001=0.002
min0.059-0.059=-0.001
max0.068-0.061=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.786-1758.788=-0.002
σ0.363-0.360=0.003
min1758.217-1758.215=0.002
max1759.371-1759.369=0.001
mean1659.800-1659.050=0.750
σ631.172-624.226=6.946
min622.000-625.000=-3.000
max2892.000-2514.000=378.000
mean2.737-2.827=-0.090
σ0.212-0.130=0.082
min2.254-2.414=-0.160
max3.087-3.008=0.079

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.008-324.025=-0.017
σ0.052-0.036=0.017
min323.915-323.962=-0.047
max324.034-324.047=-0.013
mean2892.000-2514.000=378.000
σ0.000
min2892.000-2514.000=378.000
max2892.000-2514.000=378.000
mean0.426-0.428=-0.002
σ0.001-0.002=-0.002
min0.425-0.425=0.000
max0.427-0.431=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1984.579-1984.582=-0.003
σ0.012-0.017=-0.006
min1984.568-1984.558=0.010
max1984.594-1984.600=-0.006
mean2892.000-2514.000=378.000
σ0.000
min2892.000-2514.000=378.000
max2892.000-2514.000=378.000
mean2.608-2.596=0.012
σ0.080-0.053=0.027
min2.539-2.550=-0.011
max2.710-2.681=0.028
iters=5
new-facts=6402
prior-facts=1
mean4808.118-4808.235=-0.117
σ7.520-7.777=-0.257
min4804.738-4804.693=0.045
max4821.570-4822.146=-0.576
mean2892.000-2514.000=378.000
σ0.000
min2892.000-2514.000=378.000
max2892.000-2514.000=378.000
mean8.761-8.802=-0.040
σ0.164-0.139=0.025
min8.612-8.648=-0.036
max8.952-8.956=-0.004
iters=5
new-facts=6402
prior-facts=6402
mean4995.805-4995.799=0.006
σ0.016-0.021=-0.006
min4995.788-4995.770=0.017
max4995.819-4995.820=-0.001
mean3020.800-2987.800=33.000
σ203.297-275.539=-72.242
min2892.000-2603.000=289.000
max3357.000-3290.000=67.000
mean8.604-8.698=-0.094
σ0.168-0.169=-0.001
min8.462-8.467=-0.005
max8.881-8.878=0.003

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.013-1.679=-0.666
σ0.143-0.204=-0.061
min0.911-1.353=-0.442
max1.247-1.846=-0.599

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.349-468.325=0.025
σ574.230-574.232=-0.002
min181.225-181.203=0.022
max1329.695-1329.673=0.022
mean88.250
σ8.500
min84.000
max101.000
mean2892.000-2514.000=378.000
σ0.000
min2892.000-2514.000=378.000
max2892.000-2514.000=378.000
mean0.447-0.566=-0.120
σ0.306-0.566=-0.260
min0.290-0.280=0.010
max0.906-1.416=-0.510
policies=20
mean1812.619-1812.401=0.218
σ0.401-0.387=0.014
min1812.341-1812.145=0.196
max1813.210-1812.974=0.236
mean840.000
σ0.000
min840.000
max840.000
mean2892.000-2514.000=378.000
σ0.000
min2892.000-2514.000=378.000
max2892.000-2514.000=378.000
mean2.887-2.813=0.073
σ0.017-0.019=-0.002
min2.862-2.800=0.063
max2.898-2.840=0.058
policies=200
mean18132.175-18131.561=0.615
σ0.888-0.505=0.383
min18131.008-18131.133=-0.125
max18132.919-18132.290=0.629
mean8400.000
σ0.000
min8400.000
max8400.000
mean2892.000-2514.000=378.000
σ0.000
min2892.000-2514.000=378.000
max2892.000-2514.000=378.000
mean28.831-28.345=0.486
σ0.341-0.097=0.244
min28.487-28.277=0.210
max29.135-28.484=0.651