Compare commits

Home / Compare 754e8f45 .. b0c7540c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.065-73.048=0.017
σ0.048-0.049=-0.001
min73.043-73.024=0.019
max73.200-73.187=0.013
mean416.000-419.100=-3.100
σ0.000-0.568=-0.568
min416.000-418.000=-2.000
max416.000-420.000=-4.000
mean0.161-0.162=-0.000
σ0.004-0.003=0.001
min0.157-0.158=-0.001
max0.169-0.167=0.002
cache=y
dps=1
iters=10
policies=100
mean23.756-23.741=0.015
σ0.004-0.004=-0.001
min23.751-23.737=0.015
max23.762-23.751=0.010
mean416.000-420.000=-4.000
σ0.000
min416.000-420.000=-4.000
max416.000-420.000=-4.000
mean0.068-0.066=0.002
σ0.004-0.002=0.001
min0.066-0.064=0.001
max0.077-0.072=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.793-1758.788=0.006
σ0.361-0.360=0.001
min1758.220-1758.213=0.007
max1759.373-1759.368=0.005
mean1628.450-1662.950=-34.500
σ600.982-626.600=-25.618
min625.000-629.000=-4.000
max2425.000-2521.000=-96.000
mean2.823-2.826=-0.003
σ0.137-0.101=0.037
min2.392-2.603=-0.211
max3.032-2.953=0.079

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.022-324.013=0.008
σ0.054-0.055=-0.000
min323.925-323.916=0.009
max324.050-324.043=0.007
mean2425.000-2521.000=-96.000
σ0.000
min2425.000-2521.000=-96.000
max2425.000-2521.000=-96.000
mean0.428-0.428=-0.000
σ0.005-0.005=-0.000
min0.425-0.425=-0.000
max0.436-0.437=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1984.588-1984.592=-0.004
σ0.023-0.022=0.002
min1984.562-1984.555=0.006
max1984.608-1984.607=0.001
mean2425.000-2521.000=-96.000
σ0.000
min2425.000-2521.000=-96.000
max2425.000-2521.000=-96.000
mean2.687-2.613=0.074
σ0.155-0.104=0.051
min2.561-2.491=0.070
max2.860-2.744=0.116
iters=5
new-facts=6402
prior-facts=1
mean4808.111-4808.226=-0.115
σ7.842-7.815=0.027
min4804.089-4804.651=-0.562
max4822.129-4822.205=-0.077
mean2425.000-2521.000=-96.000
σ0.000
min2425.000-2521.000=-96.000
max2425.000-2521.000=-96.000
mean8.635-8.857=-0.222
σ0.370-0.136=0.234
min8.103-8.646=-0.543
max9.032-9.026=0.006
iters=5
new-facts=6402
prior-facts=6402
mean4995.735-4995.666=0.069
σ0.167-0.181=-0.014
min4995.437-4995.467=-0.030
max4995.828-4995.825=0.004
mean2898.000-2992.600=-94.600
σ399.332-300.319=99.013
min2425.000-2584.000=-159.000
max3456.000-3362.000=94.000
mean8.441-8.685=-0.244
σ0.044-0.147=-0.103
min8.383-8.543=-0.160
max8.483-8.928=-0.445

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.671-1.570=0.101
σ0.074-0.193=-0.119
min1.611-1.243=0.368
max1.798-1.712=0.085

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.330-468.328=0.002
σ574.232-574.236=-0.004
min181.212-181.209=0.003
max1329.679-1329.682=-0.003
mean88.250
σ8.500
min84.000
max101.000
mean2425.000-2521.000=-96.000
σ0.000
min2425.000-2521.000=-96.000
max2425.000-2521.000=-96.000
mean0.552-0.554=-0.003
σ0.538-0.540=-0.002
min0.281-0.283=-0.002
max1.359-1.364=-0.005
policies=20
mean1812.484-1812.422=0.062
σ0.389-0.386=0.002
min1812.223-1812.152=0.071
max1813.059-1812.991=0.067
mean840.000
σ0.000
min840.000
max840.000
mean2425.000-2521.000=-96.000
σ0.000
min2425.000-2521.000=-96.000
max2425.000-2521.000=-96.000
mean2.819-2.821=-0.002
σ0.019-0.005=0.015
min2.799-2.817=-0.018
max2.841-2.825=0.016
policies=200
mean18132.360-18131.469=0.892
σ0.504-0.618=-0.114
min18131.940-18131.021=0.919
max18133.093-18132.374=0.718
mean8400.000
σ0.000
min8400.000
max8400.000
mean2425.000-2521.000=-96.000
σ0.000
min2425.000-2521.000=-96.000
max2425.000-2521.000=-96.000
mean28.248-28.406=-0.158
σ0.052-0.114=-0.061
min28.189-28.337=-0.148
max28.302-28.575=-0.273