Compare commits

Home / Compare e43301db .. 879be2ab

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.780=0.002
σ0.048-0.044=0.004
min70.749-70.749=-0.001
max70.914-70.902=0.012
mean415.000
σ0.000
min415.000
max415.000
mean0.161-0.157=0.004
σ0.003-0.005=-0.003
min0.157-0.150=0.007
max0.165-0.168=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.491-21.493=-0.001
σ0.003-0.003=0.000
min21.488-21.488=-0.001
max21.495-21.498=-0.003
mean415.000
σ0.000
min415.000
max415.000
mean0.063-0.065=-0.002
σ0.003-0.002=0.001
min0.059-0.063=-0.004
max0.069-0.071=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.092-1754.093=-0.002
σ0.360-0.362=-0.002
min1753.529-1753.527=0.002
max1754.681-1754.676=0.005
mean1663.250-1657.400=5.850
σ635.275-631.064=4.211
min629.000-627.000=2.000
max2778.000-2709.000=69.000
mean2.819-2.827=-0.007
σ0.121-0.177=-0.057
min2.477-2.441=0.036
max3.042-3.110=-0.067

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.956-271.957=-0.001
σ0.004-0.004=-0.000
min271.949-271.954=-0.005
max271.959-271.965=-0.006
mean2778.000-2709.000=69.000
σ0.000
min2778.000-2709.000=69.000
max2778.000-2709.000=69.000
mean0.380-0.385=-0.005
σ0.003-0.009=-0.007
min0.378-0.380=-0.003
max0.384-0.402=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1932.324-1792.062=140.262
σ0.019-313.645=-313.626
min1932.311-1230.997=701.314
max1932.357-1932.366=-0.008
mean2778.000-2709.000=69.000
σ0.000
min2778.000-2709.000=69.000
max2778.000-2709.000=69.000
mean2.889-2.788=0.101
σ0.252-0.593=-0.341
min2.476-1.735=0.741
max3.119-3.153=-0.034
iters=5
new-facts=6402
prior-facts=1
mean4753.084-4753.081=0.003
σ0.898-0.912=-0.014
min4752.600-4752.544=0.056
max4754.680-4754.692=-0.012
mean2778.000-2709.000=69.000
σ0.000
min2778.000-2709.000=69.000
max2778.000-2709.000=69.000
mean8.574-8.681=-0.107
σ0.416-0.465=-0.049
min8.047-8.044=0.003
max8.984-9.196=-0.212
iters=5
new-facts=6402
prior-facts=6402
mean4943.482-4943.481=0.002
σ0.158-0.166=-0.008
min4943.200-4943.185=0.016
max4943.570-4943.573=-0.003
mean2982.400-2937.800=44.600
σ218.367-292.709=-74.342
min2778.000-2709.000=69.000
max3313.000-3382.000=-69.000
mean8.605-8.427=0.178
σ0.338-0.071=0.266
min8.339-8.345=-0.006
max9.173-8.512=0.660

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.022-0.989=0.033
σ0.134-0.144=-0.010
min0.928-0.916=0.012
max1.239-1.246=-0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.654-468.666=-0.012
σ574.929-574.939=-0.009
min181.189-181.189=-0.000
max1331.049-1331.075=-0.026
mean88.250
σ8.500
min84.000
max101.000
mean2778.000-2709.000=69.000
σ0.000
min2778.000-2709.000=69.000
max2778.000-2709.000=69.000
mean0.449-0.555=-0.106
σ0.302-0.535=-0.232
min0.296-0.285=0.011
max0.902-1.357=-0.455
policies=20
mean1812.211-1812.213=-0.002
σ0.386-0.384=0.002
min1811.934-1811.955=-0.021
max1812.774-1812.782=-0.007
mean840.000
σ0.000
min840.000
max840.000
mean2778.000-2709.000=69.000
σ0.000
min2778.000-2709.000=69.000
max2778.000-2709.000=69.000
mean2.942-2.842=0.101
σ0.058-0.011=0.047
min2.902-2.827=0.075
max3.028-2.852=0.176
policies=200
mean18129.105-18129.224=-0.119
σ0.552-0.504=0.048
min18128.697-18128.929=-0.233
max18129.920-18129.979=-0.058
mean8400.000
σ0.000
min8400.000
max8400.000
mean2778.000-2709.000=69.000
σ0.000
min2778.000-2709.000=69.000
max2778.000-2709.000=69.000
mean28.516-28.594=-0.078
σ0.063-0.111=-0.048
min28.461-28.484=-0.023
max28.591-28.741=-0.150