Compare commits

Home / Compare dacf3eab .. 48fcc2e3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.972=0.001
σ0.105-0.105=0.000
min35.916-35.920=-0.004
max36.270-36.268=0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.076-0.077=-0.000
σ0.003-0.004=-0.000
min0.074-0.074=-0.000
max0.083-0.084=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.207-26.207=-0.000
σ0.004-0.002=0.001
min26.201-26.202=-0.001
max26.212-26.210=0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.060-0.061=-0.001
σ0.003-0.002=0.000
min0.057-0.059=-0.003
max0.067-0.067=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.364-1758.365=-0.001
σ0.371-0.369=0.002
min1757.790-1757.788=0.002
max1758.964-1758.945=0.019
mean1650.300-1656.850=-6.550
σ630.653-620.620=10.033
min678.000-686.000=-8.000
max2838.000-2744.000=94.000
mean2.374-2.361=0.013
σ0.096-0.112=-0.015
min2.223-2.195=0.027
max2.680-2.597=0.084

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.514-279.512=0.001
σ0.011-0.008=0.003
min279.495-279.500=-0.004
max279.524-279.521=0.003
mean2838.000-2744.000=94.000
σ0.000
min2838.000-2744.000=94.000
max2838.000-2744.000=94.000
mean0.415-0.405=0.011
σ0.014-0.005=0.009
min0.404-0.400=0.004
max0.438-0.413=0.025
iters=5
new-facts=1
prior-facts=6402
mean2178.451-2178.438=0.013
σ0.011-0.012=-0.000
min2178.441-2178.426=0.015
max2178.470-2178.455=0.016
mean2838.000-2744.000=94.000
σ0.000
min2838.000-2744.000=94.000
max2838.000-2744.000=94.000
mean3.311-3.366=-0.055
σ0.177-0.211=-0.034
min3.006-3.194=-0.188
max3.459-3.728=-0.269
iters=5
new-facts=6402
prior-facts=1
mean5056.374-5056.359=0.015
σ0.990-0.980=0.010
min5055.774-5055.804=-0.030
max5058.131-5058.104=0.026
mean2838.000-2744.000=94.000
σ0.000
min2838.000-2744.000=94.000
max2838.000-2744.000=94.000
mean9.184-8.945=0.239
σ0.463-0.600=-0.137
min8.393-8.067=0.327
max9.569-9.559=0.010
iters=5
new-facts=6402
prior-facts=6402
mean5193.659-5193.736=-0.078
σ0.086-0.095=-0.010
min5193.512-5193.622=-0.110
max5193.730-5193.854=-0.125
mean3304.800-3220.400=84.400
σ454.169-467.854=-13.685
min2838.000-2744.000=94.000
max3944.000-3892.000=52.000
mean8.796-8.717=0.079
σ0.169-0.204=-0.035
min8.650-8.540=0.110
max8.996-9.070=-0.074

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.972-0.995=-0.022
σ0.054-0.067=-0.013
min0.943-0.938=0.005
max1.068-1.078=-0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.482-465.478=0.004
σ572.656-572.656=-0.000
min179.147-179.146=0.001
max1324.466-1324.462=0.004
mean79.500
σ7.000
min76.000
max90.000
mean2838.000-2744.000=94.000
σ0.000
min2838.000-2744.000=94.000
max2838.000-2744.000=94.000
mean0.444-0.483=-0.039
σ0.302-0.405=-0.103
min0.290-0.278=0.012
max0.898-1.091=-0.193
policies=20
mean1791.732-1791.704=0.029
σ0.341-0.330=0.011
min1791.493-1791.517=-0.024
max1792.232-1792.197=0.035
mean760.000
σ0.000
min760.000
max760.000
mean2838.000-2744.000=94.000
σ0.000
min2838.000-2744.000=94.000
max2838.000-2744.000=94.000
mean2.865-2.801=0.064
σ0.002-0.016=-0.014
min2.863-2.782=0.080
max2.866-2.819=0.047
policies=200
mean17923.505-17923.357=0.148
σ0.457-0.520=-0.064
min17923.224-17923.024=0.201
max17924.183-17924.120=0.063
mean7600.000
σ0.000
min7600.000
max7600.000
mean2838.000-2744.000=94.000
σ0.000
min2838.000-2744.000=94.000
max2838.000-2744.000=94.000
mean28.259-28.124=0.135
σ0.363-0.061=0.302
min27.944-28.072=-0.127
max28.779-28.211=0.568