Compare commits

Home / Compare d86c1d96 .. c032e189

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.796-35.973=-0.176
σ0.104-0.105=-0.001
min35.741-35.916=-0.174
max36.092-36.270=-0.178
mean414.200-415.000=-0.800
σ0.422-0.000=0.422
min414.000-415.000=-1.000
max415.000
mean0.073-0.076=-0.003
σ0.004-0.003=0.001
min0.069-0.074=-0.005
max0.081-0.083=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.063-26.207=-0.143
σ0.003-0.004=-0.001
min26.058-26.201=-0.143
max26.067-26.212=-0.145
mean415.000
σ0.000
min415.000
max415.000
mean0.062-0.060=0.002
σ0.003-0.003=-0.000
min0.060-0.057=0.004
max0.069-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.924-1758.364=-2.440
σ0.366-0.371=-0.005
min1755.347-1757.790=-2.443
max1756.515-1758.964=-2.449
mean1662.550-1650.300=12.250
σ627.956-630.653=-2.697
min671.000-678.000=-7.000
max2659.000-2838.000=-179.000
mean2.788-2.374=0.414
σ0.157-0.096=0.060
min2.346-2.223=0.124
max2.954-2.680=0.274

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.196-279.514=-2.317
σ0.009-0.011=-0.002
min277.189-279.495=-2.307
max277.210-279.524=-2.314
mean2659.000-2838.000=-179.000
σ0.000
min2659.000-2838.000=-179.000
max2659.000-2838.000=-179.000
mean0.392-0.415=-0.023
σ0.002-0.014=-0.012
min0.390-0.404=-0.014
max0.394-0.438=-0.044
iters=5
new-facts=1
prior-facts=6402
mean2174.423-2178.451=-4.028
σ0.011-0.011=-0.001
min2174.406-2178.441=-4.035
max2174.433-2178.470=-4.037
mean2659.000-2838.000=-179.000
σ0.000
min2659.000-2838.000=-179.000
max2659.000-2838.000=-179.000
mean2.840-3.311=-0.471
σ0.121-0.177=-0.056
min2.721-3.006=-0.285
max2.991-3.459=-0.468
iters=5
new-facts=6402
prior-facts=1
mean5052.612-5056.374=-3.763
σ0.967-0.990=-0.022
min5052.132-5055.774=-3.642
max5054.337-5058.131=-3.793
mean2659.000-2838.000=-179.000
σ0.000
min2659.000-2838.000=-179.000
max2659.000-2838.000=-179.000
mean9.040-9.184=-0.144
σ0.670-0.463=0.207
min8.031-8.393=-0.362
max9.637-9.569=0.068
iters=5
new-facts=6402
prior-facts=6402
mean5188.416-5193.659=-5.243
σ0.096-0.086=0.011
min5188.312-5193.512=-5.200
max5188.526-5193.730=-5.204
mean3216.200-3304.800=-88.600
σ478.804-454.169=24.635
min2659.000-2838.000=-179.000
max3865.000-3944.000=-79.000
mean8.823-8.796=0.027
σ0.216-0.169=0.048
min8.643-8.650=-0.007
max9.124-8.996=0.128

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.230-0.972=0.258
σ0.334-0.054=0.280
min0.945-0.943=0.002
max1.793-1.068=0.725

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.857-465.482=-0.624
σ572.656-572.656=0.000
min178.528-179.147=-0.619
max1323.842-1324.466=-0.624
mean79.500
σ7.000
min76.000
max90.000
mean2659.000-2838.000=-179.000
σ0.000
min2659.000-2838.000=-179.000
max2659.000-2838.000=-179.000
mean0.559-0.444=0.115
σ0.558-0.302=0.255
min0.278-0.290=-0.012
max1.395-0.898=0.498
policies=20
mean1785.474-1791.732=-6.258
σ0.354-0.341=0.013
min1785.242-1791.493=-6.251
max1786.001-1792.232=-6.231
mean760.000
σ0.000
min760.000
max760.000
mean2659.000-2838.000=-179.000
σ0.000
min2659.000-2838.000=-179.000
max2659.000-2838.000=-179.000
mean2.782-2.865=-0.083
σ0.015-0.002=0.013
min2.761-2.863=-0.102
max2.792-2.866=-0.074
policies=200
mean17861.435-17923.505=-62.069
σ0.411-0.457=-0.046
min17861.181-17923.224=-62.043
max17862.042-17924.183=-62.141
mean7600.000
σ0.000
min7600.000
max7600.000
mean2659.000-2838.000=-179.000
σ0.000
min2659.000-2838.000=-179.000
max2659.000-2838.000=-179.000
mean28.067-28.259=-0.192
σ0.123-0.363=-0.240
min27.940-27.944=-0.004
max28.236-28.779=-0.544