Compare commits

Home / Compare 2c406901 .. 1f3d5be9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.379-70.380=-0.001
σ0.047-0.046=0.001
min70.349-70.352=-0.002
max70.510-70.509=0.001
mean414.400-413.000=1.400
σ0.516-0.000=0.516
min414.000-413.000=1.000
max415.000-413.000=2.000
mean0.158-0.160=-0.002
σ0.003-0.003=0.001
min0.152-0.157=-0.005
max0.164-0.166=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.145-21.143=0.001
σ0.003-0.002=0.001
min21.141-21.141=-0.000
max21.150-21.147=0.003
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.065-0.062=0.003
σ0.003-0.004=-0.001
min0.063-0.057=0.006
max0.072-0.067=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.386-1752.389=-0.003
σ0.363-0.361=0.002
min1751.823-1751.819=0.005
max1752.967-1752.977=-0.010
mean1632.800-1658.000=-25.200
σ608.988-636.058=-27.070
min631.000-623.000=8.000
max2452.000-2800.000=-348.000
mean2.855-2.762=0.093
σ0.109-0.223=-0.115
min2.592-2.156=0.435
max3.051-3.003=0.048

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.129-270.126=0.003
σ0.007-0.003=0.003
min270.120-270.122=-0.002
max270.139-270.131=0.008
mean2452.000-2800.000=-348.000
σ0.000
min2452.000-2800.000=-348.000
max2452.000-2800.000=-348.000
mean0.379-0.379=-0.000
σ0.002-0.001=0.001
min0.377-0.377=-0.000
max0.382-0.380=0.003
iters=5
new-facts=1
prior-facts=6402
mean1930.591-1930.580=0.011
σ0.020-0.025=-0.004
min1930.561-1930.541=0.019
max1930.606-1930.600=0.006
mean2452.000-2800.000=-348.000
σ0.000
min2452.000-2800.000=-348.000
max2452.000-2800.000=-348.000
mean2.555-2.549=0.006
σ0.101-0.314=-0.213
min2.437-2.299=0.138
max2.678-3.090=-0.412
iters=5
new-facts=6402
prior-facts=1
mean4751.140-4750.972=0.168
σ0.779-0.965=-0.186
min4750.697-4750.081=0.616
max4752.527-4752.624=-0.097
mean2452.000-2800.000=-348.000
σ0.000
min2452.000-2800.000=-348.000
max2452.000-2800.000=-348.000
mean8.080-8.480=-0.401
σ0.309-0.283=0.027
min7.738-8.228=-0.490
max8.499-8.962=-0.463
iters=5
new-facts=6402
prior-facts=6402
mean4941.460-4941.535=-0.074
σ0.206-0.090=0.116
min4941.116-4941.457=-0.341
max4941.622-4941.635=-0.013
mean2907.000-3027.000=-120.000
σ399.470-222.770=176.700
min2452.000-2800.000=-348.000
max3436.000-3322.000=114.000
mean8.347-8.524=-0.177
σ0.030-0.204=-0.175
min8.310-8.342=-0.032
max8.388-8.823=-0.435

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.797-0.991=0.806
σ0.172-0.144=0.028
min1.616-0.923=0.693
max2.083-1.249=0.833

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.349-466.355=-0.006
σ575.916-575.921=-0.005
min178.391-178.390=0.001
max1330.223-1330.237=-0.013
mean84.000
σ8.000
min80.000
max96.000
mean2452.000-2800.000=-348.000
σ0.000
min2452.000-2800.000=-348.000
max2452.000-2800.000=-348.000
mean0.560-0.435=0.125
σ0.550-0.303=0.247
min0.282-0.283=-0.000
max1.385-0.889=0.496
policies=20
mean1784.191-1784.227=-0.036
σ0.355-0.356=-0.001
min1783.966-1783.986=-0.020
max1784.719-1784.753=-0.033
mean800.000
σ0.000
min800.000
max800.000
mean2452.000-2800.000=-348.000
σ0.000
min2452.000-2800.000=-348.000
max2452.000-2800.000=-348.000
mean2.768-2.847=-0.079
σ0.022-0.132=-0.110
min2.751-2.752=-0.000
max2.800-3.034=-0.234
policies=200
mean17848.899-17848.644=0.255
σ0.484-0.469=0.015
min17848.584-17848.367=0.217
max17849.619-17849.346=0.272
mean8000.000
σ0.000
min8000.000
max8000.000
mean2452.000-2800.000=-348.000
σ0.000
min2452.000-2800.000=-348.000
max2452.000-2800.000=-348.000
mean27.919-28.063=-0.144
σ0.060-0.222=-0.162
min27.830-27.857=-0.027
max27.957-28.264=-0.307