Compare commits

Home / Compare d50e4510 .. a9ebc6c1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.707-70.708=-0.000
σ0.044-0.048=-0.005
min70.680-70.672=0.008
max70.829-70.841=-0.012
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.162-0.159=0.002
σ0.003-0.004=-0.000
min0.159-0.156=0.002
max0.168-0.165=0.002
cache=y
dps=1
iters=10
policies=100
mean21.412-21.411=0.001
σ0.004-0.003=0.002
min21.405-21.408=-0.002
max21.418-21.415=0.003
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.065-0.065=0.001
σ0.003-0.003=-0.000
min0.064-0.063=0.001
max0.073-0.073=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1717.009-1754.934=-37.925
σ169.605-0.358=169.246
min996.440-1754.358=-757.918
max1755.513-1755.516=-0.003
mean1635.450-1661.750=-26.300
σ600.273-646.843=-46.570
min623.000-625.000=-2.000
max2518.000-2780.000=-262.000
mean2.810-2.866=-0.056
σ0.352-0.101=0.251
min1.393-2.744=-1.351
max3.029-3.106=-0.077

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.791-272.787=0.004
σ0.008-0.005=0.002
min272.782-272.779=0.003
max272.803-272.792=0.011
mean2518.000-2780.000=-262.000
σ0.000
min2518.000-2780.000=-262.000
max2518.000-2780.000=-262.000
mean0.379-0.376=0.002
σ0.005-0.002=0.003
min0.375-0.374=0.001
max0.388-0.378=0.010
iters=5
new-facts=1
prior-facts=6402
mean1933.218-1933.220=-0.001
σ0.010-0.018=-0.008
min1933.205-1933.194=0.011
max1933.233-1933.237=-0.004
mean2518.000-2780.000=-262.000
σ0.000
min2518.000-2780.000=-262.000
max2518.000-2780.000=-262.000
mean2.989-3.053=-0.064
σ0.121-0.046=0.075
min2.873-3.008=-0.135
max3.181-3.125=0.055
iters=5
new-facts=6402
prior-facts=1
mean4756.730-4756.965=-0.235
σ7.377-7.562=-0.186
min4752.891-4753.402=-0.510
max4769.913-4770.491=-0.578
mean2518.000-2780.000=-262.000
σ0.000
min2518.000-2780.000=-262.000
max2518.000-2780.000=-262.000
mean8.636-8.657=-0.021
σ0.409-0.562=-0.153
min8.209-7.986=0.223
max9.086-9.528=-0.442
iters=5
new-facts=6402
prior-facts=6402
mean4944.452-4944.377=0.074
σ0.027-0.164=-0.138
min4944.415-4944.085=0.330
max4944.481-4944.474=0.007
mean2938.200-3012.800=-74.600
σ296.406-292.224=4.183
min2518.000-2780.000=-262.000
max3305.000-3446.000=-141.000
mean8.484-8.544=-0.060
σ0.169-0.497=-0.328
min8.293-8.273=0.019
max8.700-9.429=-0.729

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.501-1.031=0.470
σ0.334-0.129=0.205
min1.051-0.914=0.136
max1.804-1.230=0.574

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.307-468.328=-0.022
σ574.231-574.226=0.005
min181.184-181.206=-0.022
max1329.653-1329.668=-0.014
mean88.250
σ8.500
min84.000
max101.000
mean2518.000-2780.000=-262.000
σ0.000
min2518.000-2780.000=-262.000
max2518.000-2780.000=-262.000
mean0.544-0.442=0.102
σ0.515-0.305=0.210
min0.283-0.286=-0.003
max1.316-0.899=0.417
policies=20
mean1812.153-1812.356=-0.203
σ0.386-0.387=-0.001
min1811.906-1812.084=-0.178
max1812.726-1812.925=-0.199
mean840.000
σ0.000
min840.000
max840.000
mean2518.000-2780.000=-262.000
σ0.000
min2518.000-2780.000=-262.000
max2518.000-2780.000=-262.000
mean2.801-2.872=-0.071
σ0.009-0.021=-0.013
min2.792-2.846=-0.054
max2.810-2.897=-0.086
policies=200
mean18129.122-18129.146=-0.024
σ0.514-0.323=0.192
min18128.733-18128.890=-0.156
max18129.875-18129.578=0.298
mean8400.000
σ0.000
min8400.000
max8400.000
mean2518.000-2780.000=-262.000
σ0.000
min2518.000-2780.000=-262.000
max2518.000-2780.000=-262.000
mean28.336-28.385=-0.048
σ0.035-0.213=-0.177
min28.301-28.201=0.100
max28.381-28.681=-0.300