Compare commits

Home / Compare bc293b9f .. 67e756ef

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.780=0.002
σ0.045-0.047=-0.002
min70.755-70.746=0.008
max70.907-70.909=-0.003
mean415.800-413.600=2.200
σ0.422-0.516=-0.095
min415.000-413.000=2.000
max416.000-414.000=2.000
mean0.160-0.159=0.001
σ0.004-0.004=-0.000
min0.156-0.156=0.000
max0.169-0.169=0.000
cache=y
dps=1
iters=10
policies=100
mean21.492-21.492=-0.000
σ0.002-0.003=-0.001
min21.487-21.486=0.002
max21.495-21.496=-0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.064-0.064=-0.000
σ0.003-0.004=-0.001
min0.060-0.060=-0.000
max0.072-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1754.095=-0.001
σ0.358-0.360=-0.003
min1753.532-1753.530=0.002
max1754.661-1754.674=-0.013
mean1660.000-1658.000=2.000
σ632.930-631.025=1.904
min629.000-628.000=1.000
max2713.000-2702.000=11.000
mean2.826-2.893=-0.067
σ0.176-0.097=0.079
min2.469-2.760=-0.291
max3.148-3.113=0.035

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.954-271.951=0.003
σ0.009-0.004=0.006
min271.940-271.947=-0.007
max271.964-271.955=0.009
mean2713.000-2702.000=11.000
σ0.000
min2713.000-2702.000=11.000
max2713.000-2702.000=11.000
mean0.386-0.380=0.006
σ0.007-0.002=0.006
min0.381-0.378=0.002
max0.398-0.382=0.016
iters=5
new-facts=1
prior-facts=6402
mean1932.337-1932.320=0.017
σ0.017-0.007=0.010
min1932.317-1932.310=0.007
max1932.360-1932.328=0.032
mean2713.000-2702.000=11.000
σ0.000
min2713.000-2702.000=11.000
max2713.000-2702.000=11.000
mean2.936-2.968=-0.032
σ0.216-0.097=0.119
min2.576-2.822=-0.246
max3.155-3.045=0.110
iters=5
new-facts=6402
prior-facts=1
mean4752.995-4752.888=0.107
σ1.018-1.167=-0.149
min4751.979-4751.445=0.533
max4754.699-4754.696=0.002
mean2713.000-2702.000=11.000
σ0.000
min2713.000-2702.000=11.000
max2713.000-2702.000=11.000
mean8.513-8.463=0.049
σ0.630-0.603=0.026
min7.631-7.666=-0.035
max9.185-9.073=0.113
iters=5
new-facts=6402
prior-facts=6402
mean4943.490-4943.491=-0.001
σ0.152-0.159=-0.007
min4943.220-4943.208=0.012
max4943.573-4943.577=-0.004
mean3030.000-3036.000=-6.000
σ279.412-262.704=16.708
min2713.000-2702.000=11.000
max3413.000-3348.000=65.000
mean8.570-8.576=-0.006
σ0.109-0.105=0.004
min8.430-8.458=-0.029
max8.665-8.703=-0.038

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.020-1.063=-0.043
σ0.143-0.224=-0.081
min0.925-0.934=-0.009
max1.253-1.452=-0.199

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.655-468.665=-0.010
σ574.927-574.936=-0.009
min181.190-181.189=0.001
max1331.045-1331.069=-0.023
mean88.250
σ8.500
min84.000
max101.000
mean2713.000-2702.000=11.000
σ0.000
min2713.000-2702.000=11.000
max2713.000-2702.000=11.000
mean0.549-0.562=-0.013
σ0.508-0.546=-0.038
min0.291-0.287=0.004
max1.311-1.381=-0.070
policies=20
mean1812.171-1812.194=-0.023
σ0.380-0.385=-0.005
min1811.905-1811.928=-0.023
max1812.731-1812.761=-0.030
mean840.000
σ0.000
min840.000
max840.000
mean2713.000-2702.000=11.000
σ0.000
min2713.000-2702.000=11.000
max2713.000-2702.000=11.000
mean2.828-2.836=-0.008
σ0.011-0.011=0.000
min2.818-2.823=-0.005
max2.844-2.850=-0.006
policies=200
mean18129.074-18128.993=0.080
σ0.483-0.354=0.129
min18128.709-18128.718=-0.009
max18129.768-18129.513=0.255
mean8400.000
σ0.000
min8400.000
max8400.000
mean2713.000-2702.000=11.000
σ0.000
min2713.000-2702.000=11.000
max2713.000-2702.000=11.000
mean28.578-28.486=0.093
σ0.110-0.080=0.030
min28.488-28.404=0.084
max28.722-28.595=0.127