Compare commits

Home / Compare 1850b5d6 .. fa2ff259

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-33.979=19.935
σ0.365-0.050=0.315
min53.779-33.948=19.831
max54.954-34.120=20.834
mean416.000-411.900=4.100
σ0.000-0.316=-0.316
min416.000-411.000=5.000
max416.000-412.000=4.000
mean0.138-0.082=0.056
σ0.003-0.005=-0.002
min0.135-0.076=0.059
max0.143-0.089=0.055
cache=y
dps=1
iters=10
policies=100
mean43.141-23.317=19.824
σ0.007-0.003=0.004
min43.131-23.312=19.819
max43.150-23.322=19.828
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.117-0.064=0.053
σ0.003-0.004=-0.000
min0.114-0.059=0.055
max0.126-0.072=0.054

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.809-1757.430=-765.620
σ1.257-0.364=0.892
min991.248-1756.857=-765.609
max997.098-1758.016=-760.918
mean1063.300-1645.950=-582.650
σ321.847-633.328=-311.480
min568.000-627.000=-59.000
max1636.000-2713.000=-1077.000
mean1.543-2.403=-0.860
σ0.096-0.171=-0.075
min1.397-2.244=-0.847
max1.741-2.968=-1.226

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.412-326.542=-41.130
σ0.010-0.047=-0.037
min285.395-326.459=-41.064
max285.421-326.579=-41.157
mean1636.000-2713.000=-1077.000
σ0.000
min1636.000-2713.000=-1077.000
max1636.000-2713.000=-1077.000
mean0.378-0.426=-0.049
σ0.007-0.004=0.003
min0.374-0.422=-0.048
max0.390-0.432=-0.042
iters=5
new-facts=1
prior-facts=6402
mean1285.373-1988.732=-703.359
σ0.124-0.011=0.113
min1285.314-1988.717=-703.402
max1285.596-1988.747=-703.151
mean1636.000-2713.000=-1077.000
σ0.000
min1636.000-2713.000=-1077.000
max1636.000-2713.000=-1077.000
mean1.916-2.726=-0.810
σ0.115-0.135=-0.020
min1.804-2.621=-0.816
max2.080-2.958=-0.878
iters=5
new-facts=6402
prior-facts=1
mean1807.689-4813.494=-3005.805
σ6.998-7.808=-0.810
min1804.337-4809.746=-3005.409
max1820.194-4827.458=-3007.264
mean1636.000-2713.000=-1077.000
σ0.000
min1636.000-2713.000=-1077.000
max1636.000-2713.000=-1077.000
mean4.115-8.689=-4.574
σ0.234-0.640=-0.406
min3.856-7.827=-3.971
max4.439-9.366=-4.927
iters=5
new-facts=6402
prior-facts=6402
mean2070.190-5001.133=-2930.943
σ0.007-0.015=-0.008
min2070.180-5001.115=-2930.935
max2070.200-5001.150=-2930.950
mean1838.200-2963.800=-1125.600
σ188.355-302.933=-114.578
min1636.000-2713.000=-1077.000
max2082.000-3429.000=-1347.000
mean4.477-9.281=-4.803
σ0.109-0.549=-0.440
min4.406-8.352=-3.946
max4.670-9.686=-5.016

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.193-0.940=0.254
σ0.361-0.057=0.303
min0.913-0.897=0.016
max1.760-1.038=0.722

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.786-464.565=-27.780
σ572.363-574.768=-2.405
min150.601-177.174=-26.573
max1295.330-1326.717=-31.387
mean90.250-88.250=2.000
σ8.500
min86.000-84.000=2.000
max103.000-101.000=2.000
mean1636.000-2713.000=-1077.000
σ0.000
min1636.000-2713.000=-1077.000
max1636.000-2713.000=-1077.000
mean0.535-0.543=-0.009
σ0.552-0.536=0.017
min0.254-0.274=-0.020
max1.363-1.347=0.016
policies=20
mean1506.265-1772.033=-265.768
σ0.252-0.341=-0.089
min1506.105-1771.810=-265.705
max1506.641-1772.540=-265.900
mean860.000-840.000=20.000
σ0.000
min860.000-840.000=20.000
max860.000-840.000=20.000
mean1636.000-2713.000=-1077.000
σ0.000
min1636.000-2713.000=-1077.000
max1636.000-2713.000=-1077.000
mean2.535-2.697=-0.161
σ0.040-0.021=0.019
min2.507-2.675=-0.168
max2.591-2.726=-0.135
policies=200
mean15070.386-17727.505=-2657.120
σ0.040-0.410=-0.371
min15070.341-17727.235=-2656.894
max15070.434-17728.115=-2657.681
mean8600.000-8400.000=200.000
σ0.000
min8600.000-8400.000=200.000
max8600.000-8400.000=200.000
mean1636.000-2713.000=-1077.000
σ0.000
min1636.000-2713.000=-1077.000
max1636.000-2713.000=-1077.000
mean25.370-27.401=-2.031
σ0.123-0.106=0.017
min25.247-27.293=-2.046
max25.504-27.514=-2.010