Compare commits

Home / Compare 8e1977a3 .. d82fe46c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-73.046=-37.801
σ0.054-0.046=0.007
min35.217-73.021=-37.804
max35.396-73.176=-37.780
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.086-0.161=-0.075
σ0.005-0.003=0.002
min0.082-0.158=-0.076
max0.096-0.167=-0.072
cache=y
dps=1
iters=10
policies=100
mean23.769-23.740=0.028
σ0.002-0.004=-0.001
min23.764-23.736=0.028
max23.772-23.748=0.024
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.068-0.065=0.002
σ0.003-0.003=-0.000
min0.064-0.061=0.003
max0.075-0.073=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.483-1758.787=-2.303
σ0.365-0.362=0.003
min1755.910-1758.212=-2.301
max1757.077-1759.385=-2.308
mean1659.600-1660.850=-1.250
σ646.857-623.111=23.745
min628.000-678.000=-50.000
max2811.000-2710.000=101.000
mean2.360-2.760=-0.400
σ0.105-0.187=-0.082
min2.255-2.326=-0.070
max2.713-3.004=-0.291

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.709-324.011=0.698
σ0.039-0.052=-0.013
min324.639-323.917=0.722
max324.732-324.040=0.692
mean2811.000-2710.000=101.000
σ0.000
min2811.000-2710.000=101.000
max2811.000-2710.000=101.000
mean0.422-0.427=-0.005
σ0.001-0.002=-0.001
min0.421-0.426=-0.005
max0.423-0.429=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1985.271-1984.589=0.683
σ0.007-0.018=-0.011
min1985.264-1984.557=0.707
max1985.282-1984.603=0.679
mean2811.000-2710.000=101.000
σ0.000
min2811.000-2710.000=101.000
max2811.000-2710.000=101.000
mean2.615-2.652=-0.037
σ0.074-0.141=-0.067
min2.552-2.544=0.008
max2.702-2.895=-0.193
iters=5
new-facts=6402
prior-facts=1
mean4808.890-4808.152=0.738
σ7.653-7.784=-0.131
min4805.356-4804.234=1.122
max4822.579-4822.068=0.511
mean2811.000-2710.000=101.000
σ0.000
min2811.000-2710.000=101.000
max2811.000-2710.000=101.000
mean8.705-8.524=0.182
σ0.572-0.302=0.270
min7.712-8.136=-0.424
max9.098-8.874=0.224
iters=5
new-facts=6402
prior-facts=6402
mean4996.467-4995.808=0.659
σ0.016-0.017=-0.001
min4996.450-4995.789=0.661
max4996.485-4995.832=0.652
mean3015.800-3009.200=6.600
σ207.944-254.332=-46.388
min2811.000-2710.000=101.000
max3301.000-3330.000=-29.000
mean8.667-8.821=-0.154
σ0.104-0.367=-0.263
min8.541-8.481=0.060
max8.810-9.434=-0.623

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.949-1.010=-0.061
σ0.054-0.134=-0.079
min0.916-0.921=-0.005
max1.042-1.228=-0.186

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.966-468.335=-5.369
σ574.249-574.243=0.005
min175.838-181.212=-5.374
max1324.339-1329.700=-5.361
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2811.000-2710.000=101.000
σ0.000
min2811.000-2710.000=101.000
max2811.000-2710.000=101.000
mean0.424-0.571=-0.147
σ0.291-0.575=-0.284
min0.275-0.282=-0.007
max0.861-1.434=-0.573
policies=20
mean1758.716-1812.429=-53.713
σ0.345-0.395=-0.050
min1758.495-1812.167=-53.671
max1759.229-1813.014=-53.785
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2811.000-2710.000=101.000
σ0.000
min2811.000-2710.000=101.000
max2811.000-2710.000=101.000
mean2.784-2.819=-0.035
σ0.005-0.023=-0.018
min2.779-2.794=-0.014
max2.789-2.842=-0.053
policies=200
mean17592.527-18131.662=-539.135
σ0.443-0.515=-0.072
min17592.170-18131.325=-539.156
max17593.135-18132.430=-539.295
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2811.000-2710.000=101.000
σ0.000
min2811.000-2710.000=101.000
max2811.000-2710.000=101.000
mean27.502-28.459=-0.958
σ0.206-0.376=-0.170
min27.261-28.220=-0.959
max27.764-29.017=-1.253