Compare commits

Home / Compare 112b13f0 .. e17df95b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.969-35.952=0.018
σ0.104-0.101=0.003
min35.923-35.911=0.012
max36.263-36.239=0.024
mean416.000
σ0.000
min416.000
max416.000
mean0.074-0.078=-0.004
σ0.004-0.004=-0.000
min0.070-0.074=-0.004
max0.082-0.085=-0.003
cache=y
dps=1
iters=10
policies=100
mean26.208-26.199=0.009
σ0.003-0.004=-0.001
min26.202-26.194=0.009
max26.214-26.207=0.007
mean416.000
σ0.000
min416.000
max416.000
mean0.060-0.060=0.000
σ0.004-0.003=0.001
min0.056-0.057=-0.001
max0.069-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.758-1756.299=1.458
σ0.371-0.369=0.002
min1757.179-1755.722=1.457
max1758.357-1756.890=1.467
mean1649.550-1659.750=-10.200
σ620.963-631.421=-10.458
min624.000-614.000=10.000
max2740.000-2730.000=10.000
mean2.385-2.398=-0.013
σ0.124-0.117=0.006
min2.274-2.273=0.001
max2.748-2.752=-0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean280.284-278.815=1.468
σ0.012-0.005=0.007
min280.266-278.807=1.459
max280.297-278.819=1.478
mean2740.000-2730.000=10.000
σ0.000
min2740.000-2730.000=10.000
max2740.000-2730.000=10.000
mean0.415-0.411=0.004
σ0.008-0.005=0.002
min0.410-0.407=0.003
max0.428-0.418=0.010
iters=5
new-facts=1
prior-facts=6402
mean2270.304-2268.881=1.423
σ0.028-0.008=0.020
min2270.281-2268.876=1.405
max2270.347-2268.894=1.452
mean2740.000-2730.000=10.000
σ0.000
min2740.000-2730.000=10.000
max2740.000-2730.000=10.000
mean3.098-3.043=0.055
σ0.149-0.099=0.050
min2.921-2.929=-0.008
max3.240-3.154=0.086
iters=5
new-facts=6402
prior-facts=1
mean5147.452-4954.217=193.236
σ1.063-0.867=0.196
min5146.595-4953.681=192.914
max5149.300-4955.758=193.542
mean2740.000-2730.000=10.000
σ0.000
min2740.000-2730.000=10.000
max2740.000-2730.000=10.000
mean8.704-8.177=0.527
σ0.505-0.366=0.139
min8.192-7.837=0.356
max9.366-8.673=0.693
iters=5
new-facts=6402
prior-facts=6402
mean5285.582-5168.719=116.864
σ0.229-0.204=0.025
min5285.201-5168.377=116.823
max5285.762-5168.876=116.886
mean3479.200-3378.400=100.800
σ429.907-535.296=-105.389
min2851.000-2903.000=-52.000
max3957.000-4152.000=-195.000
mean10.084-9.111=0.972
σ0.258-0.326=-0.068
min9.714-8.570=1.143
max10.422-9.357=1.065

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.022-1.052=-0.030
σ0.062-0.134=-0.072
min0.940-0.930=0.010
max1.073-1.261=-0.188

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.301-459.801=4.500
σ572.665-571.582=1.083
min177.960-174.003=3.957
max1323.298-1317.174=6.124
mean81.500-79.500=2.000
σ7.000
min78.000-76.000=2.000
max92.000-90.000=2.000
mean2740.000-2730.000=10.000
σ0.000
min2740.000-2730.000=10.000
max2740.000-2730.000=10.000
mean0.478-0.535=-0.057
σ0.404-0.534=-0.130
min0.272-0.264=0.008
max1.083-1.336=-0.253
policies=20
mean1779.921-1740.330=39.591
σ0.365-0.319=0.046
min1779.707-1740.127=39.580
max1780.467-1740.805=39.661
mean780.000-760.000=20.000
σ0.000
min780.000-760.000=20.000
max780.000-760.000=20.000
mean2740.000-2730.000=10.000
σ0.000
min2740.000-2730.000=10.000
max2740.000-2730.000=10.000
mean2.763-2.700=0.063
σ0.019-0.012=0.007
min2.747-2.686=0.061
max2.790-2.713=0.077
policies=200
mean17805.830-17410.155=395.675
σ0.496-0.399=0.097
min17805.474-17409.943=395.531
max17806.560-17410.753=395.807
mean7800.000-7600.000=200.000
σ0.000
min7800.000-7600.000=200.000
max7800.000-7600.000=200.000
mean2740.000-2730.000=10.000
σ0.000
min2740.000-2730.000=10.000
max2740.000-2730.000=10.000
mean27.934-27.022=0.912
σ0.082-0.061=0.021
min27.863-26.952=0.911
max28.052-27.100=0.952