Compare commits

Home / Compare 4aba7f51 .. 212dcd27

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.380-70.380=-0.000
σ0.046-0.047=-0.002
min70.350-70.351=-0.000
max70.507-70.513=-0.006
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.162-0.158=0.004
σ0.003-0.006=-0.002
min0.157-0.150=0.007
max0.167-0.167=0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=0.000
σ0.002-0.003=-0.001
min21.141-21.137=0.003
max21.149-21.148=0.001
mean413.800-414.000=-0.200
σ0.422-0.000=0.422
min413.000-414.000=-1.000
max414.000
mean0.067-0.066=0.001
σ0.003-0.003=-0.000
min0.064-0.063=0.001
max0.074-0.072=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.387-1752.388=-0.001
σ0.362-0.361=0.001
min1751.816-1751.816=0.000
max1752.971-1752.969=0.002
mean1656.350-1649.550=6.800
σ638.034-626.371=11.663
min623.000-624.000=-1.000
max2822.000-2849.000=-27.000
mean2.817-2.830=-0.013
σ0.162-0.137=0.025
min2.386-2.483=-0.096
max3.019-3.053=-0.034

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.220-270.227=-0.007
σ0.008-0.005=0.003
min270.212-270.222=-0.010
max270.233-270.235=-0.002
mean2822.000-2849.000=-27.000
σ0.000
min2822.000-2849.000=-27.000
max2822.000-2849.000=-27.000
mean0.372-0.383=-0.011
σ0.003-0.004=-0.001
min0.371-0.380=-0.009
max0.377-0.389=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1930.689-1930.676=0.014
σ0.009-0.018=-0.010
min1930.676-1930.649=0.027
max1930.698-1930.694=0.004
mean2822.000-2849.000=-27.000
σ0.000
min2822.000-2849.000=-27.000
max2822.000-2849.000=-27.000
mean2.630-2.555=0.075
σ0.117-0.127=-0.010
min2.461-2.428=0.033
max2.789-2.744=0.045
iters=5
new-facts=6402
prior-facts=1
mean4751.160-4751.186=-0.026
σ0.838-0.880=-0.042
min4750.590-4750.707=-0.116
max4752.645-4752.744=-0.100
mean2822.000-2849.000=-27.000
σ0.000
min2822.000-2849.000=-27.000
max2822.000-2849.000=-27.000
mean8.525-8.460=0.064
σ0.451-0.465=-0.014
min7.827-7.843=-0.015
max9.024-9.088=-0.064
iters=5
new-facts=6402
prior-facts=6402
mean4941.552-4941.618=-0.066
σ0.209-0.078=0.131
min4941.206-4941.547=-0.341
max4941.726-4941.704=0.022
mean3088.000-3081.400=6.600
σ280.510-308.260=-27.750
min2822.000-2849.000=-27.000
max3380.000-3560.000=-180.000
mean8.690-8.442=0.248
σ0.271-0.096=0.175
min8.412-8.336=0.076
max8.968-8.584=0.384

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.059-1.032=0.027
σ0.125-0.135=-0.010
min0.943-0.943=-0.000
max1.249-1.252=-0.004

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.355-466.362=-0.007
σ575.926-575.920=0.006
min178.389-178.397=-0.008
max1330.244-1330.242=0.002
mean84.000
σ8.000
min80.000
max96.000
mean2822.000-2849.000=-27.000
σ0.000
min2822.000-2849.000=-27.000
max2822.000-2849.000=-27.000
mean0.435-0.446=-0.012
σ0.293-0.308=-0.016
min0.284-0.287=-0.003
max0.874-0.909=-0.035
policies=20
mean1784.246-1784.245=0.000
σ0.360-0.369=-0.009
min1783.998-1783.982=0.016
max1784.776-1784.787=-0.011
mean800.000
σ0.000
min800.000
max800.000
mean2822.000-2849.000=-27.000
σ0.000
min2822.000-2849.000=-27.000
max2822.000-2849.000=-27.000
mean2.899-2.861=0.039
σ0.076-0.008=0.068
min2.851-2.852=-0.001
max3.013-2.868=0.145
policies=200
mean17848.797-17848.877=-0.080
σ0.505-0.465=0.040
min17848.377-17848.596=-0.220
max17849.512-17849.569=-0.056
mean8000.000
σ0.000
min8000.000
max8000.000
mean2822.000-2849.000=-27.000
σ0.000
min2822.000-2849.000=-27.000
max2822.000-2849.000=-27.000
mean27.995-28.412=-0.417
σ0.095-0.535=-0.440
min27.938-27.936=0.002
max28.137-28.905=-0.768