Compare commits

Home / Compare d3b73bd5 .. d5f3ce21

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-53.914=0.000
σ0.366-0.366=0.000
min53.778-53.780=-0.002
max54.956-54.955=0.000
mean417.200-416.000=1.200
σ0.632-0.000=0.632
min417.000-416.000=1.000
max419.000-416.000=3.000
mean0.139-0.138=0.001
σ0.005-0.005=0.000
min0.133-0.130=0.003
max0.148-0.145=0.003
cache=y
dps=1
iters=10
policies=100
mean43.141-43.141=0.001
σ0.006-0.005=0.001
min43.131-43.132=-0.002
max43.152-43.148=0.004
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.121-0.118=0.003
σ0.003-0.004=-0.001
min0.118-0.112=0.005
max0.125-0.124=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.819-991.809=0.010
σ1.247-1.258=-0.011
min991.232-991.251=-0.020
max997.057-997.105=-0.048
mean1069.500-1063.150=6.350
σ322.827-322.359=0.468
min570.000-568.000=2.000
max1641.000-1635.000=6.000
mean1.545-1.551=-0.006
σ0.092-0.136=-0.044
min1.469-1.395=0.073
max1.774-1.976=-0.202

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.410-285.415=-0.005
σ0.010-0.009=0.001
min285.393-285.400=-0.007
max285.419-285.423=-0.004
mean1641.000-1635.000=6.000
σ0.000
min1641.000-1635.000=6.000
max1641.000-1635.000=6.000
mean0.375-0.378=-0.003
σ0.005-0.006=-0.001
min0.373-0.375=-0.002
max0.383-0.388=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1285.339-1285.373=-0.033
σ0.059-0.130=-0.071
min1285.307-1285.313=-0.007
max1285.444-1285.605=-0.161
mean1641.000-1635.000=6.000
σ0.000
min1641.000-1635.000=6.000
max1641.000-1635.000=6.000
mean1.932-1.852=0.080
σ0.118-0.085=0.034
min1.810-1.776=0.034
max2.093-1.992=0.101
iters=5
new-facts=6402
prior-facts=1
mean1807.727-1807.721=0.006
σ6.987-7.009=-0.022
min1804.375-1804.332=0.043
max1820.213-1820.243=-0.030
mean1641.000-1635.000=6.000
σ0.000
min1641.000-1635.000=6.000
max1641.000-1635.000=6.000
mean4.174-4.211=-0.038
σ0.247-0.226=0.021
min3.943-3.844=0.099
max4.501-4.424=0.077
iters=5
new-facts=6402
prior-facts=6402
mean2070.191-2070.193=-0.002
σ0.006-0.007=-0.001
min2070.182-2070.184=-0.002
max2070.197-2070.202=-0.005
mean1864.000-1846.600=17.400
σ200.975-175.668=25.307
min1641.000-1635.000=6.000
max2096.000-2091.000=5.000
mean4.442-4.470=-0.028
σ0.078-0.045=0.032
min4.323-4.426=-0.103
max4.536-4.539=-0.002

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.266-1.172=0.095
σ0.311-0.301=0.010
min1.043-0.914=0.129
max1.799-1.538=0.262

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.785-436.782=0.003
σ572.355-572.355=-0.000
min150.598-150.599=-0.001
max1295.318-1295.315=0.003
mean90.250
σ8.500
min86.000
max103.000
mean1641.000-1635.000=6.000
σ0.000
min1641.000-1635.000=6.000
max1641.000-1635.000=6.000
mean0.527-0.516=0.012
σ0.550-0.539=0.010
min0.247-0.221=0.026
max1.352-1.324=0.028
policies=20
mean1506.266-1506.278=-0.012
σ0.237-0.240=-0.003
min1506.106-1506.125=-0.019
max1506.618-1506.636=-0.018
mean860.000
σ0.000
min860.000
max860.000
mean1641.000-1635.000=6.000
σ0.000
min1641.000-1635.000=6.000
max1641.000-1635.000=6.000
mean2.510-2.522=-0.012
σ0.024-0.010=0.014
min2.486-2.508=-0.022
max2.543-2.530=0.013
policies=200
mean15070.401-15070.290=0.111
σ0.119-0.105=0.014
min15070.304-15070.178=0.127
max15070.555-15070.413=0.142
mean8600.000
σ0.000
min8600.000
max8600.000
mean1641.000-1635.000=6.000
σ0.000
min1641.000-1635.000=6.000
max1641.000-1635.000=6.000
mean25.505-25.483=0.022
σ0.136-0.102=0.034
min25.371-25.351=0.020
max25.692-25.574=0.118