Compare commits

Home / Compare 2da0894f .. aadc620a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.914=0.000
σ0.368-0.367=0.000
min53.787-53.785=0.002
max54.961-54.959=0.002
mean416.600-413.000=3.600
σ0.516-0.000=0.516
min416.000-413.000=3.000
max417.000-413.000=4.000
mean0.138-0.137=0.001
σ0.003-0.004=-0.001
min0.134-0.132=0.002
max0.143-0.146=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.140-43.142=-0.002
σ0.006-0.006=-0.000
min43.131-43.130=0.000
max43.151-43.152=-0.002
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.119-0.121=-0.002
σ0.004-0.004=0.000
min0.114-0.114=-0.000
max0.126-0.128=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.792-991.811=-0.019
σ1.265-1.272=-0.007
min991.248-991.226=0.022
max997.117-997.168=-0.051
mean1065.150-1063.950=1.200
σ321.640-322.950=-1.309
min569.000-566.000=3.000
max1629.000-1636.000=-7.000
mean1.570-1.542=0.027
σ0.146-0.092=0.054
min1.428-1.417=0.010
max1.995-1.786=0.209

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.409-285.389=0.020
σ0.015-0.009=0.006
min285.383-285.377=0.006
max285.422-285.400=0.021
mean1629.000-1636.000=-7.000
σ0.000
min1629.000-1636.000=-7.000
max1629.000-1636.000=-7.000
mean0.380-0.382=-0.002
σ0.009-0.012=-0.003
min0.373-0.374=-0.002
max0.393-0.402=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1285.376-1285.373=0.003
σ0.136-0.133=0.003
min1285.307-1285.303=0.004
max1285.619-1285.610=0.009
mean1629.000-1636.000=-7.000
σ0.000
min1629.000-1636.000=-7.000
max1629.000-1636.000=-7.000
mean1.938-1.858=0.080
σ0.119-0.023=0.095
min1.832-1.842=-0.010
max2.123-1.899=0.224
iters=5
new-facts=6402
prior-facts=1
mean1807.728-1807.743=-0.015
σ6.961-6.958=0.003
min1804.381-1804.355=0.026
max1820.163-1820.178=-0.015
mean1629.000-1636.000=-7.000
σ0.000
min1629.000-1636.000=-7.000
max1629.000-1636.000=-7.000
mean4.198-4.290=-0.092
σ0.156-0.299=-0.143
min4.073-4.085=-0.011
max4.466-4.766=-0.300
iters=5
new-facts=6402
prior-facts=6402
mean2070.196-2070.194=0.001
σ0.008-0.015=-0.007
min2070.184-2070.176=0.008
max2070.205-2070.216=-0.011
mean1835.400-1850.600=-15.200
σ181.182-208.260=-27.078
min1629.000-1636.000=-7.000
max2073.000-2088.000=-15.000
mean4.491-4.560=-0.069
σ0.025-0.281=-0.255
min4.475-4.408=0.068
max4.536-5.062=-0.525

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.165-1.192=-0.027
σ0.248-0.233=0.015
min0.902-0.908=-0.006
max1.502-1.523=-0.022

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.785-436.785=0.000
σ572.366-572.363=0.002
min150.596-150.599=-0.003
max1295.333-1295.329=0.004
mean90.250
σ8.500
min86.000
max103.000
mean1629.000-1636.000=-7.000
σ0.000
min1629.000-1636.000=-7.000
max1629.000-1636.000=-7.000
mean0.519-0.521=-0.002
σ0.537-0.538=-0.000
min0.248-0.248=-0.001
max1.325-1.328=-0.003
policies=20
mean1506.256-1506.269=-0.013
σ0.221-0.235=-0.014
min1506.109-1506.115=-0.006
max1506.585-1506.619=-0.034
mean860.000
σ0.000
min860.000
max860.000
mean1629.000-1636.000=-7.000
σ0.000
min1629.000-1636.000=-7.000
max1629.000-1636.000=-7.000
mean2.497-2.516=-0.019
σ0.007-0.003=0.004
min2.489-2.513=-0.024
max2.507-2.520=-0.014
policies=200
mean15070.287-15070.360=-0.074
σ0.082-0.047=0.035
min15070.177-15070.304=-0.126
max15070.364-15070.419=-0.054
mean8600.000
σ0.000
min8600.000
max8600.000
mean1629.000-1636.000=-7.000
σ0.000
min1629.000-1636.000=-7.000
max1629.000-1636.000=-7.000
mean25.383-25.520=-0.138
σ0.066-0.087=-0.021
min25.328-25.449=-0.120
max25.469-25.639=-0.170