Compare commits

Home / Compare 6ad82991 .. fc507bb2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.837-53.838=-0.001
σ0.368-0.367=0.001
min53.693-53.694=-0.001
max54.885-54.883=0.002
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.138-0.138=-0.000
σ0.005-0.004=0.001
min0.132-0.133=-0.001
max0.146-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean43.208-43.208=0.000
σ0.007-0.007=-0.001
min43.200-43.197=0.003
max43.224-43.223=0.001
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.121-0.121=0.000
σ0.004-0.004=0.000
min0.114-0.115=-0.001
max0.128-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.207-1016.206=0.001
σ1.161-1.175=-0.014
min1015.632-1015.632=0.000
max1021.067-1021.131=-0.064
mean1056.800-1050.150=6.650
σ313.848-311.443=2.405
min588.000-558.000=30.000
max1629.000-1514.000=115.000
mean1.527-1.518=0.010
σ0.071-0.070=0.002
min1.459-1.367=0.092
max1.702-1.660=0.042

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.230-301.309=-0.079
σ0.244-0.270=-0.026
min301.017-301.126=-0.109
max301.856-302.051=-0.195
mean1946.000-2022.000=-76.000
σ0.000
min1946.000-2022.000=-76.000
max1946.000-2022.000=-76.000
mean0.552-0.585=-0.033
σ0.028-0.009=0.019
min0.509-0.574=-0.065
max0.579-0.600=-0.020

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.482-301.483=-0.001
σ0.047-0.045=0.002
min301.414-301.417=-0.003
max301.536-301.536=0.000
mean1629.000-1514.000=115.000
σ0.000
min1629.000-1514.000=115.000
max1629.000-1514.000=115.000
mean0.398-0.394=0.004
σ0.010-0.005=0.005
min0.389-0.390=-0.001
max0.412-0.403=0.010
iters=5
new-facts=1
prior-facts=6402
mean1324.054-1324.058=-0.005
σ0.112-0.111=0.001
min1323.922-1323.924=-0.002
max1324.207-1324.203=0.004
mean1629.000-1514.000=115.000
σ0.000
min1629.000-1514.000=115.000
max1629.000-1514.000=115.000
mean1.893-1.930=-0.036
σ0.062-0.108=-0.046
min1.829-1.822=0.007
max1.990-2.067=-0.077
iters=5
new-facts=6402
prior-facts=1
mean1562.093-1562.069=0.024
σ6.895-6.898=-0.002
min1558.742-1558.770=-0.028
max1574.421-1574.402=0.019
mean1629.000-1514.000=115.000
σ0.000
min1629.000-1514.000=115.000
max1629.000-1514.000=115.000
mean2.341-2.242=0.099
σ0.254-0.147=0.107
min2.124-2.116=0.008
max2.631-2.484=0.147
iters=5
new-facts=6402
prior-facts=6402
mean1891.981-1891.950=0.031
σ0.070-0.070=0.001
min1891.858-1891.855=0.003
max1892.025-1892.009=0.016
mean1777.400-1725.200=52.200
σ114.220-204.908=-90.687
min1629.000-1514.000=115.000
max1946.000-2022.000=-76.000
mean2.978-2.974=0.004
σ0.133-0.231=-0.098
min2.844-2.739=0.105
max3.173-3.344=-0.171

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.155-1.557=-0.402
σ0.295-0.290=0.005
min0.886-1.224=-0.338
max1.531-1.788=-0.257

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.941-443.932=0.009
σ575.153-575.136=0.017
min156.362-156.362=0.000
max1306.670-1306.636=0.034
mean96.250
σ8.500
min92.000
max109.000
mean1629.000-1514.000=115.000
σ0.000
min1629.000-1514.000=115.000
max1629.000-1514.000=115.000
mean0.538-0.531=0.007
σ0.552-0.536=0.016
min0.260-0.263=-0.003
max1.367-1.336=0.031
policies=20
mean1563.922-1563.900=0.022
σ0.325-0.339=-0.014
min1563.744-1563.674=0.070
max1564.410-1564.404=0.005
mean920.000
σ0.000
min920.000
max920.000
mean1629.000-1514.000=115.000
σ0.000
min1629.000-1514.000=115.000
max1629.000-1514.000=115.000
mean2.611-2.607=0.005
σ0.014-0.015=-0.000
min2.594-2.587=0.007
max2.629-2.622=0.007
policies=200
mean15646.997-15646.964=0.033
σ0.057-0.067=-0.010
min15646.929-15646.887=0.042
max15647.051-15647.047=0.004
mean9200.000
σ0.000
min9200.000
max9200.000
mean1629.000-1514.000=115.000
σ0.000
min1629.000-1514.000=115.000
max1629.000-1514.000=115.000
mean26.364-26.368=-0.003
σ0.212-0.108=0.104
min26.164-26.255=-0.091
max26.593-26.493=0.100