Compare commits

Home / Compare c4182ed3 .. c88749b0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.655-53.655=-0.000
σ0.368-0.368=-0.001
min53.512-53.517=-0.005
max54.701-54.703=-0.002
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.139-0.135=0.004
σ0.003-0.004=-0.001
min0.136-0.129=0.008
max0.145-0.140=0.005
cache=y
dps=1
iters=10
policies=100
mean42.983-42.981=0.002
σ0.005-0.008=-0.003
min42.977-42.971=0.006
max42.990-42.997=-0.007
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.128-0.121=0.007
σ0.009-0.003=0.006
min0.118-0.118=-0.000
max0.140-0.127=0.012

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.970-1013.699=0.271
σ1.178-1.222=-0.044
min1013.418-1013.158=0.260
max1018.901-1018.815=0.086
mean1049.750-1062.100=-12.350
σ294.462-316.819=-22.357
min605.000-596.000=9.000
max1438.000-1654.000=-216.000
mean1.609-1.638=-0.029
σ0.057-0.087=-0.031
min1.496-1.506=-0.010
max1.710-1.862=-0.152

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.224-334.322=-35.098
σ0.238-0.233=0.005
min299.092-334.102=-35.010
max299.894-334.948=-35.054
mean1970.000-2124.000=-154.000
σ0.000
min1970.000-2124.000=-154.000
max1970.000-2124.000=-154.000
mean0.575-0.744=-0.169
σ0.022-0.036=-0.014
min0.541-0.717=-0.176
max0.600-0.837=-0.237

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.677-294.414=0.263
σ0.016-0.022=-0.006
min294.655-294.388=0.267
max294.700-294.446=0.254
mean1438.000-1654.000=-216.000
σ0.000
min1438.000-1654.000=-216.000
max1438.000-1654.000=-216.000
mean0.390-0.386=0.004
σ0.011-0.010=0.001
min0.380-0.378=0.002
max0.407-0.397=0.010
iters=5
new-facts=1
prior-facts=6402
mean1316.937-1316.713=0.224
σ0.101-0.068=0.033
min1316.887-1316.602=0.285
max1317.118-1316.784=0.334
mean1438.000-1654.000=-216.000
σ0.000
min1438.000-1654.000=-216.000
max1438.000-1654.000=-216.000
mean1.902-1.893=0.010
σ0.079-0.048=0.031
min1.837-1.837=-0.001
max1.994-1.968=0.026
iters=5
new-facts=6402
prior-facts=1
mean1555.281-1736.949=-181.668
σ6.870-6.901=-0.031
min1551.949-1733.675=-181.727
max1567.565-1749.288=-181.723
mean1438.000-1654.000=-216.000
σ0.000
min1438.000-1654.000=-216.000
max1438.000-1654.000=-216.000
mean2.226-3.123=-0.898
σ0.215-0.372=-0.157
min2.113-2.605=-0.492
max2.610-3.519=-0.909
iters=5
new-facts=6402
prior-facts=6402
mean1884.778-1999.634=-114.856
σ0.028-0.029=-0.002
min1884.752-1999.602=-114.849
max1884.823-1999.674=-114.850
mean1724.400-1845.800=-121.400
σ166.093-198.409=-32.316
min1536.000-1654.000=-118.000
max1970.000-2124.000=-154.000
mean2.952-3.251=-0.300
σ0.073-0.070=0.003
min2.874-3.171=-0.297
max3.053-3.357=-0.304

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.686-1.180=0.506
σ0.169-0.322=-0.153
min1.410-0.909=0.500
max1.856-1.717=0.139

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.554-441.090=-0.536
σ573.019-573.037=-0.018
min154.037-154.569=-0.532
max1300.082-1300.646=-0.564
mean96.250-94.250=2.000
σ8.500
min92.000-90.000=2.000
max109.000-107.000=2.000
mean1438.000-1654.000=-216.000
σ0.000
min1438.000-1654.000=-216.000
max1438.000-1654.000=-216.000
mean0.535-0.552=-0.017
σ0.532-0.577=-0.045
min0.264-0.263=0.001
max1.333-1.417=-0.084
policies=20
mean1540.673-1545.928=-5.255
σ0.327-0.328=-0.001
min1540.453-1545.736=-5.283
max1541.159-1546.419=-5.259
mean920.000-900.000=20.000
σ0.000
min920.000-900.000=20.000
max920.000-900.000=20.000
mean1438.000-1654.000=-216.000
σ0.000
min1438.000-1654.000=-216.000
max1438.000-1654.000=-216.000
mean2.594-2.626=-0.031
σ0.014-0.015=-0.000
min2.577-2.604=-0.026
max2.612-2.634=-0.022
policies=200
mean15414.865-15467.120=-52.254
σ0.070-0.059=0.012
min15414.798-15467.065=-52.267
max15414.955-15467.195=-52.240
mean9200.000-9000.000=200.000
σ0.000
min9200.000-9000.000=200.000
max9200.000-9000.000=200.000
mean1438.000-1654.000=-216.000
σ0.000
min1438.000-1654.000=-216.000
max1438.000-1654.000=-216.000
mean26.243-26.665=-0.422
σ0.122-0.131=-0.009
min26.112-26.487=-0.376
max26.405-26.802=-0.397