Compare commits

Home / Compare 18ff10d2 .. 305fd7c4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.031-54.056=-0.024
σ0.369-0.367=0.002
min53.891-53.919=-0.028
max55.080-55.098=-0.018
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.140-0.139=0.001
σ0.003-0.004=-0.001
min0.137-0.136=0.001
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.384-43.393=-0.010
σ0.006-0.005=0.001
min43.375-43.388=-0.013
max43.397-43.403=-0.006
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.122-0.120=0.001
σ0.003-0.005=-0.002
min0.119-0.113=0.006
max0.127-0.127=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.331-1006.981=-0.649
σ0.882-0.885=-0.003
min1005.836-1006.507=-0.671
max1009.981-1010.648=-0.667
mean1050.100-1049.350=0.750
σ306.907-319.930=-13.022
min584.000-574.000=10.000
max1648.000-1617.000=31.000
mean1.545-1.565=-0.020
σ0.076-0.099=-0.023
min1.381-1.469=-0.088
max1.651-1.867=-0.215

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.003=-0.000
min0.881-0.882=-0.000
max0.886-0.887=-0.001
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean0.422-0.421=0.001
σ0.135-0.146=-0.010
min0.343-0.339=0.004
max0.661-0.681=-0.019
name=error_case.art
mean2.333-2.339=-0.005
σ0.003
min2.332-2.337=-0.005
max2.337-2.342=-0.005
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean0.874-0.881=-0.007
σ0.092-0.091=0.001
min0.822-0.822=-0.001
max1.036-1.042=-0.005
name=heavy_item.art
mean1.521-1.524=-0.002
σ0.002
min1.520-1.522=-0.002
max1.524-1.526=-0.002
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean0.572-0.538=0.034
σ0.061-0.047=0.014
min0.509-0.500=0.010
max0.649-0.619=0.030
name=nested_use.art
mean2.355-2.361=-0.005
σ0.002
min2.355-2.360=-0.005
max2.358-2.364=-0.005
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean1.006-0.856=0.150
σ0.328-0.042=0.286
min0.820-0.823=-0.003
max1.589-0.928=0.661

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-964.835=-1.283
σ0.024-0.031=-0.007
min963.523-964.805=-1.282
max963.582-964.888=-1.306
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean0.821-0.828=-0.007
σ0.044-0.016=0.028
min0.745-0.805=-0.061
max0.852-0.852=0.001
name=cdr_enhanced_4k_loc.art
mean884.856-885.513=-0.657
σ0.005-0.005=0.000
min884.847-885.504=-0.657
max884.861-885.517=-0.657
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean0.713-0.698=0.015
σ0.039-0.040=-0.001
min0.653-0.661=-0.008
max0.741-0.742=-0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.716=-0.010
σ0.002-0.002=0.000
min7.705-7.715=-0.010
max7.713-7.720=-0.007
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean3.536-3.529=0.007
σ0.092-0.081=0.011
min3.380-3.402=-0.022
max3.782-3.864=-0.082
name=record_render_large_syntax_err.art
mean7.655-7.665=-0.010
σ0.002-0.002=-0.000
min7.654-7.664=-0.010
max7.658-7.670=-0.013
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean4.155-3.481=0.673
σ0.272-0.133=0.139
min3.405-3.249=0.155
max4.541-4.239=0.302
name=record_render_success.art
mean2.288-2.291=-0.003
σ0.002
min2.287-2.290=-0.003
max2.291-2.294=-0.003
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean0.747-0.738=0.009
σ0.018-0.019=-0.001
min0.711-0.698=0.013
max0.863-0.863=-0.001
name=record_render_syntax_err.art
mean2.163-2.166=-0.002
σ0.002
min2.163-2.165=-0.002
max2.166-2.169=-0.002
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean0.716-0.697=0.019
σ0.018-0.015=0.003
min0.685-0.672=0.013
max0.826-0.776=0.051

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.599-295.569=0.030
σ0.241-0.200=0.040
min295.462-295.416=0.046
max296.277-296.079=0.198
mean1903.000-1895.000=8.000
σ0.000
min1903.000-1895.000=8.000
max1903.000-1895.000=8.000
mean0.581-0.570=0.010
σ0.043-0.036=0.007
min0.533-0.496=0.037
max0.686-0.622=0.064

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.252-285.410=-0.158
σ0.038-0.034=0.005
min285.205-285.364=-0.160
max285.291-285.446=-0.155
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean0.391-0.391=0.000
σ0.011-0.011=-0.000
min0.380-0.382=-0.002
max0.406-0.406=0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.200-1295.797=-0.597
σ0.114-0.111=0.003
min1295.077-1295.677=-0.600
max1295.342-1295.934=-0.592
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean1.930-1.931=-0.001
σ0.105-0.114=-0.009
min1.798-1.794=0.003
max2.023-2.025=-0.002
iters=5
new-facts=6402
prior-facts=1
mean1538.075-1539.922=-1.847
σ4.010-6.902=-2.893
min1536.032-1536.602=-0.570
max1545.238-1552.263=-7.025
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean2.262-2.332=-0.070
σ0.204-0.275=-0.070
min2.006-2.028=-0.022
max2.508-2.693=-0.185
iters=5
new-facts=6402
prior-facts=6402
mean1857.110-1857.702=-0.592
σ0.054-0.051=0.003
min1857.053-1857.661=-0.608
max1857.183-1857.774=-0.590
mean1772.400-1760.800=11.600
σ127.688-131.134=-3.446
min1648.000-1617.000=31.000
max1903.000-1895.000=8.000
mean3.053-3.101=-0.047
σ0.305-0.348=-0.043
min2.838-2.888=-0.050
max3.578-3.719=-0.141

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.369-1.322=0.047
σ0.276-0.248=0.028
min1.102-1.103=-0.001
max1.823-1.699=0.124

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.609-445.740=-2.131
σ577.065-580.934=-3.869
min155.075-155.272=-0.197
max1309.206-1317.141=-7.935
mean96.250
σ8.500
min92.000
max109.000
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean0.548-0.548=-0.000
σ0.569-0.584=-0.015
min0.262-0.256=0.006
max1.402-1.424=-0.022
policies=20
mean1551.023-1552.966=-1.943
σ0.316-0.307=0.009
min1550.806-1552.757=-1.952
max1551.493-1553.423=-1.930
mean920.000
σ0.000
min920.000
max920.000
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean2.582-2.566=0.016
σ0.015-0.017=-0.002
min2.571-2.548=0.023
max2.605-2.586=0.019
policies=200
mean15518.566-15537.881=-19.315
σ0.087-0.098=-0.011
min15518.471-15537.743=-19.272
max15518.676-15537.957=-19.281
mean9200.000
σ0.000
min9200.000
max9200.000
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean26.382-26.147=0.235
σ0.167-0.275=-0.109
min26.255-25.844=0.412
max26.623-26.485=0.139