Compare commits

Home / Compare 3f6fa461 .. 16f7873d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.705-54.047=-0.342
σ0.367-0.370=-0.003
min53.563-53.903=-0.341
max54.749-55.098=-0.349
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.141-0.139=0.003
σ0.010-0.004=0.006
min0.132-0.133=-0.001
max0.160-0.145=0.016
cache=y
dps=1
iters=10
policies=100
mean43.057-43.383=-0.326
σ0.006-0.006=-0.000
min43.049-43.371=-0.322
max43.068-43.395=-0.328
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.118-0.121=-0.002
σ0.004-0.005=-0.000
min0.114-0.115=-0.001
max0.125-0.129=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.284-1007.157=-1.874
σ0.887-0.876=0.011
min1004.816-1006.659=-1.843
max1008.959-1010.789=-1.830
mean1054.400-1050.450=3.950
σ321.209-308.082=13.127
min553.000-574.000=-21.000
max1634.000-1650.000=-16.000
mean1.627-1.523=0.104
σ0.083-0.049=0.034
min1.500-1.460=0.040
max1.812-1.628=0.184

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.003=-0.000
min0.881-0.882=-0.000
max0.886-0.887=-0.001
mean1634.000-1650.000=-16.000
σ0.000
min1634.000-1650.000=-16.000
max1634.000-1650.000=-16.000
mean0.426-0.413=0.013
σ0.146-0.139=0.007
min0.325-0.331=-0.006
max0.684-0.660=0.024
name=error_case.art
mean2.333-2.339=-0.005
σ0.003
min2.332-2.337=-0.005
max2.337-2.342=-0.005
mean1634.000-1650.000=-16.000
σ0.000
min1634.000-1650.000=-16.000
max1634.000-1650.000=-16.000
mean0.871-0.894=-0.023
σ0.087-0.083=0.004
min0.799-0.841=-0.042
max1.020-1.039=-0.019
name=heavy_item.art
mean1.521-1.524=-0.002
σ0.002
min1.520-1.522=-0.002
max1.524-1.526=-0.002
mean1634.000-1650.000=-16.000
σ0.000
min1634.000-1650.000=-16.000
max1634.000-1650.000=-16.000
mean0.546-0.539=0.008
σ0.051-0.056=-0.005
min0.505-0.489=0.016
max0.630-0.631=-0.000
name=nested_use.art
mean2.355-2.361=-0.005
σ0.002
min2.355-2.360=-0.005
max2.358-2.364=-0.005
mean1634.000-1650.000=-16.000
σ0.000
min1634.000-1650.000=-16.000
max1634.000-1650.000=-16.000
mean0.846-0.852=-0.006
σ0.048-0.045=0.003
min0.807-0.816=-0.008
max0.927-0.928=-0.001

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-964.832=-1.280
σ0.024-0.023=0.001
min963.523-964.816=-1.293
max963.583-964.869=-1.285
mean1634.000-1650.000=-16.000
σ0.000
min1634.000-1650.000=-16.000
max1634.000-1650.000=-16.000
mean0.831-0.833=-0.002
σ0.049-0.022=0.027
min0.754-0.813=-0.059
max0.869-0.860=0.009
name=cdr_enhanced_4k_loc.art
mean884.856-885.511=-0.655
σ0.008-0.009=-0.001
min884.847-885.504=-0.657
max884.865-885.523=-0.658
mean1634.000-1650.000=-16.000
σ0.000
min1634.000-1650.000=-16.000
max1634.000-1650.000=-16.000
mean0.744-0.727=0.017
σ0.004-0.016=-0.012
min0.739-0.713=0.026
max0.748-0.755=-0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.716=-0.010
σ0.002-0.002=0.000
min7.705-7.715=-0.010
max7.712-7.719=-0.007
mean1634.000-1650.000=-16.000
σ0.000
min1634.000-1650.000=-16.000
max1634.000-1650.000=-16.000
mean3.520-4.287=-0.767
σ0.079-0.092=-0.013
min3.392-4.143=-0.751
max3.799-4.696=-0.897
name=record_render_large_syntax_err.art
mean7.655-7.665=-0.010
σ0.002
min7.654-7.664=-0.010
max7.658-7.668=-0.010
mean1634.000-1650.000=-16.000
σ0.000
min1634.000-1650.000=-16.000
max1634.000-1650.000=-16.000
mean3.499-4.267=-0.768
σ0.065-0.079=-0.014
min3.372-4.152=-0.780
max3.748-4.539=-0.790
name=record_render_success.art
mean2.288-2.291=-0.003
σ0.002
min2.287-2.290=-0.003
max2.291-2.294=-0.003
mean1634.000-1650.000=-16.000
σ0.000
min1634.000-1650.000=-16.000
max1634.000-1650.000=-16.000
mean0.746-0.743=0.003
σ0.017-0.019=-0.002
min0.718-0.714=0.004
max0.843-0.875=-0.032
name=record_render_syntax_err.art
mean2.163-2.166=-0.002
σ0.002
min2.163-2.165=-0.002
max2.166-2.169=-0.002
mean1634.000-1650.000=-16.000
σ0.000
min1634.000-1650.000=-16.000
max1634.000-1650.000=-16.000
mean0.699-0.572=0.127
σ0.014-0.094=-0.079
min0.670-0.485=0.185
max0.787-0.809=-0.021

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.327-295.590=-1.264
σ0.273-0.273=-0.001
min294.112-295.414=-1.302
max295.059-296.338=-1.279
mean1915.000-1902.000=13.000
σ0.000
min1915.000-1902.000=13.000
max1915.000-1902.000=13.000
mean0.581-0.582=-0.000
σ0.018-0.021=-0.004
min0.539-0.537=0.001
max0.604-0.608=-0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean283.476-287.385=-3.909
σ0.037-0.036=0.001
min283.430-287.343=-3.913
max283.514-287.422=-3.908
mean1634.000-1650.000=-16.000
σ0.000
min1634.000-1650.000=-16.000
max1634.000-1650.000=-16.000
mean0.389-0.393=-0.004
σ0.007-0.007=0.001
min0.386-0.387=-0.001
max0.402-0.404=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1293.464-1297.769=-4.305
σ0.112-0.104=0.008
min1293.344-1297.650=-4.306
max1293.600-1297.897=-4.297
mean1634.000-1650.000=-16.000
σ0.000
min1634.000-1650.000=-16.000
max1634.000-1650.000=-16.000
mean1.891-1.889=0.001
σ0.082-0.068=0.013
min1.803-1.830=-0.027
max1.975-1.997=-0.022
iters=5
new-facts=6402
prior-facts=1
mean1536.321-1541.911=-5.590
σ4.075-6.876=-2.801
min1534.278-1538.641=-4.363
max1543.601-1554.208=-10.607
mean1634.000-1650.000=-16.000
σ0.000
min1634.000-1650.000=-16.000
max1634.000-1650.000=-16.000
mean2.356-2.163=0.193
σ0.355-0.129=0.226
min2.034-2.054=-0.020
max2.925-2.374=0.551
iters=5
new-facts=6402
prior-facts=6402
mean1855.347-1859.683=-4.336
σ0.066-0.052=0.014
min1855.275-1859.633=-4.357
max1855.421-1859.759=-4.337
mean1776.200-1772.600=3.600
σ135.491-123.733=11.758
min1634.000-1650.000=-16.000
max1915.000-1902.000=13.000
mean3.259-3.091=0.168
σ0.449-0.313=0.136
min2.866-2.862=0.004
max3.751-3.639=0.112

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.371-1.478=-0.107
σ0.326-0.229=0.097
min1.106-1.261=-0.155
max1.896-1.839=0.058

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.784-446.094=-3.311
σ577.064-580.932=-3.868
min154.250-155.628=-1.378
max1308.380-1317.493=-9.112
mean96.250
σ8.500
min92.000
max109.000
mean1634.000-1650.000=-16.000
σ0.000
min1634.000-1650.000=-16.000
max1634.000-1650.000=-16.000
mean0.522-0.547=-0.025
σ0.520-0.568=-0.048
min0.258-0.258=-0.000
max1.302-1.399=-0.097
policies=20
mean1542.814-1556.540=-13.727
σ0.353-0.333=0.020
min1542.573-1556.306=-13.733
max1543.339-1557.034=-13.695
mean920.000
σ0.000
min920.000
max920.000
mean1634.000-1650.000=-16.000
σ0.000
min1634.000-1650.000=-16.000
max1634.000-1650.000=-16.000
mean2.618-2.593=0.026
σ0.053-0.019=0.034
min2.566-2.569=-0.002
max2.685-2.616=0.069
policies=200
mean15436.115-15573.673=-137.558
σ0.111-0.148=-0.037
min15436.007-15573.515=-137.507
max15436.261-15573.842=-137.581
mean9200.000
σ0.000
min9200.000
max9200.000
mean1634.000-1650.000=-16.000
σ0.000
min1634.000-1650.000=-16.000
max1634.000-1650.000=-16.000
mean26.054-26.131=-0.077
σ0.052-0.100=-0.048
min25.986-25.987=-0.001
max26.111-26.218=-0.107