Compare commits

Home / Compare 772f8c66 .. 1efbe90c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.056=0.000
σ0.370-0.369=0.001
min53.908-53.906=0.002
max55.109-55.106=0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.138-0.136=0.002
σ0.004-0.004=0.000
min0.134-0.131=0.003
max0.147-0.143=0.004
cache=y
dps=1
iters=10
policies=100
mean43.395-43.395=-0.000
σ0.006-0.006=0.000
min43.385-43.386=-0.001
max43.403-43.404=-0.001
mean415.100-415.000=0.100
σ0.316-0.000=0.316
min415.000
max416.000-415.000=1.000
mean0.122-0.120=0.002
σ0.004-0.005=-0.001
min0.118-0.114=0.004
max0.129-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.962-1006.922=0.040
σ0.904-0.885=0.019
min1006.487-1006.454=0.033
max1010.713-1010.590=0.123
mean1050.600-1036.900=13.700
σ310.102-301.076=9.026
min551.000-547.000=4.000
max1643.000-1584.000=59.000
mean1.561-1.524=0.037
σ0.119-0.074=0.045
min1.471-1.459=0.012
max1.841-1.747=0.095

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean0.425-0.416=0.009
σ0.141-0.132=0.009
min0.325-0.331=-0.006
max0.665-0.649=0.015
name=error_case.art
mean2.339-2.339=-0.000
σ0.003-0.002=0.000
min2.337
max2.342
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean0.879-0.875=0.004
σ0.109-0.089=0.020
min0.815-0.806=0.009
max1.073-1.031=0.042
name=heavy_item.art
mean1.524-1.524=-0.000
σ0.002-0.002=-0.001
min1.522
max1.526-1.527=-0.001
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean0.528-0.565=-0.037
σ0.049-0.048=0.001
min0.478-0.504=-0.025
max0.611-0.637=-0.026
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean0.838-0.872=-0.034
σ0.044-0.052=-0.008
min0.805-0.815=-0.010
max0.914-0.939=-0.025

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.833=0.007
σ0.034-0.029=0.005
min964.811-964.802=0.010
max964.896-964.872=0.024
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean0.848-0.840=0.008
σ0.028-0.018=0.010
min0.799-0.813=-0.014
max0.867-0.854=0.013
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.006-0.007=-0.001
min885.505-885.504=0.001
max885.518-885.521=-0.003
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean0.726-0.731=-0.004
σ0.023-0.017=0.006
min0.686-0.704=-0.018
max0.740-0.748=-0.008

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean4.244-4.217=0.027
σ0.087-0.090=-0.003
min4.116-4.075=0.041
max4.480-4.599=-0.119
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean4.257-4.245=0.012
σ0.080-0.084=-0.003
min4.124-4.103=0.021
max4.517-4.568=-0.051
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean0.744-0.754=-0.010
σ0.027-0.018=0.009
min0.607-0.728=-0.120
max0.855-0.873=-0.018
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean0.701-0.712=-0.011
σ0.023-0.016=0.007
min0.586-0.673=-0.087
max0.797-0.792=0.005

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.426-295.581=-0.155
σ0.268-0.201=0.067
min295.280-295.426=-0.146
max296.172-296.092=0.080
mean1913.000-1896.000=17.000
σ0.000
min1913.000-1896.000=17.000
max1913.000-1896.000=17.000
mean0.574-0.583=-0.008
σ0.033-0.057=-0.024
min0.535-0.498=0.037
max0.635-0.708=-0.072

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.394-285.357=0.036
σ0.038-0.037=0.001
min285.350-285.311=0.039
max285.434-285.397=0.038
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean0.390-0.395=-0.005
σ0.008-0.008=0.000
min0.380-0.383=-0.003
max0.397-0.404=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.782-1295.715=0.067
σ0.117-0.114=0.003
min1295.655-1295.620=0.035
max1295.926-1295.906=0.020
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean1.898-1.990=-0.092
σ0.075-0.181=-0.106
min1.809-1.805=0.004
max1.982-2.184=-0.203
iters=5
new-facts=6402
prior-facts=1
mean1539.897-1539.949=-0.053
σ6.868-6.834=0.034
min1536.643-1536.765=-0.122
max1552.178-1552.173=0.005
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean2.230-2.363=-0.132
σ0.195-0.256=-0.062
min2.035-2.114=-0.079
max2.472-2.744=-0.271
iters=5
new-facts=6402
prior-facts=6402
mean1857.684-1857.656=0.027
σ0.063-0.057=0.006
min1857.613-1857.598=0.015
max1857.770-1857.735=0.035
mean1772.400-1761.000=11.400
σ135.579-140.282=-4.702
min1643.000-1584.000=59.000
max1913.000-1896.000=17.000
mean3.130-3.034=0.097
σ0.373-0.261=0.111
min2.862-2.788=0.074
max3.785-3.461=0.325

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.238-1.357=-0.119
σ0.376-0.392=-0.016
min0.930-0.941=-0.011
max1.851-1.852=-0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.705-445.635=0.070
σ580.934-580.934=0.000
min155.236-155.166=0.069
max1317.106-1317.035=0.070
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean0.526-0.526=0.000
σ0.528-0.535=-0.006
min0.262-0.257=0.005
max1.319-1.328=-0.010
policies=20
mean1552.633-1551.939=0.694
σ0.333-0.337=-0.004
min1552.401-1551.707=0.693
max1553.128-1552.439=0.689
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean2.590-2.597=-0.007
σ0.016-0.034=-0.018
min2.571-2.573=-0.003
max2.609-2.648=-0.039
policies=200
mean15534.642-15527.602=7.040
σ0.134-0.094=0.040
min15534.555-15527.488=7.067
max15534.839-15527.697=7.142
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean26.082-26.098=-0.017
σ0.055-0.140=-0.085
min26.049-25.985=0.064
max26.163-26.277=-0.114