Compare commits

Home / Compare 00c43ba7 .. 0e71ea38

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.013=0.001
σ0.368-0.368=-0.000
min53.866-53.876=-0.009
max55.060-55.059=0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.138-0.136=0.002
σ0.004-0.005=-0.001
min0.135-0.129=0.006
max0.144-0.142=0.002
cache=y
dps=1
iters=10
policies=100
mean43.321-43.321=0.000
σ0.006-0.007=-0.000
min43.313-43.315=-0.001
max43.334-43.336=-0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.122-0.119=0.003
σ0.004-0.005=-0.000
min0.118-0.114=0.004
max0.130-0.126=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1006.305=0.004
σ1.182-1.184=-0.002
min1005.765-1005.743=0.022
max1011.267-1011.270=-0.003
mean1051.150-1050.000=1.150
σ303.691-305.535=-1.844
min586.000-592.000=-6.000
max1640.000-1644.000=-4.000
mean1.561-1.553=0.008
σ0.103-0.081=0.022
min1.471-1.478=-0.006
max1.820-1.824=-0.004

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1640.000-1644.000=-4.000
σ0.000
min1640.000-1644.000=-4.000
max1640.000-1644.000=-4.000
mean0.423-0.411=0.012
σ0.140-0.137=0.003
min0.330-0.332=-0.002
max0.670-0.654=0.017
name=error_case.art
mean2.337-2.338=-0.000
σ0.003-0.002=0.000
min2.336
max2.341
mean1640.000-1644.000=-4.000
σ0.000
min1640.000-1644.000=-4.000
max1640.000-1644.000=-4.000
mean0.916-0.896=0.020
σ0.102-0.090=0.013
min0.832-0.839=-0.007
max1.090-1.054=0.036
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1640.000-1644.000=-4.000
σ0.000
min1640.000-1644.000=-4.000
max1640.000-1644.000=-4.000
mean0.551-0.547=0.005
σ0.056-0.049=0.006
min0.493-0.500=-0.007
max0.625-0.626=-0.001
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1640.000-1644.000=-4.000
σ0.000
min1640.000-1644.000=-4.000
max1640.000-1644.000=-4.000
mean0.870-0.847=0.024
σ0.062-0.041=0.020
min0.827-0.815=0.012
max0.979-0.916=0.062

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113-964.115=-0.001
σ0.031-0.034=-0.003
min964.088-964.086=0.002
max964.164-964.171=-0.006
mean1640.000-1644.000=-4.000
σ0.000
min1640.000-1644.000=-4.000
max1640.000-1644.000=-4.000
mean0.811-0.828=-0.016
σ0.030-0.048=-0.018
min0.783-0.747=0.036
max0.858-0.867=-0.008
name=cdr_enhanced_4k_loc.art
mean884.711-884.711=-0.000
σ0.007-0.007=0.000
min884.705
max884.721-884.722=-0.001
mean1640.000-1644.000=-4.000
σ0.000
min1640.000-1644.000=-4.000
max1640.000-1644.000=-4.000
mean0.710-0.708=0.003
σ0.040-0.047=-0.007
min0.642-0.644=-0.002
max0.739-0.745=-0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.714=0.000
σ0.002-0.002=-0.000
min7.714
max7.718
mean1640.000-1644.000=-4.000
σ0.000
min1640.000-1644.000=-4.000
max1640.000-1644.000=-4.000
mean4.214-3.529=0.685
σ0.081-0.085=-0.004
min4.094-3.390=0.704
max4.663-3.832=0.831
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.669-7.668=0.001
mean1640.000-1644.000=-4.000
σ0.000
min1640.000-1644.000=-4.000
max1640.000-1644.000=-4.000
mean4.196-3.562=0.634
σ0.060-0.096=-0.035
min4.094-3.430=0.664
max4.476-3.993=0.483
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1640.000-1644.000=-4.000
σ0.000
min1640.000-1644.000=-4.000
max1640.000-1644.000=-4.000
mean0.753-0.480=0.273
σ0.044-0.105=-0.061
min0.714-0.285=0.429
max1.062-0.637=0.425
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1640.000-1644.000=-4.000
σ0.000
min1640.000-1644.000=-4.000
max1640.000-1644.000=-4.000
mean0.705-0.286=0.419
σ0.022-0.016=0.006
min0.671-0.272=0.399
max0.781-0.412=0.369

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.277-296.015=0.262
σ0.279-0.245=0.034
min295.980-295.839=0.141
max296.999-296.682=0.317
mean1902.000-1903.000=-1.000
σ0.000
min1902.000-1903.000=-1.000
max1902.000-1903.000=-1.000
mean0.568-0.568=0.000
σ0.043-0.056=-0.013
min0.512-0.499=0.012
max0.652-0.699=-0.048

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.704-284.693=0.011
σ0.027-0.031=-0.005
min284.677-284.650=0.028
max284.735-284.724=0.011
mean1640.000-1644.000=-4.000
σ0.000
min1640.000-1644.000=-4.000
max1640.000-1644.000=-4.000
mean0.392-0.398=-0.006
σ0.007-0.012=-0.005
min0.384-0.384=-0.000
max0.403-0.409=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1295.077-1295.079=-0.002
σ0.105-0.110=-0.005
min1294.960-1294.959=0.001
max1295.206-1295.211=-0.004
mean1640.000-1644.000=-4.000
σ0.000
min1640.000-1644.000=-4.000
max1640.000-1644.000=-4.000
mean1.917-1.920=-0.003
σ0.104-0.108=-0.004
min1.808-1.798=0.009
max2.037-2.034=0.003
iters=5
new-facts=6402
prior-facts=1
mean1539.184-1539.177=0.007
σ6.828-6.856=-0.028
min1535.950-1535.910=0.040
max1551.395-1551.437=-0.043
mean1640.000-1644.000=-4.000
σ0.000
min1640.000-1644.000=-4.000
max1640.000-1644.000=-4.000
mean2.213-2.251=-0.038
σ0.180-0.225=-0.045
min2.058-1.969=0.089
max2.489-2.447=0.042
iters=5
new-facts=6402
prior-facts=6402
mean1856.989-1856.986=0.004
σ0.059-0.055=0.004
min1856.932-1856.934=-0.003
max1857.076-1857.066=0.010
mean1773.200-1771.800=1.400
σ128.550-128.432=0.119
min1640.000-1644.000=-4.000
max1902.000-1903.000=-1.000
mean3.045-3.013=0.032
σ0.272-0.297=-0.026
min2.827-2.789=0.038
max3.502-3.512=-0.010

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.197-1.195=0.003
σ0.289-0.271=0.019
min0.927-0.943=-0.015
max1.672-1.625=0.047

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.784-447.785=-0.001
σ581.212-581.212=-0.000
min157.176-157.177=-0.001
max1319.602-1319.604=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1640.000-1644.000=-4.000
σ0.000
min1640.000-1644.000=-4.000
max1640.000-1644.000=-4.000
mean0.535-0.551=-0.016
σ0.553-0.580=-0.027
min0.257-0.260=-0.003
max1.364-1.421=-0.057
policies=20
mean1572.089-1572.093=-0.004
σ0.363-0.341=0.022
min1571.841-1571.859=-0.018
max1572.628-1572.599=0.029
mean920.000
σ0.000
min920.000
max920.000
mean1640.000-1644.000=-4.000
σ0.000
min1640.000-1644.000=-4.000
max1640.000-1644.000=-4.000
mean2.628-2.608=0.020
σ0.024-0.028=-0.004
min2.599-2.582=0.017
max2.658-2.647=0.010
policies=200
mean15729.009-15729.073=-0.064
σ0.167-0.093=0.074
min15728.823-15728.996=-0.173
max15729.208-15729.208=0.000
mean9200.000
σ0.000
min9200.000
max9200.000
mean1640.000-1644.000=-4.000
σ0.000
min1640.000-1644.000=-4.000
max1640.000-1644.000=-4.000
mean26.496-26.445=0.051
σ0.130-0.035=0.095
min26.402-26.401=0.002
max26.688-26.479=0.210