Compare commits

Home / Compare 9638b948 .. 487a87b4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.033-54.031=0.002
σ0.368-0.369=-0.001
min53.886-53.891=-0.005
max55.079-55.080=-0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.146-0.140=0.006
σ0.010-0.003=0.007
min0.137-0.137=0.000
max0.165-0.146=0.019
cache=y
dps=1
iters=10
policies=100
mean43.385-43.384=0.001
σ0.006-0.006=0.000
min43.371-43.375=-0.005
max43.393-43.397=-0.004
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.123-0.122=0.002
σ0.004-0.003=0.001
min0.120-0.119=0.001
max0.130-0.127=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.332-1006.331=0.000
σ0.894-0.882=0.012
min1005.834-1005.836=-0.002
max1010.044-1009.981=0.063
mean1046.850-1050.100=-3.250
σ309.963-306.907=3.056
min562.000-584.000=-22.000
max1638.000-1648.000=-10.000
mean1.555-1.545=0.010
σ0.098-0.076=0.022
min1.455-1.381=0.074
max1.836-1.651=0.185

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.001
σ0.003-0.002=0.000
min0.881
max0.887-0.886=0.002
mean1638.000-1648.000=-10.000
σ0.000
min1638.000-1648.000=-10.000
max1638.000-1648.000=-10.000
mean0.433-0.422=0.011
σ0.172-0.135=0.037
min0.333-0.343=-0.009
max0.739-0.661=0.077
name=error_case.art
mean2.334-2.333=0.000
σ0.002-0.003=-0.000
min2.332
max2.337
mean1638.000-1648.000=-10.000
σ0.000
min1638.000-1648.000=-10.000
max1638.000-1648.000=-10.000
mean0.930-0.874=0.056
σ0.181-0.092=0.089
min0.816-0.822=-0.006
max1.251-1.036=0.215
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1638.000-1648.000=-10.000
σ0.000
min1638.000-1648.000=-10.000
max1638.000-1648.000=-10.000
mean0.551-0.572=-0.021
σ0.048-0.061=-0.012
min0.507-0.509=-0.003
max0.631-0.649=-0.017
name=nested_use.art
mean2.356-2.355=0.001
σ0.002-0.002=0.000
min2.355
max2.360-2.358=0.001
mean1638.000-1648.000=-10.000
σ0.000
min1638.000-1648.000=-10.000
max1638.000-1648.000=-10.000
mean0.850-1.006=-0.156
σ0.034-0.328=-0.294
min0.821-0.820=0.001
max0.908-1.589=-0.681

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.553-963.552=0.001
σ0.025-0.024=0.001
min963.531-963.523=0.009
max963.591-963.582=0.009
mean1638.000-1648.000=-10.000
σ0.000
min1638.000-1648.000=-10.000
max1638.000-1648.000=-10.000
mean0.786-0.821=-0.035
σ0.028-0.044=-0.016
min0.762-0.745=0.017
max0.830-0.852=-0.022
name=cdr_enhanced_4k_loc.art
mean884.856-884.856=0.001
σ0.006-0.005=0.000
min884.847
max884.861-884.861=0.001
mean1638.000-1648.000=-10.000
σ0.000
min1638.000-1648.000=-10.000
max1638.000-1648.000=-10.000
mean0.727-0.713=0.014
σ0.033-0.039=-0.005
min0.668-0.653=0.014
max0.744-0.741=0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=-0.000
min7.705
max7.711-7.713=-0.003
mean1638.000-1648.000=-10.000
σ0.000
min1638.000-1648.000=-10.000
max1638.000-1648.000=-10.000
mean4.268-3.536=0.732
σ0.073-0.092=-0.020
min4.119-3.380=0.739
max4.540-3.782=0.759
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1638.000-1648.000=-10.000
σ0.000
min1638.000-1648.000=-10.000
max1638.000-1648.000=-10.000
mean4.223-4.155=0.068
σ0.061-0.272=-0.211
min4.119-3.405=0.715
max4.441-4.541=-0.100
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1638.000-1648.000=-10.000
σ0.000
min1638.000-1648.000=-10.000
max1638.000-1648.000=-10.000
mean0.754-0.747=0.006
σ0.022-0.018=0.004
min0.660-0.711=-0.051
max0.856-0.863=-0.007
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1638.000-1648.000=-10.000
σ0.000
min1638.000-1648.000=-10.000
max1638.000-1648.000=-10.000
mean0.711-0.716=-0.005
σ0.020-0.018=0.003
min0.573-0.685=-0.111
max0.799-0.826=-0.027

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.540-295.599=-0.059
σ0.224-0.241=-0.016
min295.352-295.462=-0.110
max296.132-296.277=-0.145
mean1924.000-1903.000=21.000
σ0.000
min1924.000-1903.000=21.000
max1924.000-1903.000=21.000
mean0.595-0.581=0.014
σ0.037-0.043=-0.006
min0.534-0.533=0.000
max0.680-0.686=-0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.244-285.252=-0.008
σ0.039-0.038=0.001
min285.195-285.205=-0.010
max285.285-285.291=-0.006
mean1638.000-1648.000=-10.000
σ0.000
min1638.000-1648.000=-10.000
max1638.000-1648.000=-10.000
mean0.395-0.391=0.004
σ0.009-0.011=-0.002
min0.382-0.380=0.002
max0.404-0.406=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.191-1295.200=-0.009
σ0.102-0.114=-0.012
min1295.071-1295.077=-0.005
max1295.310-1295.342=-0.031
mean1638.000-1648.000=-10.000
σ0.000
min1638.000-1648.000=-10.000
max1638.000-1648.000=-10.000
mean1.956-1.930=0.025
σ0.121-0.105=0.016
min1.821-1.798=0.024
max2.070-2.023=0.047
iters=5
new-facts=6402
prior-facts=1
mean1538.075-1538.075=-0.000
σ4.010-4.010=-0.000
min1536.064-1536.032=0.032
max1545.240-1545.238=0.001
mean1638.000-1648.000=-10.000
σ0.000
min1638.000-1648.000=-10.000
max1638.000-1648.000=-10.000
mean2.243-2.262=-0.019
σ0.204-0.204=-0.001
min2.034-2.006=0.027
max2.521-2.508=0.012
iters=5
new-facts=6402
prior-facts=6402
mean1857.109-1857.110=-0.001
σ0.059-0.054=0.006
min1857.052-1857.053=-0.001
max1857.189-1857.183=0.005
mean1775.800-1772.400=3.400
σ143.472-127.688=15.784
min1638.000-1648.000=-10.000
max1924.000-1903.000=21.000
mean2.933-3.053=-0.120
σ0.105-0.305=-0.199
min2.843-2.838=0.004
max3.092-3.578=-0.486

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.342-1.369=-0.027
σ0.307-0.276=0.030
min1.098-1.102=-0.004
max1.850-1.823=0.027

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.611-443.609=0.002
σ577.065-577.065=0.000
min155.077-155.075=0.002
max1309.208-1309.206=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1638.000-1648.000=-10.000
σ0.000
min1638.000-1648.000=-10.000
max1638.000-1648.000=-10.000
mean0.538-0.548=-0.010
σ0.558-0.569=-0.011
min0.255-0.262=-0.007
max1.375-1.402=-0.027
policies=20
mean1551.039-1551.023=0.016
σ0.325-0.316=0.008
min1550.816-1550.806=0.010
max1551.521-1551.493=0.029
mean920.000
σ0.000
min920.000
max920.000
mean1638.000-1648.000=-10.000
σ0.000
min1638.000-1648.000=-10.000
max1638.000-1648.000=-10.000
mean2.584-2.582=0.002
σ0.023-0.015=0.008
min2.556-2.571=-0.016
max2.604-2.605=-0.000
policies=200
mean15518.523-15518.566=-0.043
σ0.033-0.087=-0.053
min15518.490-15518.471=0.019
max15518.568-15518.676=-0.108
mean9200.000
σ0.000
min9200.000
max9200.000
mean1638.000-1648.000=-10.000
σ0.000
min1638.000-1648.000=-10.000
max1638.000-1648.000=-10.000
mean26.173-26.382=-0.209
σ0.112-0.167=-0.055
min26.032-26.255=-0.223
max26.289-26.623=-0.334