Compare commits

Home / Compare b4fe94c3 .. 863475e3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.055=-0.000
σ0.370-0.368=0.002
min53.908-53.910=-0.001
max55.106-55.102=0.005
mean421.000-415.000=6.000
σ0.000
min421.000-415.000=6.000
max421.000-415.000=6.000
mean0.138-0.137=0.001
σ0.006-0.004=0.001
min0.130-0.131=-0.001
max0.147-0.144=0.004
cache=y
dps=1
iters=10
policies=100
mean43.395-43.395=-0.000
σ0.005-0.007=-0.001
min43.388-43.386=0.002
max43.402-43.405=-0.003
mean421.000-415.000=6.000
σ0.000
min421.000-415.000=6.000
max421.000-415.000=6.000
mean0.123-0.122=0.001
σ0.004-0.004=-0.000
min0.119-0.119=0.000
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.986-1006.959=0.027
σ0.852-0.876=-0.024
min1006.478-1006.493=-0.014
max1010.490-1010.586=-0.096
mean1050.900-1053.900=-3.000
σ314.232-316.477=-2.245
min581.000-547.000=34.000
max1649.000-1634.000=15.000
mean1.543-1.533=0.010
σ0.093-0.082=0.011
min1.466-1.452=0.013
max1.832-1.799=0.033

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.882
max0.887
mean1649.000-1634.000=15.000
σ0.000
min1649.000-1634.000=15.000
max1649.000-1634.000=15.000
mean0.422-0.421=0.001
σ0.116-0.128=-0.012
min0.350-0.351=-0.000
max0.629-0.649=-0.020
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1649.000-1634.000=15.000
σ0.000
min1649.000-1634.000=15.000
max1649.000-1634.000=15.000
mean0.889-0.894=-0.005
σ0.078-0.098=-0.020
min0.835-0.822=0.013
max1.024-1.065=-0.041
name=heavy_item.art
mean1.523
σ0.001
min1.522
max1.525
mean1649.000-1634.000=15.000
σ0.000
min1649.000-1634.000=15.000
max1649.000-1634.000=15.000
mean0.534-0.538=-0.005
σ0.048-0.053=-0.005
min0.494-0.499=-0.005
max0.609-0.626=-0.017
name=nested_use.art
mean2.362
σ0.002
min2.360
max2.364
mean1649.000-1634.000=15.000
σ0.000
min1649.000-1634.000=15.000
max1649.000-1634.000=15.000
mean0.844-0.856=-0.012
σ0.038-0.036=0.002
min0.811-0.831=-0.020
max0.908-0.919=-0.011

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.839=-0.009
σ0.025-0.021=0.003
min964.802-964.814=-0.012
max964.861-964.871=-0.009
mean1649.000-1634.000=15.000
σ0.000
min1649.000-1634.000=15.000
max1649.000-1634.000=15.000
mean0.814-0.839=-0.026
σ0.017-0.023=-0.006
min0.784-0.799=-0.015
max0.828-0.859=-0.031
name=cdr_enhanced_4k_loc.art
mean885.514-885.513=0.002
σ0.004-0.008=-0.003
min885.508-885.505=0.002
max885.518-885.523=-0.005
mean1649.000-1634.000=15.000
σ0.000
min1649.000-1634.000=15.000
max1649.000-1634.000=15.000
mean0.706-0.737=-0.031
σ0.028-0.004=0.024
min0.674-0.732=-0.057
max0.745-0.742=0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.722=-0.001
mean1649.000-1634.000=15.000
σ0.000
min1649.000-1634.000=15.000
max1649.000-1634.000=15.000
mean4.249-4.258=-0.009
σ0.089-0.131=-0.041
min4.092-4.122=-0.031
max4.564-5.141=-0.577
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1649.000-1634.000=15.000
σ0.000
min1649.000-1634.000=15.000
max1649.000-1634.000=15.000
mean4.232-4.266=-0.034
σ0.081-0.079=0.002
min4.074-4.130=-0.057
max4.507-4.574=-0.067
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1649.000-1634.000=15.000
σ0.000
min1649.000-1634.000=15.000
max1649.000-1634.000=15.000
mean0.749-0.746=0.002
σ0.019-0.025=-0.006
min0.716-0.563=0.153
max0.860-0.864=-0.004
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1649.000-1634.000=15.000
σ0.000
min1649.000-1634.000=15.000
max1649.000-1634.000=15.000
mean0.701-0.710=-0.009
σ0.016-0.028=-0.012
min0.673-0.562=0.111
max0.777-0.808=-0.032

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.463-295.376=0.086
σ0.230-0.251=-0.020
min295.254-295.208=0.046
max296.025-296.071=-0.046
mean1929.000-1897.000=32.000
σ0.000
min1929.000-1897.000=32.000
max1929.000-1897.000=32.000
mean0.579-0.552=0.027
σ0.058-0.042=0.016
min0.473-0.506=-0.033
max0.687-0.620=0.067

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.412-285.396=0.016
σ0.036-0.033=0.003
min285.366-285.353=0.013
max285.456-285.429=0.027
mean1649.000-1634.000=15.000
σ0.000
min1649.000-1634.000=15.000
max1649.000-1634.000=15.000
mean0.399-0.388=0.011
σ0.008-0.006=0.002
min0.391-0.383=0.007
max0.410-0.395=0.015
iters=5
new-facts=1
prior-facts=6402
mean1295.794-1295.777=0.017
σ0.112-0.107=0.005
min1295.669-1295.661=0.008
max1295.925-1295.910=0.015
mean1649.000-1634.000=15.000
σ0.000
min1649.000-1634.000=15.000
max1649.000-1634.000=15.000
mean1.886-1.921=-0.035
σ0.074-0.087=-0.014
min1.823-1.822=0.001
max1.984-2.010=-0.026
iters=5
new-facts=6402
prior-facts=1
mean1539.997-1539.985=0.011
σ6.876-6.806=0.070
min1536.723-1536.768=-0.045
max1552.291-1552.157=0.134
mean1649.000-1634.000=15.000
σ0.000
min1649.000-1634.000=15.000
max1649.000-1634.000=15.000
mean2.450-2.441=0.009
σ0.298-0.287=0.011
min2.149-2.116=0.033
max2.827-2.830=-0.003
iters=5
new-facts=6402
prior-facts=6402
mean1857.702-1857.693=0.009
σ0.058-0.054=0.004
min1857.632-1857.642=-0.010
max1857.772-1857.771=0.001
mean1782.800-1765.400=17.400
σ140.685-126.859=13.825
min1649.000-1634.000=15.000
max1929.000-1897.000=32.000
mean3.038-3.115=-0.077
σ0.143-0.368=-0.225
min2.864-2.865=-0.001
max3.190-3.762=-0.572

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.385-1.182=0.204
σ0.277-0.237=0.040
min1.112-0.944=0.168
max1.844-1.559=0.285

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.707=0.034
σ580.934-580.934=0.000
min155.273-155.239=0.034
max1317.143-1317.108=0.034
mean96.250
σ8.500
min92.000
max109.000
mean1649.000-1634.000=15.000
σ0.000
min1649.000-1634.000=15.000
max1649.000-1634.000=15.000
mean0.525-0.541=-0.016
σ0.539-0.561=-0.022
min0.255-0.260=-0.005
max1.334-1.383=-0.049
policies=20
mean1552.993-1552.662=0.331
σ0.330-0.335=-0.005
min1552.768-1552.434=0.334
max1553.484-1553.160=0.324
mean920.000
σ0.000
min920.000
max920.000
mean1649.000-1634.000=15.000
σ0.000
min1649.000-1634.000=15.000
max1649.000-1634.000=15.000
mean2.594-2.601=-0.007
σ0.016-0.033=-0.017
min2.581-2.571=0.009
max2.616-2.647=-0.031
policies=200
mean15538.054-15534.707=3.346
σ0.091-0.052=0.039
min15537.951-15534.647=3.303
max15538.150-15534.773=3.377
mean9200.000
σ0.000
min9200.000
max9200.000
mean1649.000-1634.000=15.000
σ0.000
min1649.000-1634.000=15.000
max1649.000-1634.000=15.000
mean26.165-26.217=-0.052
σ0.121-0.179=-0.058
min26.052-26.108=-0.056
max26.336-26.483=-0.147