Compare commits

Home / Compare 7939d16f .. f1c8d908

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.049=0.008
σ0.367-0.368=-0.001
min53.917-53.903=0.014
max55.102-55.096=0.006
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.139-0.139=0.000
σ0.003-0.004=-0.000
min0.136-0.134=0.002
max0.144-0.145=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.395-43.343=0.053
σ0.006-0.006=0.000
min43.385-43.334=0.051
max43.404-43.351=0.053
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.123-0.120=0.002
σ0.004-0.004=0.001
min0.117-0.115=0.002
max0.130-0.126=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1017.197=-10.218
σ0.866-1.183=-0.317
min1006.505-1016.652=-10.147
max1010.558-1022.159=-11.601
mean1053.650-1053.300=0.350
σ319.689-303.706=15.983
min577.000-594.000=-17.000
max1621.000-1641.000=-20.000
mean1.542-1.558=-0.016
σ0.124-0.093=0.031
min1.454-1.473=-0.019
max2.044-1.792=0.252

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1621.000
σ0.000
min1621.000
max1621.000
mean0.409
σ0.098
min0.341
max0.581
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1621.000
σ0.000
min1621.000
max1621.000
mean0.886
σ0.092
min0.807
max1.044
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1621.000
σ0.000
min1621.000
max1621.000
mean0.536
σ0.057
min0.479
max0.625
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1621.000
σ0.000
min1621.000
max1621.000
mean0.841
σ0.043
min0.809
max0.914

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831
σ0.025
min964.803
max964.859
mean1621.000
σ0.000
min1621.000
max1621.000
mean0.814
σ0.051
min0.734
max0.859
name=cdr_enhanced_4k_loc.art
mean885.513
σ0.008
min885.504
max885.523
mean1621.000
σ0.000
min1621.000
max1621.000
mean0.734
σ0.022
min0.695
max0.749

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716
σ0.002
min7.715
max7.720
mean1621.000
σ0.000
min1621.000
max1621.000
mean4.240
σ0.087
min4.105
max4.522
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1621.000
σ0.000
min1621.000
max1621.000
mean4.215
σ0.085
min4.067
max4.495
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1621.000
σ0.000
min1621.000
max1621.000
mean0.742
σ0.016
min0.708
max0.844
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1621.000
σ0.000
min1621.000
max1621.000
mean0.704
σ0.013
min0.680
max0.773

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.515-302.006=-6.491
σ0.247-0.241=0.006
min295.327-301.798=-6.471
max296.137-302.623=-6.486
mean1941.000-2034.000=-93.000
σ0.000
min1941.000-2034.000=-93.000
max1941.000-2034.000=-93.000
mean0.587-0.596=-0.009
σ0.034-0.007=0.027
min0.541-0.588=-0.047
max0.657-0.605=0.051

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.404-303.788=-18.384
σ0.039-0.052=-0.013
min285.361-303.711=-18.350
max285.446-303.849=-18.403
mean1621.000-1641.000=-20.000
σ0.000
min1621.000-1641.000=-20.000
max1621.000-1641.000=-20.000
mean0.393-0.395=-0.002
σ0.005-0.009=-0.004
min0.384-0.387=-0.004
max0.397-0.408=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1295.793-1326.325=-30.532
σ0.104-0.099=0.006
min1295.673-1326.200=-30.527
max1295.932-1326.449=-30.517
mean1621.000-1641.000=-20.000
σ0.000
min1621.000-1641.000=-20.000
max1621.000-1641.000=-20.000
mean1.890-1.940=-0.050
σ0.084-0.140=-0.055
min1.795-1.777=0.018
max1.969-2.138=-0.168
iters=5
new-facts=6402
prior-facts=1
mean1539.941-1564.381=-24.440
σ6.859-6.889=-0.030
min1536.686-1561.094=-24.408
max1552.209-1576.700=-24.492
mean1621.000-1641.000=-20.000
σ0.000
min1621.000-1641.000=-20.000
max1621.000-1641.000=-20.000
mean2.132-2.264=-0.131
σ0.178-0.179=-0.001
min1.952-2.097=-0.145
max2.421-2.510=-0.089
iters=5
new-facts=6402
prior-facts=6402
mean1857.707-1894.266=-36.559
σ0.061-0.068=-0.007
min1857.645-1894.152=-36.507
max1857.779-1894.317=-36.538
mean1784.400-1774.600=9.800
σ154.343-165.904=-11.561
min1621.000-1641.000=-20.000
max1941.000-2034.000=-93.000
mean2.971-3.008=-0.037
σ0.075-0.154=-0.078
min2.882-2.899=-0.017
max3.074-3.255=-0.181

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.405-1.244=0.162
σ0.272-0.341=-0.069
min1.105-0.946=0.159
max1.769-1.814=-0.045

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-448.341=-2.601
σ580.934-581.797=-0.863
min155.270-157.435=-2.165
max1317.142-1321.036=-3.895
mean96.250
σ8.500
min92.000
max109.000
mean1621.000-1641.000=-20.000
σ0.000
min1621.000-1641.000=-20.000
max1621.000-1641.000=-20.000
mean0.538-0.546=-0.007
σ0.554-0.565=-0.011
min0.259-0.262=-0.003
max1.369-1.393=-0.024
policies=20
mean1552.991-1574.625=-21.634
σ0.330-0.334=-0.004
min1552.762-1574.423=-21.661
max1553.480-1575.125=-21.644
mean920.000
σ0.000
min920.000
max920.000
mean1621.000-1641.000=-20.000
σ0.000
min1621.000-1641.000=-20.000
max1621.000-1641.000=-20.000
mean2.593-2.624=-0.030
σ0.019-0.012=0.007
min2.574-2.615=-0.040
max2.615-2.640=-0.025
policies=200
mean15538.048-15754.415=-216.367
σ0.086-0.077=0.008
min15537.935-15754.326=-216.391
max15538.140-15754.506=-216.367
mean9200.000
σ0.000
min9200.000
max9200.000
mean1621.000-1641.000=-20.000
σ0.000
min1621.000-1641.000=-20.000
max1621.000-1641.000=-20.000
mean26.226-26.497=-0.271
σ0.234-0.129=0.104
min26.093-26.376=-0.283
max26.574-26.658=-0.084