Compare commits

Home / Compare f69b544c .. cfeb474e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.057=-0.001
σ0.369-0.369=0.000
min53.913-53.911=0.002
max55.106-55.106=0.000
mean413.700-415.000=-1.300
σ0.483-0.000=0.483
min413.000-415.000=-2.000
max414.000-415.000=-1.000
mean0.137-0.139=-0.002
σ0.003-0.004=-0.001
min0.132-0.136=-0.004
max0.142-0.145=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.393-43.396=-0.003
σ0.007-0.005=0.002
min43.381-43.389=-0.008
max43.407-43.404=0.002
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.121-0.123=-0.001
σ0.004-0.003=0.001
min0.116-0.120=-0.005
max0.129-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.976-1006.979=-0.003
σ0.893-0.872=0.021
min1006.503-1006.482=0.021
max1010.685-1010.589=0.095
mean1041.050-1044.750=-3.700
σ305.498-314.240=-8.742
min574.000-575.000=-1.000
max1657.000-1639.000=18.000
mean1.556-1.540=0.016
σ0.099-0.070=0.029
min1.335-1.466=-0.131
max1.801-1.710=0.091

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.001
σ0.003-0.002=0.000
min0.882
max0.887
mean1657.000-1639.000=18.000
σ0.000
min1657.000-1639.000=18.000
max1657.000-1639.000=18.000
mean0.416-0.415=0.001
σ0.129-0.138=-0.009
min0.340-0.343=-0.003
max0.643-0.661=-0.017
name=error_case.art
mean2.339-2.339=-0.000
σ0.003-0.003=0.001
min2.337
max2.344-2.342=0.001
mean1657.000-1639.000=18.000
σ0.000
min1657.000-1639.000=18.000
max1657.000-1639.000=18.000
mean0.886-0.879=0.006
σ0.081-0.080=0.001
min0.819-0.839=-0.020
max1.026-1.023=0.003
name=heavy_item.art
mean1.525-1.523=0.002
σ0.001-0.001=-0.000
min1.524-1.522=0.001
max1.526-1.525=0.001
mean1657.000-1639.000=18.000
σ0.000
min1657.000-1639.000=18.000
max1657.000-1639.000=18.000
mean0.565-0.534=0.031
σ0.060-0.053=0.007
min0.507-0.493=0.014
max0.634-0.624=0.010
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.002=-0.000
min2.360
max2.364
mean1657.000-1639.000=18.000
σ0.000
min1657.000-1639.000=18.000
max1657.000-1639.000=18.000
mean0.855-0.844=0.011
σ0.049-0.044=0.005
min0.810-0.816=-0.006
max0.935-0.922=0.013

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.829-964.830=-0.001
σ0.025-0.025=-0.000
min964.802
max964.861-964.863=-0.001
mean1657.000-1639.000=18.000
σ0.000
min1657.000-1639.000=18.000
max1657.000-1639.000=18.000
mean0.811-0.828=-0.017
σ0.032-0.026=0.006
min0.767-0.805=-0.038
max0.857-0.861=-0.004
name=cdr_enhanced_4k_loc.art
mean885.513-885.513=-0.000
σ0.005-0.004=0.001
min885.505-885.508=-0.003
max885.518-885.518=-0.000
mean1657.000-1639.000=18.000
σ0.000
min1657.000-1639.000=18.000
max1657.000-1639.000=18.000
mean0.700-0.692=0.007
σ0.050-0.040=0.011
min0.621-0.635=-0.014
max0.737-0.737=-0.000

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1657.000-1639.000=18.000
σ0.000
min1657.000-1639.000=18.000
max1657.000-1639.000=18.000
mean4.239-3.512=0.728
σ0.112-0.088=0.024
min4.092-3.389=0.702
max4.873-3.836=1.037
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1657.000-1639.000=18.000
σ0.000
min1657.000-1639.000=18.000
max1657.000-1639.000=18.000
mean4.201-3.507=0.694
σ0.072-0.071=0.000
min4.066-3.375=0.691
max4.434-3.766=0.667
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1657.000-1639.000=18.000
σ0.000
min1657.000-1639.000=18.000
max1657.000-1639.000=18.000
mean0.692-0.530=0.161
σ0.086-0.015=0.071
min0.509-0.504=0.005
max0.844-0.625=0.219
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1657.000-1639.000=18.000
σ0.000
min1657.000-1639.000=18.000
max1657.000-1639.000=18.000
mean0.500-0.292=0.208
σ0.038-0.040=-0.002
min0.469-0.271=0.198
max0.851-0.565=0.286

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.642-295.611=0.031
σ0.190-0.225=-0.034
min295.433-295.466=-0.032
max296.105-296.208=-0.102
mean2025.000-1900.000=125.000
σ0.000
min2025.000-1900.000=125.000
max2025.000-1900.000=125.000
mean0.525-0.597=-0.072
σ0.035-0.022=0.012
min0.486-0.573=-0.088
max0.589-0.651=-0.062

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.409-285.418=-0.009
σ0.037-0.031=0.006
min285.362-285.377=-0.016
max285.450-285.452=-0.001
mean1657.000-1639.000=18.000
σ0.000
min1657.000-1639.000=18.000
max1657.000-1639.000=18.000
mean0.387-0.388=-0.001
σ0.010-0.007=0.003
min0.379-0.381=-0.001
max0.403-0.398=0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.794-1295.803=-0.009
σ0.100-0.121=-0.020
min1295.679-1295.681=-0.001
max1295.905-1295.969=-0.065
mean1657.000-1639.000=18.000
σ0.000
min1657.000-1639.000=18.000
max1657.000-1639.000=18.000
mean1.909-1.898=0.011
σ0.112-0.091=0.021
min1.800-1.793=0.008
max2.030-1.973=0.057
iters=5
new-facts=6402
prior-facts=1
mean1539.948-1539.916=0.031
σ6.852-6.867=-0.015
min1536.658-1536.584=0.073
max1552.198-1552.194=0.004
mean1657.000-1639.000=18.000
σ0.000
min1657.000-1639.000=18.000
max1657.000-1639.000=18.000
mean2.366-2.309=0.058
σ0.204-0.264=-0.061
min2.104-1.990=0.114
max2.607-2.643=-0.036
iters=5
new-facts=6402
prior-facts=6402
mean1857.706-1857.701=0.005
σ0.057-0.054=0.003
min1857.639-1857.649=-0.010
max1857.771-1857.775=-0.004
mean1788.400-1769.400=19.000
σ159.652-125.371=34.281
min1657.000-1639.000=18.000
max2025.000-1900.000=125.000
mean3.098-3.008=0.090
σ0.383-0.194=0.190
min2.698-2.814=-0.116
max3.705-3.312=0.393

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.379-1.380=-0.001
σ0.291-0.286=0.006
min1.120-1.105=0.015
max1.868-1.858=0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.740=-0.001
σ580.935-580.935=0.000
min155.271-155.269=0.002
max1317.142-1317.143=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1657.000-1639.000=18.000
σ0.000
min1657.000-1639.000=18.000
max1657.000-1639.000=18.000
mean0.548-0.518=0.030
σ0.562-0.505=0.057
min0.264-0.259=0.005
max1.391-1.276=0.115
policies=20
mean1552.987-1552.983=0.004
σ0.328-0.317=0.011
min1552.768-1552.766=0.002
max1553.476-1553.454=0.021
mean920.000
σ0.000
min920.000
max920.000
mean1657.000-1639.000=18.000
σ0.000
min1657.000-1639.000=18.000
max1657.000-1639.000=18.000
mean2.589-2.576=0.013
σ0.006-0.018=-0.011
min2.583-2.558=0.025
max2.595-2.597=-0.002
policies=200
mean15537.986-15537.934=0.052
σ0.082-0.110=-0.029
min15537.871-15537.825=0.047
max15538.061-15538.036=0.025
mean9200.000
σ0.000
min9200.000
max9200.000
mean1657.000-1639.000=18.000
σ0.000
min1657.000-1639.000=18.000
max1657.000-1639.000=18.000
mean26.149-26.042=0.107
σ0.182-0.094=0.088
min26.042-25.949=0.093
max26.422-26.141=0.280