Skip to content

Avoid converting meta-schemas altogether for now - #1087

Merged
jviotti merged 2 commits into
mainfrom
no-meta-convert
Sep 23, 2026
Merged

jviotti merged 2 commits into
mainfrom
no-meta-convert

Conversation

@jviotti

@jviotti jviotti commented Sep 23, 2026 •

Copy link
Copy Markdown
Member

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

Review in cubic

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
@augmentcode

augmentcode Bot commented Sep 23, 2026

Copy link
Copy Markdown
🤖 Augment PR Summary

Summary: This PR disables conversion of meta-schemas and non-official dialects.
Changes:

  • Adds dedicated unsupported-dialect and unsupported-meta-schema errors.
  • Frames the input before conversion and rejects unsupported locations up front.
  • Detects self-describing schemas and embedded meta-schema targets.
  • Removes the public and test-only is_metaschema parameter.
  • Removes meta-schema vocabulary synthesis and its conversion rule.
  • Simplifies upgrade rules now that foreign and meta-schema resources are rejected.
  • Updates the conversion fixture runner to assert the new error classes.
  • Replaces prior conversion fixtures for foreign/meta-schema cases with rejection coverage.
Technical Notes: Official draft URL aliases are normalized when checking whether a dialect is on the supported conversion ladder.

🤖 Was this summary useful? React with 👍 or 👎

@augmentcode augmentcode Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. 2 suggestions posted.

Fix All in Augment

Comment augment review to trigger a new review at any time.

Comment thread src/convert/convert.cc
auto assert_convertible_dialects(const core::JSON &schema,
const core::SchemaFrame &frame,
const std::string_view default_id) -> void {
if (describes_itself(schema, default_id)) {

@augmentcode augmentcode Bot Sep 23, 2026 •

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

describes_itself only recognizes Draft 3/4 through the exact HTTP-with-# ladder strings. A self-describing schema using an accepted alias such as https://json-schema.org/draft-04/schema# (or the HTTP spelling without #) therefore passes this check and names_ladder_dialect, then is converted despite meta-schemas being unsupported.

Severity: high

Fix This in Augment

🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.

/// is. For example:
/// is. Meta-schemas are not supported, so a document that declares a dialect
/// outside the official ones, embeds the meta-schema it declares, or describes
/// itself raises `ConvertUnsupportedMetaschemaError`. For example:

@augmentcode augmentcode Bot Sep 23, 2026 •

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This says a non-official dialect raises ConvertUnsupportedMetaschemaError, but assert_convertible_dialects raises ConvertUnsupportedDialectError for that case. This public API documentation would cause consumers to handle the wrong exception type.

Severity: low

Fix This in Augment

🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>

@cubic-dev-ai cubic-dev-ai Bot left a comment •

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed against the latest diff

Reply with feedback, questions, or to request a fix.

Re-trigger cubic

Comment thread src/convert/rules/upgrade_draft_3_to_draft_4.h

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

2 issues found across 116 files

Prompt for AI agents (unresolved issues)

Check if these issues are valid — if so, understand the root cause of each and fix them. If appropriate, use sub-agents to investigate and fix each issue separately.


<file name="src/convert/include/sourcemeta/blaze/convert.h">

<violation number="1" location="src/convert/include/sourcemeta/blaze/convert.h:49">
P3: The phrase “meta-schema something in it declares” is unclear; state that the document contains a meta-schema declared by a subschema.</violation>
</file>

<file name="src/convert/helpers.h">

<violation number="1" location="src/convert/helpers.h:208">
P2: The updated `describes_itself` documentation claims aliases of ladder dialects (e.g. https spellings) are detected, but `names_the_same_uri` never equates `https` with `http`: string equality is checked after stripping only the empty fragment, and the fallback URI canonicalisation preserves the scheme. So a self-descriptive metaschema that spells `$schema` and `id` differently — for example `$schema: https://json-schema.org/draft-04/schema#` with `id: http://json-schema.org/draft-04/schema#` — fails `describes_itself`, the root is not refused, and the conversion mutates a metaschema the PR intends to refuse. The new https-alias fixtures only pair identical spellings (`$schema`/`$id` or `$schema`/`id` share the exact same string), so this mixed-spelling path is unexercised.</violation>
</file>

Reply with feedback, questions, or to request a fix.

Re-trigger cubic

Comment thread src/convert/helpers.h
// dialect the ladder does not name leaves the question open
// names after them in `$id`, so the other keyword is ordinary data there.
// Anything the ladder does not name outright, which includes every alias of
// a dialect it does name, has to be asked of both

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2: The updated describes_itself documentation claims aliases of ladder dialects (e.g. https spellings) are detected, but names_the_same_uri never equates https with http: string equality is checked after stripping only the empty fragment, and the fallback URI canonicalisation preserves the scheme. So a self-descriptive metaschema that spells $schema and id differently — for example $schema: https://json-schema.org/draft-04/schema# with id: http://json-schema.org/draft-04/schema# — fails describes_itself, the root is not refused, and the conversion mutates a metaschema the PR intends to refuse. The new https-alias fixtures only pair identical spellings ($schema/$id or $schema/id share the exact same string), so this mixed-spelling path is unexercised.

Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At src/convert/helpers.h, line 208:

<comment>The updated `describes_itself` documentation claims aliases of ladder dialects (e.g. https spellings) are detected, but `names_the_same_uri` never equates `https` with `http`: string equality is checked after stripping only the empty fragment, and the fallback URI canonicalisation preserves the scheme. So a self-descriptive metaschema that spells `$schema` and `id` differently — for example `$schema: https://json-schema.org/draft-04/schema#` with `id: http://json-schema.org/draft-04/schema#` — fails `describes_itself`, the root is not refused, and the conversion mutates a metaschema the PR intends to refuse. The new https-alias fixtures only pair identical spellings (`$schema`/`$id` or `$schema`/`id` share the exact same string), so this mixed-spelling path is unexercised.</comment>

<file context>
@@ -253,8 +203,9 @@ inline auto describes_itself(const sourcemeta::core::JSON &schema,
-  // dialect the ladder does not name leaves the question open
+  // names after them in `$id`, so the other keyword is ordinary data there.
+  // Anything the ladder does not name outright, which includes every alias of
+  // a dialect it does name, has to be asked of both
   const auto position{dialect_position(dialect->to_string())};
   const auto &value{dialect->to_string()};
</file context>

Comment on lines +49 to +50
/// is. A document that describes itself or that carries the meta-schema
/// something in it declares raises `ConvertUnsupportedMetaschemaError`, and one

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P3: The phrase “meta-schema something in it declares” is unclear; state that the document contains a meta-schema declared by a subschema.

Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At src/convert/include/sourcemeta/blaze/convert.h, line 49:

<comment>The phrase “meta-schema something in it declares” is unclear; state that the document contains a meta-schema declared by a subschema.</comment>

<file context>
@@ -46,7 +46,10 @@ enum class ConvertTarget : std::uint8_t {
 /// Convert the given schema, in place, to the given dialect. Only upgrades are
 /// supported, so a schema already on that dialect or a newer one is left as
-/// is. For example:
+/// is. A document that describes itself or that carries the meta-schema
+/// something in it declares raises `ConvertUnsupportedMetaschemaError`, and one
+/// that sits on a dialect outside the official ladder raises
</file context>
Suggested change
/// is. A document that describes itself or that carries the meta-schema
/// something in it declares raises `ConvertUnsupportedMetaschemaError`, and one
/// is. A document that is itself a meta-schema or contains a meta-schema
/// that a subschema declares raises `ConvertUnsupportedMetaschemaError`, and one

@github-actions github-actions Bot left a comment •

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/llvm)

Details
Benchmark suite Current: 4481260 Previous: 22f5a83 Ratio
E2E_Compiler_adaptivecard 65300972.333333336 ns 31297118 ns 2.09
E2E_Compiler_ansible_meta 19111775.615384616 ns 10195280.782608695 ns 1.87
E2E_Compiler_aws_cdk 253421.1426056338 ns 144350.66049739733 ns 1.76
E2E_Compiler_babelrc 1489602.92 ns 906798.3271375465 ns 1.64
E2E_Compiler_clang_format 12399450.307692308 ns 6922379.073170732 ns 1.79
E2E_Compiler_cmake_presets 21645888.888888888 ns 17845529.785714287 ns 1.21
E2E_Compiler_code_climate 1087250.9382022473 ns 776079.5152838428 ns 1.40
E2E_Compiler_cql2 9597750 ns 5848811.5 ns 1.64
E2E_Compiler_cspell 17278985.07142857 ns 9725920.454545455 ns 1.78
E2E_Compiler_cypress 3647293.269230769 ns 1619479.0078740157 ns 2.25
E2E_Compiler_deno 4622339.285714285 ns 4651173.6 ns 0.99
E2E_Compiler_dependabot 5352096.218181818 ns 1357520.8333333333 ns 3.94
E2E_Compiler_draft_04 2207925.9850746267 ns 1079553.9333333333 ns 2.05
E2E_Compiler_fabric_mod 3186368.6440677964 ns 2011968.142857143 ns 1.58
E2E_Compiler_geojson 16873788.866666667 ns 11922525.80952381 ns 1.42
E2E_Compiler_gitpod_configuration 3852741.9126213593 ns 1888469.7024793387 ns 2.04
E2E_Compiler_helm_chart_lock 607549.5303370786 ns 281441.05125148984 ns 2.16
E2E_Compiler_importmap 245614.52184179457 ns 148032.50323415265 ns 1.66
E2E_Compiler_jasmine 852612.012145749 ns 425981.2324324324 ns 2.00
E2E_Compiler_jshintrc 2317992.09 ns 1497766.8944444444 ns 1.55
E2E_Compiler_jsconfig 14322033.333333334 ns 7871302.419354838 ns 1.82
E2E_Compiler_krakend 91287500 ns 58750895.75 ns 1.55
E2E_Compiler_lazygit 25854359.375 ns 14266660.05263158 ns 1.81
E2E_Compiler_lerna 1170763.1578947369 ns 634598.6328358209 ns 1.84
E2E_Compiler_nest_cli 4035646.3414634145 ns 3576071.734177215 ns 1.13
E2E_Compiler_omc 188369000 ns 95150014 ns 1.98
E2E_Compiler_omnisharp 5261940.625 ns 2779400.641025641 ns 1.89
E2E_Compiler_openapi 22597993.083333332 ns 13227085.4 ns 1.71
E2E_Compiler_pre_commit_hooks 1846530.9 ns 1576251.461988304 ns 1.17
E2E_Compiler_pulumi 2050988.2921348314 ns 1462373.1751824818 ns 1.40
E2E_Compiler_semantic_release 858573.5506072874 ns 570627.428904429 ns 1.50
E2E_Compiler_stale 724952.9177718833 ns 477104.1169451074 ns 1.52
E2E_Compiler_stylecop 3184420.578125 ns 2264590.8076923075 ns 1.41
E2E_Compiler_tmuxinator 839629.4351851852 ns 739814.4171779141 ns 1.13
E2E_Compiler_ui5 39940767.85714286 ns 29404807.375 ns 1.36
E2E_Compiler_ui5_manifest 232630000 ns 173639084 ns 1.34
E2E_Compiler_unreal_engine_uproject 2538076.301204819 ns 1606872.7034482758 ns 1.58
E2E_Compiler_users_array 447953.4691629956 ns 328252.71181938914 ns 1.36
E2E_Compiler_vercel 8253448.692307692 ns 6295274 ns 1.31
E2E_Compiler_yamllint 98533.54519774011 ns 90475.96053215077 ns 1.09
E2E_Evaluator_adaptivecard 27332.026703411575 ns 22792.042306904325 ns 1.20
E2E_Evaluator_ansible_meta 314010.58390804596 ns 191256.0501022495 ns 1.64
E2E_Evaluator_aws_cdk 59809.0214858918 ns 44877.6510425949 ns 1.33
E2E_Evaluator_babelrc 140643.0541619156 ns 96772.8554472234 ns 1.45
E2E_Evaluator_cerebrum_criminal_case 1382312.384180791 ns 1048025.606870229 ns 1.32
E2E_Evaluator_clang_format 102739.69253208868 ns 97053.02531645569 ns 1.06
E2E_Evaluator_cmake_presets 4785076.508196721 ns 3893604.4923076923 ns 1.23
E2E_Evaluator_code_climate 212902.8022355976 ns 165742.1261889664 ns 1.28
E2E_Evaluator_cql2 273012.598820059 ns 170855.23407202217 ns 1.60
E2E_Evaluator_cspell 716348.2053872054 ns 528762.7296703297 ns 1.35
E2E_Evaluator_cypress 206432.54680534918 ns 154315.1803948264 ns 1.34
E2E_Evaluator_deno 400014.7831800263 ns 288824.5204872647 ns 1.38
E2E_Evaluator_dependabot 432502.9411764706 ns 283990.8810325477 ns 1.52
E2E_Evaluator_draft_04 8313521.68 ns 5846944.444444444 ns 1.42
E2E_Evaluator_fabric_mod 730656.779661017 ns 556388.0269541779 ns 1.31
E2E_Evaluator_geojson 15706329.545454545 ns 8809758.32 ns 1.78
E2E_Evaluator_gitpod_configuration 329203.75722543354 ns 193403.02878289475 ns 1.70
E2E_Evaluator_helm_chart_lock 515300.48076923075 ns 262476.28657921293 ns 1.96
E2E_Evaluator_importmap 74524.2674462467 ns 44383.0961576747 ns 1.68
E2E_Evaluator_jasmine 121878.31539782484 ns 108431.78689956332 ns 1.12
E2E_Evaluator_jshintrc 1670702.0263157894 ns 1072062.6242424243 ns 1.56
E2E_Evaluator_jsconfig 485405.2631578947 ns 407476.6092814371 ns 1.19
E2E_Evaluator_krakend 217967.98917944095 ns 160385.75 ns 1.36
E2E_Evaluator_lazygit 214902.60891590678 ns 117497.96270161291 ns 1.83
E2E_Evaluator_lerna 267651.3199588477 ns 145863.08466548254 ns 1.83
E2E_Evaluator_nest_cli 298004.15936952713 ns 153055.68970283345 ns 1.95
E2E_Evaluator_omc 24764.58463786266 ns 16844.133476856834 ns 1.47
E2E_Evaluator_omnisharp 870884.0996168583 ns 489652.5767634855 ns 1.78
E2E_Evaluator_openapi 14453660.4 ns 8333301.269230769 ns 1.73
E2E_Evaluator_pre_commit_hooks 728897.9700854701 ns 442238.4338235294 ns 1.65
E2E_Evaluator_pulumi 1083442.118226601 ns 567554.5192802057 ns 1.91
E2E_Evaluator_semantic_release 128057.98779743747 ns 83274.54370692783 ns 1.54
E2E_Evaluator_stale 211587.24340175954 ns 133610.431763285 ns 1.58
E2E_Evaluator_stylecop 398729.54173486086 ns 222011.89961013646 ns 1.80
E2E_Evaluator_tmuxinator 115033.41889117043 ns 75364.80597484276 ns 1.53
E2E_Evaluator_ui5 716344.1546961326 ns 417629.7690763052 ns 1.72
E2E_Evaluator_ui5_manifest 3634161.169811321 ns 2591122.743243243 ns 1.40
E2E_Evaluator_unreal_engine_uproject 527156.0693641618 ns 388754.7223796034 ns 1.36
E2E_Evaluator_users_array 702285.7919463087 ns 468879.2277432712 ns 1.50
E2E_Evaluator_vercel 425789.86862745095 ns 251737.93284365162 ns 1.69
E2E_Evaluator_yamllint 15051.523351073372 ns 9158.120108945834 ns 1.64
JSONLD_Catalog_Simple 33358250 ns 18025500 ns 1.85
JSONLD_Catalog_Override_Agreeing 30950365.666666668 ns 19497100.666666668 ns 1.59
JSONLD_Catalog_Override_Shadowing 44183423.666666664 ns 26822912.111111112 ns 1.65
Micro_Draft4_Meta_1_No_Callback 208.6386472639268 ns 161.6960093111893 ns 1.29
Micro_Draft4_Required_Properties 1200.463974308976 ns 737.9028566557965 ns 1.63
Micro_Draft4_Many_Optional_Properties_Minimal_Match 20.842392778153933 ns 18.852528223283826 ns 1.11
Micro_Draft4_Few_Optional_Properties_Minimal_Match 16.128427690789206 ns 11.495589388671464 ns 1.40
Micro_Draft4_Items_Schema 432.3032292892151 ns 314.5011858309282 ns 1.37
Micro_Draft4_Nested_Object 2.585639321284358 ns 2.1092368217478237 ns 1.23
Micro_Draft4_Properties_Triad_Optional 409.07437309933135 ns 253.3463632147353 ns 1.61
Micro_Draft4_Properties_Triad_Required 465.6583025092472 ns 272.8269339615686 ns 1.71
Micro_Draft4_Properties_Triad_Closed 282.86203523389514 ns 211.99207110567258 ns 1.33
Micro_Draft4_Properties_Closed 73.13938244472496 ns 52.51276932352268 ns 1.39
Micro_Draft4_Non_Recursive_Ref 17.087557088337224 ns 13.085285779044204 ns 1.31
Micro_Draft4_Pattern_Properties_Empty 215.0188173444068 ns 162.30942158032073 ns 1.32
Micro_Draft4_Ref_To_Single_Property 21.001225 ns 11.216287815606037 ns 1.87
Micro_Draft4_Additional_Properties_Type 37.665219917173104 ns 28.984503681078873 ns 1.30
Micro_Draft4_Nested_Oneof 50.68128651586411 ns 45.05780581325646 ns 1.12
Micro_Draft4_Short_Enum 8.333701256074995 ns 6.862223882589019 ns 1.21
Micro_Draft4_Long_Enum 13.581535917570228 ns 11.784972525952758 ns 1.15
Micro_Draft4_Long_Enum_Short_Strings 8.786354849193314 ns 8.762053459974435 ns 1.00
Micro_Draft4_Type_Object 3.897356684820609 ns 4.08777172709557 ns 0.95
Micro_Draft4_Ref_Single_100 1239243.25433526 ns 1452938.6690140846 ns 0.85
Micro_Draft4_Compile_Ref_Many_Nested 1033683.2717391305 ns 796829.1050724637 ns 1.30
Micro_Draft4_Compile_Wrap 1243130.005464481 ns 948558.1983805668 ns 1.31
Micro_Draft6_Property_Names 139.57386795773024 ns 109.6611467613388 ns 1.27
Micro_Draft6_Compile_FHIR 9048192709 ns 6008231125 ns 1.51
Micro_Draft7_If_Then_Else 27.679053232978546 ns 19.026367684101636 ns 1.45
Micro_2019_09_Unevaluated_Properties 51.93936052713381 ns 33.56142438579747 ns 1.55
Micro_2019_09_Compile_Wrap 98760062.5 ns 80453194.33333333 ns 1.23
Micro_2020_12_Dynamic_Ref 868.264432345231 ns 609.3416455434276 ns 1.42
Micro_2020_12_Dynamic_Ref_Single 5.100443663246359 ns 3.452267177713751 ns 1.48
Micro_2020_12_Simple_Output_Mask 1151.5338014021245 ns 853.1489867360375 ns 1.35
Micro_2020_12_Simple_Output_Annotations 76985.27497559389 ns 51805.19942516029 ns 1.49
Micro_2020_12_Simple_Output_Annotation_Dropping 2063905.83 ns 1202555.2642487048 ns 1.72
Micro_2020_12_Compile_NonCircular_Shared_Refs 626457.9439252337 ns 426471.1895910781 ns 1.47
Micro_2020_12_Exhaustive_Deep_Numeric 7164.103800630127 ns 5054.298615771812 ns 1.42
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 37904.94516431925 ns 30758.86220028209 ns 1.23
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 16486.842251897397 ns 13086.309215578716 ns 1.26
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 97.63745328277169 ns 84.32082068527578 ns 1.16
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 3186.100740459013 ns 2358.074327070837 ns 1.35
TestSuite_Parse_WoT 16513939.777777778 ns 11351941.176470589 ns 1.45
Alterschema_Check_Readibility_ISO_Language_Set_3 212214875 ns 154002750 ns 1.38
Alterschema_Check_Readibility_OMC 51777525 ns 31978303.57142857 ns 1.62
Alterschema_Check_Readibility_KrakenD 616676291 ns 387366000 ns 1.59
Alterschema_Apply_Readibility_KrakenD 63306269125 ns 41860532167 ns 1.51
Alterschema_Check_Invalid_External_Refs 230508375 ns 135566437.5 ns 1.70
Alterschema_Check_Resolvable_External_Refs 238003.99760191847 ns 124552.71512052593 ns 1.91

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment •

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (macos/llvm)

Details
Benchmark suite Current: 4481260 Previous: 22f5a83 Ratio
E2E_Evaluator_adaptivecard 183032 ns 91917 ns 1.99
E2E_Evaluator_ansible-meta 563323 ns 318614 ns 1.77
E2E_Evaluator_aws-cdk 155819 ns 106736 ns 1.46
E2E_Evaluator_babelrc 368754 ns 241783 ns 1.53
E2E_Evaluator_cerebrum-criminal-case 2291494 ns 1486531 ns 1.54
E2E_Evaluator_clang-format 249026 ns 157649 ns 1.58
E2E_Evaluator_cmake-presets 19416457 ns 11796013 ns 1.65
E2E_Evaluator_code-climate 480803 ns 365980 ns 1.31
E2E_Evaluator_cql2 1049121 ns 956879 ns 1.10
E2E_Evaluator_cspell 1387894 ns 1016805 ns 1.36
E2E_Evaluator_cypress 616953 ns 529313 ns 1.17
E2E_Evaluator_deno 737474 ns 664555 ns 1.11
E2E_Evaluator_dependabot 827502 ns 744374 ns 1.11
E2E_Evaluator_draft-04 15950111 ns 15287344 ns 1.04
E2E_Evaluator_fabric-mod 2058331 ns 1477770 ns 1.39
E2E_Evaluator_geojson 19348124 ns 17320628 ns 1.12
E2E_Evaluator_gitpod-configuration 541814 ns 489007 ns 1.11
E2E_Evaluator_helm-chart-lock 898950 ns 856982 ns 1.05
E2E_Evaluator_importmap 299735 ns 212699 ns 1.41
E2E_Evaluator_jasmine 304929 ns 211552 ns 1.44
E2E_Evaluator_jsconfig 1191114 ns 887980 ns 1.34
E2E_Evaluator_jshintrc 2534275 ns 2071295 ns 1.22
E2E_Evaluator_krakend 655529 ns 435200 ns 1.51
E2E_Evaluator_lazygit 381040 ns 292100 ns 1.30
E2E_Evaluator_lerna 389961 ns 320178 ns 1.22
E2E_Evaluator_nest-cli 467620 ns 415712 ns 1.12
E2E_Evaluator_omc 112966 ns 95560 ns 1.18
E2E_Evaluator_omnisharp 1061624 ns 998186 ns 1.06
E2E_Evaluator_openapi 32040082 ns 28681006 ns 1.12
E2E_Evaluator_pre-commit-hooks 1584269 ns 1356129 ns 1.17
E2E_Evaluator_pulumi 2286854 ns 1567943 ns 1.46
E2E_Evaluator_semantic-release 207521 ns 179063 ns 1.16
E2E_Evaluator_stale 334963 ns 279361 ns 1.20
E2E_Evaluator_stylecop 891579 ns 712868 ns 1.25
E2E_Evaluator_tmuxinator 177610 ns 167751 ns 1.06
E2E_Evaluator_ui5 1747404 ns 1574223 ns 1.11
E2E_Evaluator_ui5-manifest 9326875 ns 7663299 ns 1.22
E2E_Evaluator_unreal-engine-uproject 1556962 ns 1276196 ns 1.22
E2E_Evaluator_users-array 3508839 ns 2216164 ns 1.58
E2E_Evaluator_vercel 1203117 ns 768341 ns 1.57
E2E_Evaluator_yamllint 30127 ns 23730 ns 1.27

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment •

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/llvm)

Details
Benchmark suite Current: 4481260 Previous: 22f5a83 Ratio
E2E_Compiler_adaptivecard 34619669.8 ns 32222193.42857143 ns 1.07
E2E_Compiler_ansible_meta 10630870.217391305 ns 10696262.136363637 ns 0.99
E2E_Compiler_aws_cdk 181312.8623076923 ns 182536.95249042145 ns 0.99
E2E_Compiler_babelrc 1053458.1233480177 ns 1053273.5777777778 ns 1.00
E2E_Compiler_clang_format 7191686 ns 7153382.636363637 ns 1.01
E2E_Compiler_cmake_presets 15348810.42857143 ns 15039307 ns 1.02
E2E_Compiler_code_climate 769171.4077669902 ns 771044.569579288 ns 1.00
E2E_Compiler_cql2 7086208.575757576 ns 7014917.705882353 ns 1.01
E2E_Compiler_cspell 11729770.75 ns 11426216.19047619 ns 1.03
E2E_Compiler_cypress 1823318.724409449 ns 1842403.3643410853 ns 0.99
E2E_Compiler_deno 3549191.1764705884 ns 3540068.149253731 ns 1.00
E2E_Compiler_dependabot 1442685.5521472392 ns 1447855.3536585367 ns 1.00
E2E_Compiler_draft_04 1266941.0802139037 ns 1266760.9839572192 ns 1.00
E2E_Compiler_fabric_mod 2204413.886792453 ns 2201024.0560747664 ns 1.00
E2E_Compiler_geojson 10628089.227272727 ns 10604363.954545455 ns 1.00
E2E_Compiler_gitpod_configuration 2168375.018348624 ns 2177534.2935779816 ns 1.00
E2E_Compiler_helm_chart_lock 328245.39364640886 ns 327879.44751381216 ns 1.00
E2E_Compiler_importmap 144080.95686794957 ns 145486.11145320197 ns 0.99
E2E_Compiler_jasmine 555080.1966824644 ns 556613.1643192489 ns 1.00
E2E_Compiler_jshintrc 1753494.8074074073 ns 1764978.485074627 ns 0.99
E2E_Compiler_jsconfig 10052055.043478262 ns 10003825.75 ns 1.00
E2E_Compiler_krakend 67399362.25 ns 61680104.75 ns 1.09
E2E_Compiler_lazygit 14268279.5 ns 13928139.11764706 ns 1.02
E2E_Compiler_lerna 690343.4811594203 ns 689149.4664723033 ns 1.00
E2E_Compiler_nest_cli 3306787.5142857144 ns 3314987.888888889 ns 1.00
E2E_Compiler_omc 86208323.66666667 ns 79278129.66666667 ns 1.09
E2E_Compiler_omnisharp 2978237.7875 ns 2965822.325 ns 1.00
E2E_Compiler_openapi 13486076.823529411 ns 13114157.944444444 ns 1.03
E2E_Compiler_pre_commit_hooks 1466258.490797546 ns 1454321.3803680982 ns 1.01
E2E_Compiler_pulumi 1782117.8615384616 ns 1767447.2706766918 ns 1.01
E2E_Compiler_semantic_release 645237.3369565217 ns 648356.629427793 ns 1.00
E2E_Compiler_stale 563907.7923627686 ns 567370.6330935252 ns 0.99
E2E_Compiler_stylecop 2557224.153846154 ns 2582131.5054945056 ns 0.99
E2E_Compiler_tmuxinator 881729.5634328359 ns 877835.1555555556 ns 1.00
E2E_Compiler_ui5 28665065.57142857 ns 27567975.875 ns 1.04
E2E_Compiler_ui5_manifest 165882618 ns 155270778 ns 1.07
E2E_Compiler_unreal_engine_uproject 1890632.0495867769 ns 1888538.9512195121 ns 1.00
E2E_Compiler_users_array 371058.57007874013 ns 371700.60876369325 ns 1.00
E2E_Compiler_vercel 6497171.25 ns 6491352.918918919 ns 1.00
E2E_Compiler_yamllint 121864.53586278587 ns 123617.86375455018 ns 0.99
E2E_Evaluator_adaptivecard 26228.427404007612 ns 26084.35781730347 ns 1.01
E2E_Evaluator_ansible_meta 244665.77971311475 ns 245188.6905737705 ns 1.00
E2E_Evaluator_aws_cdk 50733.886094674555 ns 50717.67504332756 ns 1.00
E2E_Evaluator_babelrc 115049.03167641326 ns 115249.759697733 ns 1.00
E2E_Evaluator_cerebrum_criminal_case 1084065.2119815669 ns 1079048.3288288289 ns 1.00
E2E_Evaluator_clang_format 114412.52426717924 ns 113516.75428571428 ns 1.01
E2E_Evaluator_cmake_presets 4953067.274509804 ns 4320664.5 ns 1.15
E2E_Evaluator_code_climate 192848.56503728253 ns 192552.95331695332 ns 1.00
E2E_Evaluator_cql2 225001.5420207743 ns 223446.69763033176 ns 1.01
E2E_Evaluator_cspell 653759.9668508287 ns 654040.5757575758 ns 1.00
E2E_Evaluator_cypress 200323.77692960136 ns 198999.0373514431 ns 1.01
E2E_Evaluator_deno 336950.0760401722 ns 340165.22953216376 ns 0.99
E2E_Evaluator_dependabot 349394.93934911245 ns 344741.9798850575 ns 1.01
E2E_Evaluator_draft_04 9128222.76 ns 7136848.133333334 ns 1.28
E2E_Evaluator_fabric_mod 686758.2666666667 ns 693856.5676470589 ns 0.99
E2E_Evaluator_geojson 11484458.142857144 ns 11331717.590909092 ns 1.01
E2E_Evaluator_gitpod_configuration 249310.17883597885 ns 249943.06210526315 ns 1.00
E2E_Evaluator_helm_chart_lock 358370.92438271607 ns 366620.14961832063 ns 0.98
E2E_Evaluator_importmap 50162.24108695652 ns 51590.0355671221 ns 0.97
E2E_Evaluator_jasmine 113652.98918664786 ns 113096.25381679389 ns 1.00
E2E_Evaluator_jshintrc 1216513.5282051282 ns 1213593.9846938776 ns 1.00
E2E_Evaluator_jsconfig 443327.3965517241 ns 446062.8330206379 ns 0.99
E2E_Evaluator_krakend 211392.63445761168 ns 212196.44354110208 ns 1.00
E2E_Evaluator_lazygit 156805.38822751323 ns 157224.5617078052 ns 1.00
E2E_Evaluator_lerna 149908.84382871535 ns 150349.18977635782 ns 1.00
E2E_Evaluator_nest_cli 196478.53580246912 ns 198533.5107615894 ns 0.99
E2E_Evaluator_omc 21842.68466722053 ns 21786.290040063355 ns 1.00
E2E_Evaluator_omnisharp 637004.6989247312 ns 638487.8682795699 ns 1.00
E2E_Evaluator_openapi 16423258.642857144 ns 11911687.35 ns 1.38
E2E_Evaluator_pre_commit_hooks 516344.5606407323 ns 511791.25701943843 ns 1.01
E2E_Evaluator_pulumi 688288.1988304093 ns 682864.7449275362 ns 1.01
E2E_Evaluator_semantic_release 102834.59353146853 ns 102222.57557384149 ns 1.01
E2E_Evaluator_stale 156539.2465300727 ns 157029.72733289213 ns 1.00
E2E_Evaluator_stylecop 301677.725388601 ns 300339.8665819568 ns 1.00
E2E_Evaluator_tmuxinator 97723.08829568789 ns 97507.42951907132 ns 1.00
E2E_Evaluator_ui5 552655.4595842956 ns 540908.3257403189 ns 1.02
E2E_Evaluator_ui5_manifest 2675506.1445783135 ns 2651657.6704545454 ns 1.01
E2E_Evaluator_unreal_engine_uproject 466005.9921875 ns 475517.5261044177 ns 0.98
E2E_Evaluator_users_array 591782.769035533 ns 589189.2456575682 ns 1.00
E2E_Evaluator_vercel 338335.35077793495 ns 334603.338028169 ns 1.01
E2E_Evaluator_yamllint 9279.648862125596 ns 9186.988910074322 ns 1.01
JSONLD_Catalog_Simple 21758318.222222224 ns 19605683 ns 1.11
JSONLD_Catalog_Override_Agreeing 21759093.7 ns 20071868.416666668 ns 1.08
JSONLD_Catalog_Override_Shadowing 35370823 ns 30219230.875 ns 1.17
Micro_Draft4_Meta_1_No_Callback 199.17601966853755 ns 197.9637121896125 ns 1.01
Micro_Draft4_Required_Properties 825.9704226871947 ns 812.0029058557814 ns 1.02
Micro_Draft4_Many_Optional_Properties_Minimal_Match 25.74380994278211 ns 25.695874944036593 ns 1.00
Micro_Draft4_Few_Optional_Properties_Minimal_Match 13.179607527298815 ns 13.167480327749251 ns 1.00
Micro_Draft4_Items_Schema 294.37748390507886 ns 293.68657449619474 ns 1.00
Micro_Draft4_Nested_Object 3.114018200706272 ns 3.1128695997234184 ns 1.00
Micro_Draft4_Properties_Triad_Optional 335.48640555078424 ns 333.6412679860022 ns 1.01
Micro_Draft4_Properties_Triad_Required 351.39109605634803 ns 351.69648053084785 ns 1.00
Micro_Draft4_Properties_Triad_Closed 277.663449454582 ns 276.28973994733667 ns 1.00
Micro_Draft4_Properties_Closed 64.08721939329227 ns 64.01933031099931 ns 1.00
Micro_Draft4_Non_Recursive_Ref 16.498745095403855 ns 16.43452658987652 ns 1.00
Micro_Draft4_Pattern_Properties_Empty 163.37571075474048 ns 163.49072664440575 ns 1.00
Micro_Draft4_Ref_To_Single_Property 13.161023025770154 ns 13.16620050153704 ns 1.00
Micro_Draft4_Additional_Properties_Type 35.251640004415194 ns 35.18440327272733 ns 1.00
Micro_Draft4_Nested_Oneof 61.96904271544364 ns 61.91922176398393 ns 1.00
Micro_Draft4_Short_Enum 10.635817381438896 ns 12.765100514919704 ns 0.83
Micro_Draft4_Long_Enum 15.579417739007308 ns 15.573647351184094 ns 1.00
Micro_Draft4_Long_Enum_Short_Strings 10.616709017363046 ns 12.7683207 ns 0.83
Micro_Draft4_Type_Object 4.981355159509466 ns 5.289856456275931 ns 0.94
Micro_Draft4_Ref_Single_100 1365142.7660818712 ns 1359933.9425287356 ns 1.00
Micro_Draft4_Compile_Ref_Many_Nested 882710.3791821562 ns 885926.2696629213 ns 1.00
Micro_Draft4_Compile_Wrap 1054054.0442477877 ns 1051656.6415929203 ns 1.00
Micro_Draft6_Property_Names 111.71322413490499 ns 111.74485061849087 ns 1.00
Micro_Draft6_Compile_FHIR 5179513573 ns 5003239038 ns 1.04
Micro_Draft7_If_Then_Else 24.012971250386258 ns 23.999680790821262 ns 1.00
Micro_2019_09_Unevaluated_Properties 28.691085899279432 ns 28.670843907615303 ns 1.00
Micro_2019_09_Compile_Wrap 85960451.33333333 ns 79954070 ns 1.08
Micro_2020_12_Dynamic_Ref 703.3256371742887 ns 706.5046247619499 ns 1.00
Micro_2020_12_Dynamic_Ref_Single 5.292476291331836 ns 5.2900204365844585 ns 1.00
Micro_2020_12_Simple_Output_Mask 1050.330978381007 ns 1047.0163232621885 ns 1.00
Micro_2020_12_Simple_Output_Annotations 48779.179708359006 ns 48149.08109201214 ns 1.01
Micro_2020_12_Simple_Output_Annotation_Dropping 1278061.027027027 ns 1286523.902173913 ns 0.99
Micro_2020_12_Compile_NonCircular_Shared_Refs 503254.7195652174 ns 505009.03624733473 ns 1.00
Micro_2020_12_Exhaustive_Deep_Numeric 8446.965474283681 ns 8497.80012887982 ns 0.99
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 36240.684868822456 ns 36840.00352112676 ns 0.98
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 19732.53846153846 ns 19648.06947890819 ns 1.00
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 154.69910937918394 ns 151.72992485374053 ns 1.02
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 2347.226547865645 ns 2352.0716878310645 ns 1.00
TestSuite_Parse_WoT 12635355 ns 12357103.684210526 ns 1.02
Alterschema_Check_Readibility_ISO_Language_Set_3 269161312 ns 268770043 ns 1.00
Alterschema_Check_Readibility_OMC 48199783.4 ns 47281819.2 ns 1.02
Alterschema_Check_Readibility_KrakenD 529582515 ns 524737265 ns 1.01
Alterschema_Apply_Readibility_KrakenD 56015540944 ns 54736893689 ns 1.02
Alterschema_Check_Invalid_External_Refs 231800115 ns 220455563 ns 1.05
Alterschema_Check_Resolvable_External_Refs 194020.73382473382 ns 196213.04962779157 ns 0.99

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment •

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/llvm)

Details
Benchmark suite Current: 4481260 Previous: 22f5a83 Ratio
E2E_Evaluator_adaptivecard 120219 ns 121312 ns 0.99
E2E_Evaluator_ansible-meta 526794 ns 532804 ns 0.99
E2E_Evaluator_aws-cdk 143620 ns 146165 ns 0.98
E2E_Evaluator_babelrc 358643 ns 346236 ns 1.04
E2E_Evaluator_cerebrum-criminal-case 2568465 ns 2508405 ns 1.02
E2E_Evaluator_clang-format 261833 ns 262272 ns 1.00
E2E_Evaluator_cmake-presets 18100973 ns 16261241 ns 1.11
E2E_Evaluator_code-climate 534980 ns 511963 ns 1.04
E2E_Evaluator_cql2 1221235 ns 1220583 ns 1.00
E2E_Evaluator_cspell 1477812 ns 1474584 ns 1.00
E2E_Evaluator_cypress 763359 ns 760652 ns 1.00
E2E_Evaluator_deno 1039268 ns 1014216 ns 1.02
E2E_Evaluator_dependabot 1127518 ns 1107769 ns 1.02
E2E_Evaluator_draft-04 22842044 ns 19809308 ns 1.15
E2E_Evaluator_fabric-mod 2379656 ns 2325080 ns 1.02
E2E_Evaluator_geojson 24280137 ns 24562414 ns 0.99
E2E_Evaluator_gitpod-configuration 711151 ns 721538 ns 0.99
E2E_Evaluator_helm-chart-lock 991153 ns 994190 ns 1.00
E2E_Evaluator_importmap 264811 ns 260403 ns 1.02
E2E_Evaluator_jasmine 305971 ns 291648 ns 1.05
E2E_Evaluator_jsconfig 1239376 ns 1243220 ns 1.00
E2E_Evaluator_jshintrc 2771231 ns 2703060 ns 1.03
E2E_Evaluator_krakend 658854 ns 668491 ns 0.99
E2E_Evaluator_lazygit 521349 ns 502299 ns 1.04
E2E_Evaluator_lerna 464178 ns 472339 ns 0.98
E2E_Evaluator_nest-cli 605203 ns 603875 ns 1.00
E2E_Evaluator_omc 118402 ns 118272 ns 1.00
E2E_Evaluator_omnisharp 1412894 ns 1393445 ns 1.01
E2E_Evaluator_openapi 46437834 ns 45376040 ns 1.02
E2E_Evaluator_pre-commit-hooks 2021999 ns 1963598 ns 1.03
E2E_Evaluator_pulumi 1964195 ns 1947255 ns 1.01
E2E_Evaluator_semantic-release 262590 ns 257238 ns 1.02
E2E_Evaluator_stale 406755 ns 409343 ns 0.99
E2E_Evaluator_stylecop 1204767 ns 1213539 ns 0.99
E2E_Evaluator_tmuxinator 229682 ns 231153 ns 0.99
E2E_Evaluator_ui5 2287495 ns 2199315 ns 1.04
E2E_Evaluator_ui5-manifest 10622347 ns 10907334 ns 0.97
E2E_Evaluator_unreal-engine-uproject 1503931 ns 1534294 ns 0.98
E2E_Evaluator_users-array 2878257 ns 3093622 ns 0.93
E2E_Evaluator_vercel 1018968 ns 980803 ns 1.04
E2E_Evaluator_yamllint 25822 ns 25630 ns 1.01

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment •

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/gcc)

Details
Benchmark suite Current: 4481260 Previous: bfe658e Ratio
Alterschema_Check_Readibility_ISO_Language_Set_3 262382339 ns 152933818.5 ns 1.72
Alterschema_Check_Readibility_OMC 55263806.25 ns 35994534.5 ns 1.54
Alterschema_Check_Readibility_KrakenD 616547103 ns 474520074 ns 1.30
Alterschema_Apply_Readibility_KrakenD 63268455589 ns 49612952868 ns 1.28
Alterschema_Check_Invalid_External_Refs 257553433 ns 128526079.5 ns 2.00
Alterschema_Check_Resolvable_External_Refs 229607.33300685603 ns 131107.2978488693 ns 1.75
TestSuite_Parse_WoT 13848596.3125 ns 9048422.807692308 ns 1.53
Micro_2020_12_Dynamic_Ref 940.5686165678832 ns 606.4076875009604 ns 1.55
Micro_2020_12_Dynamic_Ref_Single 4.681005024463135 ns 3.1956097256335707 ns 1.46
Micro_2020_12_Simple_Output_Mask 1209.1697794248294 ns 729.314993106036 ns 1.66
Micro_2020_12_Simple_Output_Annotations 54597.94784007353 ns 31454.82330326778 ns 1.74
Micro_2020_12_Simple_Output_Annotation_Dropping 1490071.8734177216 ns 919189.9343629343 ns 1.62
Micro_2020_12_Compile_NonCircular_Shared_Refs 566484.0239808153 ns 342643.9479015919 ns 1.65
Micro_2020_12_Exhaustive_Deep_Numeric 9273.11361952665 ns 5614.65134529148 ns 1.65
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 43555.16246805403 ns 26200.27797833935 ns 1.66
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 22376.538432625446 ns 13761.293565683645 ns 1.63
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 174.59227386268572 ns 99.96838651928431 ns 1.75
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 2792.879679804403 ns 1492.3988013461224 ns 1.87
Micro_2019_09_Unevaluated_Properties 30.837727129364072 ns 18.80304203256368 ns 1.64
Micro_2019_09_Compile_Wrap 88596383.5 ns 56859269.666666664 ns 1.56
Micro_Draft7_If_Then_Else 25.21949862251636 ns 15.10244622014098 ns 1.67
Micro_Draft6_Property_Names 149.33811925716157 ns 99.33620142484877 ns 1.50
Micro_Draft6_Compile_FHIR 5589143883 ns 4634718876 ns 1.21
Micro_Draft4_Meta_1_No_Callback 183.44892249174512 ns 113.1311718168395 ns 1.62
Micro_Draft4_Required_Properties 890.1801427872276 ns 646.9426663866624 ns 1.38
Micro_Draft4_Many_Optional_Properties_Minimal_Match 21.831490974557337 ns 14.557564031389536 ns 1.50
Micro_Draft4_Few_Optional_Properties_Minimal_Match 15.580913132977292 ns 8.949743755450534 ns 1.74
Micro_Draft4_Items_Schema 353.69511951867156 ns 238.34493608069366 ns 1.48
Micro_Draft4_Nested_Object 1.555975502474745 ns 0.8208847243253798 ns 1.90
Micro_Draft4_Properties_Triad_Optional 465.2215637549203 ns 194.24327969346143 ns 2.40
Micro_Draft4_Properties_Triad_Required 502.5102806665966 ns 215.23658405826237 ns 2.33
Micro_Draft4_Properties_Triad_Closed 378.35403071297276 ns 160.96679209026675 ns 2.35
Micro_Draft4_Properties_Closed 66.11105043165857 ns 43.41288429823736 ns 1.52
Micro_Draft4_Non_Recursive_Ref 8.71345656925304 ns 5.849014308783264 ns 1.49
Micro_Draft4_Pattern_Properties_Empty 205.0183676803109 ns 124.37617998289171 ns 1.65
Micro_Draft4_Ref_To_Single_Property 15.599189253996284 ns 8.946710459169955 ns 1.74
Micro_Draft4_Additional_Properties_Type 14.006512853742212 ns 9.612841216449755 ns 1.46
Micro_Draft4_Nested_Oneof 64.52231522346764 ns 43.56633141867611 ns 1.48
Micro_Draft4_Short_Enum 14.628443256766607 ns 8.455506917076324 ns 1.73
Micro_Draft4_Long_Enum 13.08187438097066 ns 7.83997740011237 ns 1.67
Micro_Draft4_Long_Enum_Short_Strings 14.633768020269727 ns 8.444252518783443 ns 1.73
Micro_Draft4_Type_Object 4.357011174630136 ns 2.8474724472901825 ns 1.53
Micro_Draft4_Ref_Single_100 1453528.530487805 ns 874683.0295202952 ns 1.66
Micro_Draft4_Compile_Ref_Many_Nested 942616.5918367347 ns 575273.3851674641 ns 1.64
Micro_Draft4_Compile_Wrap 1168692.565 ns 698674.5950155763 ns 1.67
JSONLD_Catalog_Simple 23404321.25 ns 13051049.944444444 ns 1.79
JSONLD_Catalog_Override_Agreeing 23673008.7 ns 13212850.222222222 ns 1.79
JSONLD_Catalog_Override_Shadowing 36017125 ns 19709069.454545453 ns 1.83
E2E_Compiler_adaptivecard 38996005.4 ns 24871531.888888888 ns 1.57
E2E_Compiler_ansible_meta 11807725.05 ns 7821881.580645162 ns 1.51
E2E_Compiler_aws_cdk 203835.54553264604 ns 118922.28277886497 ns 1.71
E2E_Compiler_babelrc 1107356.2112676057 ns 657490.976744186 ns 1.68
E2E_Compiler_clang_format 7955095.033333333 ns 5053694 ns 1.57
E2E_Compiler_cmake_presets 16195942.785714285 ns 10877528.666666666 ns 1.49
E2E_Compiler_code_climate 868290.8327272728 ns 502510.7048832272 ns 1.73
E2E_Compiler_cql2 8035020.1034482755 ns 5370237.4772727275 ns 1.50
E2E_Compiler_cspell 11868238.157894736 ns 7849868.166666667 ns 1.51
E2E_Compiler_cypress 1864780.546875 ns 1109754.8558139536 ns 1.68
E2E_Compiler_deno 3850746.9677419355 ns 2376251.1414141413 ns 1.62
E2E_Compiler_dependabot 1620661.4452054794 ns 922772.8313725491 ns 1.76
E2E_Compiler_draft_04 1430530.4939759036 ns 905224.7164750958 ns 1.58
E2E_Compiler_fabric_mod 2529453.0212765955 ns 1635998.0134228189 ns 1.55
E2E_Compiler_geojson 11601019.95 ns 7579132 ns 1.53
E2E_Compiler_gitpod_configuration 2381627.82 ns 1535640.6 ns 1.55
E2E_Compiler_helm_chart_lock 358054.20884146343 ns 192294.58823529413 ns 1.86
E2E_Compiler_importmap 158629.42914707857 ns 88711.59774859287 ns 1.79
E2E_Compiler_jasmine 589632.1729323309 ns 343905.74558823527 ns 1.71
E2E_Compiler_jshintrc 1816880.6640625 ns 1062100.92 ns 1.71
E2E_Compiler_jsconfig 10498187.217391305 ns 6073438.41025641 ns 1.73
E2E_Compiler_krakend 68006252 ns 40775274.6 ns 1.67
E2E_Compiler_lazygit 14803768.875 ns 9438093.52 ns 1.57
E2E_Compiler_lerna 742209.6677115988 ns 429978.9855334539 ns 1.73
E2E_Compiler_nest_cli 3551610.656716418 ns 2200021.438095238 ns 1.61
E2E_Compiler_omc 95553180 ns 57733309.5 ns 1.66
E2E_Compiler_omnisharp 3106446.6052631577 ns 1901763.76 ns 1.63
E2E_Compiler_openapi 15668225 ns 9891068.8 ns 1.58
E2E_Compiler_pre_commit_hooks 1595305.8150684931 ns 908866.9351145038 ns 1.76
E2E_Compiler_pulumi 1916816.256198347 ns 1236092.1510416667 ns 1.55
E2E_Compiler_semantic_release 738093.5969230769 ns 432439.4744525548 ns 1.71
E2E_Compiler_stale 582447.637037037 ns 367747.01739130437 ns 1.58
E2E_Compiler_stylecop 2683670.2386363638 ns 1685878.9541984734 ns 1.59
E2E_Compiler_tmuxinator 1001717.7046413502 ns 590618.5657568239 ns 1.70
E2E_Compiler_ui5 31149104.714285713 ns 20141581.9 ns 1.55
E2E_Compiler_ui5_manifest 185182321 ns 111446701 ns 1.66
E2E_Compiler_unreal_engine_uproject 1997642.0683760685 ns 1282258.311827957 ns 1.56
E2E_Compiler_users_array 422922.41740674956 ns 234460.06739345886 ns 1.80
E2E_Compiler_vercel 6733137.2727272725 ns 4406309.320754717 ns 1.53
E2E_Compiler_yamllint 132505.15 ns 71093.67433209333 ns 1.86
E2E_Evaluator_adaptivecard 26222.59599777654 ns 15617.414417937687 ns 1.68
E2E_Evaluator_ansible_meta 291707.73284313723 ns 161194.72727272726 ns 1.81
E2E_Evaluator_aws_cdk 59062.85671567406 ns 35654.36410102225 ns 1.66
E2E_Evaluator_babelrc 115461.57121807466 ns 66963.83442576232 ns 1.72
E2E_Evaluator_cerebrum_criminal_case 1149572.4356435644 ns 864850.0945454546 ns 1.33
E2E_Evaluator_clang_format 108030.01548974944 ns 67991.34348950848 ns 1.59
E2E_Evaluator_cmake_presets 5191520.936170213 ns 3769210.049180328 ns 1.38
E2E_Evaluator_code_climate 233751.7705882353 ns 160885.2681281619 ns 1.45
E2E_Evaluator_cql2 225944.518804243 ns 141849.85868263472 ns 1.59
E2E_Evaluator_cspell 636860.6469002696 ns 484196.5356415479 ns 1.32
E2E_Evaluator_cypress 191898.82171799027 ns 132726.6349206349 ns 1.45
E2E_Evaluator_deno 375386.04448105436 ns 262188.5360696517 ns 1.43
E2E_Evaluator_dependabot 398267.1644295302 ns 264625.1284090909 ns 1.51
E2E_Evaluator_draft_04 9214464.782608695 ns 4734601.52 ns 1.95
E2E_Evaluator_fabric_mod 823064.0769230769 ns 564736.7688564477 ns 1.46
E2E_Evaluator_geojson 14009975.294117646 ns 10566095.818181818 ns 1.33
E2E_Evaluator_gitpod_configuration 279432.54415274464 ns 193384.46456692912 ns 1.44
E2E_Evaluator_helm_chart_lock 368660.14417177916 ns 350382.0663580247 ns 1.05
E2E_Evaluator_importmap 47115.66585067319 ns 21688.088799475998 ns 2.17
E2E_Evaluator_jasmine 128392.09041980625 ns 79993.5392123864 ns 1.61
E2E_Evaluator_jshintrc 1110998.7594339622 ns 877998.5645756457 ns 1.27
E2E_Evaluator_jsconfig 454853.42034548946 ns 271840.2376009227 ns 1.67
E2E_Evaluator_krakend 227171.36416184972 ns 126284.17514729513 ns 1.80
E2E_Evaluator_lazygit 156172.38925729442 ns 88173.28571428571 ns 1.77
E2E_Evaluator_lerna 179093.12898330804 ns 130668.85272277228 ns 1.37
E2E_Evaluator_nest_cli 216090.713091922 ns 133799.40813648293 ns 1.62
E2E_Evaluator_omc 24671.319783761304 ns 14558.685522590176 ns 1.69
E2E_Evaluator_omnisharp 612359.6323907454 ns 465527.60236220475 ns 1.32
E2E_Evaluator_openapi 19098466.333333332 ns 8854924.291666666 ns 2.16
E2E_Evaluator_pre_commit_hooks 558051.858490566 ns 396319.202020202 ns 1.41
E2E_Evaluator_pulumi 775394.8640776699 ns 598204.8600508906 ns 1.30
E2E_Evaluator_semantic_release 107617.19429676172 ns 62641.60345744681 ns 1.72
E2E_Evaluator_stale 178939.38531415595 ns 110951.79272898962 ns 1.61
E2E_Evaluator_stylecop 327234.33518776076 ns 193328.99661590526 ns 1.69
E2E_Evaluator_tmuxinator 109443.84881007933 ns 65261.143287671235 ns 1.68
E2E_Evaluator_ui5 623731.914893617 ns 378895.264 ns 1.65
E2E_Evaluator_ui5_manifest 4646345.959183673 ns 2141376.831775701 ns 2.17
E2E_Evaluator_unreal_engine_uproject 508668.39262472885 ns 331752.1013888889 ns 1.53
E2E_Evaluator_users_array 707529.5498489426 ns 512343.3405172414 ns 1.38
E2E_Evaluator_vercel 346577.4388807069 ns 244327.02631578947 ns 1.42
E2E_Evaluator_yamllint 12893.917340131258 ns 7466.40008122208 ns 1.73

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment •

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/gcc)

Details
Benchmark suite Current: 4481260 Previous: bfe658e Ratio
E2E_Evaluator_adaptivecard 119792 ns 74858 ns 1.60
E2E_Evaluator_ansible-meta 526792 ns 338661 ns 1.56
E2E_Evaluator_aws-cdk 147013 ns 95621 ns 1.54
E2E_Evaluator_babelrc 343411 ns 249503 ns 1.38
E2E_Evaluator_cerebrum-criminal-case 2481939 ns 1553876 ns 1.60
E2E_Evaluator_clang-format 261976 ns 170277 ns 1.54
E2E_Evaluator_cmake-presets 17596124 ns 12379940 ns 1.42
E2E_Evaluator_code-climate 519610 ns 379372 ns 1.37
E2E_Evaluator_cql2 1213293 ns 737347 ns 1.65
E2E_Evaluator_cspell 1482999 ns 1111797 ns 1.33
E2E_Evaluator_cypress 771279 ns 615111 ns 1.25
E2E_Evaluator_deno 1070738 ns 785153 ns 1.36
E2E_Evaluator_dependabot 1140984 ns 729443 ns 1.56
E2E_Evaluator_draft-04 21131479 ns 13184849 ns 1.60
E2E_Evaluator_fabric-mod 2329159 ns 1664219 ns 1.40
E2E_Evaluator_geojson 24814574 ns 19506364 ns 1.27
E2E_Evaluator_gitpod-configuration 715962 ns 538096 ns 1.33
E2E_Evaluator_helm-chart-lock 1047734 ns 757671 ns 1.38
E2E_Evaluator_importmap 264510 ns 219782 ns 1.20
E2E_Evaluator_jasmine 287332 ns 195317 ns 1.47
E2E_Evaluator_jsconfig 1248823 ns 920072 ns 1.36
E2E_Evaluator_jshintrc 2722389 ns 2040486 ns 1.33
E2E_Evaluator_krakend 661010 ns 402586 ns 1.64
E2E_Evaluator_lazygit 514496 ns 292269 ns 1.76
E2E_Evaluator_lerna 469527 ns 323695 ns 1.45
E2E_Evaluator_nest-cli 579222 ns 399328 ns 1.45
E2E_Evaluator_omc 119186 ns 75764 ns 1.57
E2E_Evaluator_omnisharp 1377896 ns 1002602 ns 1.37
E2E_Evaluator_openapi 41770163 ns 24939816 ns 1.67
E2E_Evaluator_pre-commit-hooks 1977206 ns 1475743 ns 1.34
E2E_Evaluator_pulumi 1869914 ns 1470116 ns 1.27
E2E_Evaluator_semantic-release 249903 ns 184556 ns 1.35
E2E_Evaluator_stale 404987 ns 260384 ns 1.56
E2E_Evaluator_stylecop 1126488 ns 769161 ns 1.46
E2E_Evaluator_tmuxinator 233093 ns 202542 ns 1.15
E2E_Evaluator_ui5 2242361 ns 1409670 ns 1.59
E2E_Evaluator_ui5-manifest 10201389 ns 7010417 ns 1.46
E2E_Evaluator_unreal-engine-uproject 1506745 ns 1097338 ns 1.37
E2E_Evaluator_users-array 2868866 ns 2083156 ns 1.38
E2E_Evaluator_vercel 960576 ns 706811 ns 1.36
E2E_Evaluator_yamllint 25888 ns 16996 ns 1.52

This comment was automatically generated by workflow using github-action-benchmark.

@jviotti
jviotti merged commit bfe658e into main Sep 23, 2026
14 checks passed
@jviotti
jviotti deleted the no-meta-convert branch September 23, 2026 15:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant