{"id":2926,"date":"2022-09-14T07:33:01","date_gmt":"2022-09-14T11:33:01","guid":{"rendered":"https:\/\/linguix.com\/blog\/?p=2926"},"modified":"2024-10-07T15:53:30","modified_gmt":"2024-10-07T19:53:30","slug":"linguix-vs-grammarly-the-results-of-grammar-checking-benchmarking-analysis","status":"publish","type":"post","link":"https:\/\/linguix.com\/blog\/linguix-vs-grammarly-the-results-of-grammar-checking-benchmarking-analysis\/","title":{"rendered":"Linguix vs. Grammarly: the Results of Grammar Checking Benchmarking Analysis"},"content":{"rendered":"\n<p>The Linguix team has recently conducted benchmarking tests that evaluated the performance of the grammar checking software, <a href=\"https:\/\/publishergrowth.com\/blog-details\/7-best-ai-content-writing-tools-for-bloggers\">Linguix<\/a> and Grammarly.\u00a0<\/p>\n\n\n\n<p>For these purposes, we used two datasets containing 1515 sentences in English with both grammar mistakes and correct sentences. To be precise, there were several thousands of grammar mistakes to detect in total.&nbsp;<\/p>\n\n\n\n<p>Below are the performance comparison results of premium versions of both Linguix and Grammarly.<\/p>\n\n\n\n<h1 class=\"wp-block-heading\" id=\"h-linguix-vs-grammarly-which-one-detected-more-mistakes\">Linguix vs. Grammarly: which one detected more mistakes<\/h1>\n\n\n\n<p>When we analyzed performance based on single tokens (i.e. words with mistakes), Linguix found almost as many mistakes (1554) as Grammarly (1571).<\/p><\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh6.googleusercontent.com\/u-bCIHmb7nd2nl5UXtK-F6cu57zqXTQmYtV5ynhk9wa8N0zKZ6Gg3X28b9F0XzbruhsEDRC2724keIxQhoB1UEm_QTlaWgdcoB4YHltbp9D0XUkjwsw0falCv1bLansQw9QbsGniZduDpSqRBpCEyL1qIHaUuzdUANBo2SFspcKxFuNqTfTRcD6XHQ\" alt=\"\"\/><\/figure>\n\n\n\n<p>When it comes to token spans (i.e. incorrect phrases), Linguix identified 1275 mistakes, while Grammarly found 1361.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh3.googleusercontent.com\/Fn6NDq_nhnJ_aPEJZaVxdNegoKTxjSNhtchPA2fAaCkQD_viSn0WaqBjW6T9q8_rqASbxxi2NwEcf_Gn3L1CKZKOxJRwlBiBiQ-bkBVmtxDVlJuT-7GtdOVBGcI0aHT-y1N9e3PZVjMg09r-0oob-iJnsEcVLCsF5N6c552aa3ERn3NDwpqVG65Pgw\" alt=\"\"\/><\/figure>\n\n\n\n<p>We first measured the quality of grammar checking for our custom dataset. In this case, Linguix achieved an overall accuracy of 72%, while Grammarly demonstrated 76% accuracy:<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh5.googleusercontent.com\/5TQfNi7E1lx8aQzu8ZOMxpjfqmSXsrG0J-NhTwPmnY65YC3jXuOL_iFJZdqV0Y328_20awy0v8a0Z1zrsb_NDHAIYAgei8oLObUBT79jsl19rcFEkoFy5S5KZdbgFxBMGyZakE9uy6IY_qpZUspHnFdWuLpTiH6U33nBlKNEU6rQ6oVXrHPgTxYUHA\" alt=\"\"\/><\/figure>\n\n\n\n<p>Then we took a publicly available dataset (BEA). This time Linguix showed an accuracy of 61%, while Grammarly\u2019s accuracy level was just about 45%:<\/p><\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh3.googleusercontent.com\/dvXpq7ZbW_EGGJiVa-oe77ujpLK10wpD_Ni7iQ3Rp0k1_nuiW7Q9cCPSx97yM0wnEJoc2oOmtR8hUPvgoIKblcu9XkPhukEXQA0juYgBR0arLywb_VwSdt1ssw1M8Jg7YYWB9MDORt_F9NHmM6WfUV4PjOlhF6q4DHsLFidD7GcEWIDy5T1FidLmWg\" alt=\"\"\/><\/figure>\n\n\n\n<h1 class=\"wp-block-heading\" id=\"h-linguix-s-progress\">Linguix\u2019s progress<\/h1>\n\n\n\n<p>We are constantly working on improving our grammar-checking model quality. For the period starting from March 2020 till August 2022, the quality of identifying both words with mistakes and incorrect phrases has significantly increased:<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh3.googleusercontent.com\/XJhzXPwngQ-4_f0g3ENB6ftD2FgkQD4jK7CY0tpwed2WzzrbanFmNetadKmUvmZ05cl24lfC5S2JauDQj7zFcyl40PqntoXY0uuqr0gM1THwd3V1-HwvqdjADPGdzlFOONUZ1-GB1FgE2WYmLyX_a4wjjH8__xBKxgJIdsO63uZi0b6ZicZKMxp_zw\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh5.googleusercontent.com\/9KSWc5GMbl5n6aEhB3KzUNLfrmwLnayGx8A3-y44aCCd5LpnPtWfmOtcwCwUrLTZD6PKO7zOEdrxj4SyNLDVWWEsFiNq7UHiL1YqfsBUKvQbTaKh5qiMxuabLSFtfSS53jDNmWISAjF9abm4GvFcldnzmRvUfwKZwwN9N9Atkt4LCghY8OaerX8MFw\" alt=\"\"\/><\/figure>\n\n\n\n<p>According to our analysis, the difference between grammar-checking quality when using Linguix and Grammarly is almost unnoticeable.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The Linguix team has recently conducted benchmarking tests that evaluated the performance of the grammar checking software, Linguix and Grammarly.\u00a0 For these purposes, we used two datasets containing 1515 sentences in English with both grammar mistakes and correct sentences. To be precise, there were several thousands of grammar mistakes to detect in total.&nbsp; Below are [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":2928,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":"","_links_to":"","_links_to_target":""},"categories":[10,483,817,9],"tags":[471,15,12],"class_list":["post-2926","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-grammar","category-product","category-research","category-writing","tag-english","tag-grammar","tag-writing"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v20.8 (Yoast SEO v24.8.1) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Linguix vs. Grammarly: the Results of Grammar Checking Benchmarking Analysis - Linguix Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/linguix.com\/blog\/linguix-vs-grammarly-the-results-of-grammar-checking-benchmarking-analysis\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Linguix vs. Grammarly: the Results of Grammar Checking Benchmarking Analysis\" \/>\n<meta property=\"og:description\" content=\"The Linguix team has recently conducted benchmarking tests that evaluated the performance of the grammar checking software, Linguix and Grammarly.\u00a0 For these purposes, we used two datasets containing 1515 sentences in English with both grammar mistakes and correct sentences. To be precise, there were several thousands of grammar mistakes to detect in total.&nbsp; Below are [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/linguix.com\/blog\/linguix-vs-grammarly-the-results-of-grammar-checking-benchmarking-analysis\/\" \/>\n<meta property=\"og:site_name\" content=\"Linguix Blog\" \/>\n<meta property=\"article:author\" content=\"alex\" \/>\n<meta property=\"article:published_time\" content=\"2022-09-14T11:33:01+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-10-07T19:53:30+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/linguix.com\/blog\/wp-content\/uploads\/2022\/09\/report.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1720\" \/>\n\t<meta property=\"og:image:height\" content=\"1200\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Alex\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Alex\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/linguix.com\/blog\/linguix-vs-grammarly-the-results-of-grammar-checking-benchmarking-analysis\/\",\"url\":\"https:\/\/linguix.com\/blog\/linguix-vs-grammarly-the-results-of-grammar-checking-benchmarking-analysis\/\",\"name\":\"Linguix vs. Grammarly: the Results of Grammar Checking Benchmarking Analysis - Linguix Blog\",\"isPartOf\":{\"@id\":\"https:\/\/linguix.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/linguix.com\/blog\/linguix-vs-grammarly-the-results-of-grammar-checking-benchmarking-analysis\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/linguix.com\/blog\/linguix-vs-grammarly-the-results-of-grammar-checking-benchmarking-analysis\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/linguix.com\/blog\/wp-content\/uploads\/2022\/09\/report.png\",\"datePublished\":\"2022-09-14T11:33:01+00:00\",\"dateModified\":\"2024-10-07T19:53:30+00:00\",\"author\":{\"@id\":\"https:\/\/linguix.com\/blog\/#\/schema\/person\/ea7597fd80a4c2a8f55eb54be35a2293\"},\"breadcrumb\":{\"@id\":\"https:\/\/linguix.com\/blog\/linguix-vs-grammarly-the-results-of-grammar-checking-benchmarking-analysis\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/linguix.com\/blog\/linguix-vs-grammarly-the-results-of-grammar-checking-benchmarking-analysis\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/linguix.com\/blog\/linguix-vs-grammarly-the-results-of-grammar-checking-benchmarking-analysis\/#primaryimage\",\"url\":\"https:\/\/linguix.com\/blog\/wp-content\/uploads\/2022\/09\/report.png\",\"contentUrl\":\"https:\/\/linguix.com\/blog\/wp-content\/uploads\/2022\/09\/report.png\",\"width\":1720,\"height\":1200,\"caption\":\"Linguix vs. Grammarly: the Results of Grammar Checking Benchmarking Analysis\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/linguix.com\/blog\/linguix-vs-grammarly-the-results-of-grammar-checking-benchmarking-analysis\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/linguix.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Linguix vs. Grammarly: the Results of Grammar Checking Benchmarking Analysis\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/linguix.com\/blog\/#website\",\"url\":\"https:\/\/linguix.com\/blog\/\",\"name\":\"Linguix Blog\",\"description\":\"Writing about using technology to create content and build effective communications.\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/linguix.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/linguix.com\/blog\/#\/schema\/person\/ea7597fd80a4c2a8f55eb54be35a2293\",\"name\":\"Alex\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/linguix.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/linguix.com\/blog\/wp-content\/uploads\/2022\/04\/team-lashkov2-96x96.jpg\",\"contentUrl\":\"https:\/\/linguix.com\/blog\/wp-content\/uploads\/2022\/04\/team-lashkov2-96x96.jpg\",\"caption\":\"Alex\"},\"description\":\"Linguix.com co-founder\",\"sameAs\":[\"https:\/\/twitter.com\/alexlashkov\",\"alex\"],\"url\":\"https:\/\/linguix.com\/blog\/author\/alex\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Linguix vs. Grammarly: the Results of Grammar Checking Benchmarking Analysis - Linguix Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/linguix.com\/blog\/linguix-vs-grammarly-the-results-of-grammar-checking-benchmarking-analysis\/","og_locale":"en_US","og_type":"article","og_title":"Linguix vs. Grammarly: the Results of Grammar Checking Benchmarking Analysis","og_description":"The Linguix team has recently conducted benchmarking tests that evaluated the performance of the grammar checking software, Linguix and Grammarly.\u00a0 For these purposes, we used two datasets containing 1515 sentences in English with both grammar mistakes and correct sentences. To be precise, there were several thousands of grammar mistakes to detect in total.&nbsp; Below are [&hellip;]","og_url":"https:\/\/linguix.com\/blog\/linguix-vs-grammarly-the-results-of-grammar-checking-benchmarking-analysis\/","og_site_name":"Linguix Blog","article_author":"alex","article_published_time":"2022-09-14T11:33:01+00:00","article_modified_time":"2024-10-07T19:53:30+00:00","og_image":[{"width":1720,"height":1200,"url":"https:\/\/linguix.com\/blog\/wp-content\/uploads\/2022\/09\/report.png","type":"image\/png"}],"author":"Alex","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Alex","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/linguix.com\/blog\/linguix-vs-grammarly-the-results-of-grammar-checking-benchmarking-analysis\/","url":"https:\/\/linguix.com\/blog\/linguix-vs-grammarly-the-results-of-grammar-checking-benchmarking-analysis\/","name":"Linguix vs. Grammarly: the Results of Grammar Checking Benchmarking Analysis - Linguix Blog","isPartOf":{"@id":"https:\/\/linguix.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/linguix.com\/blog\/linguix-vs-grammarly-the-results-of-grammar-checking-benchmarking-analysis\/#primaryimage"},"image":{"@id":"https:\/\/linguix.com\/blog\/linguix-vs-grammarly-the-results-of-grammar-checking-benchmarking-analysis\/#primaryimage"},"thumbnailUrl":"https:\/\/linguix.com\/blog\/wp-content\/uploads\/2022\/09\/report.png","datePublished":"2022-09-14T11:33:01+00:00","dateModified":"2024-10-07T19:53:30+00:00","author":{"@id":"https:\/\/linguix.com\/blog\/#\/schema\/person\/ea7597fd80a4c2a8f55eb54be35a2293"},"breadcrumb":{"@id":"https:\/\/linguix.com\/blog\/linguix-vs-grammarly-the-results-of-grammar-checking-benchmarking-analysis\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/linguix.com\/blog\/linguix-vs-grammarly-the-results-of-grammar-checking-benchmarking-analysis\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/linguix.com\/blog\/linguix-vs-grammarly-the-results-of-grammar-checking-benchmarking-analysis\/#primaryimage","url":"https:\/\/linguix.com\/blog\/wp-content\/uploads\/2022\/09\/report.png","contentUrl":"https:\/\/linguix.com\/blog\/wp-content\/uploads\/2022\/09\/report.png","width":1720,"height":1200,"caption":"Linguix vs. Grammarly: the Results of Grammar Checking Benchmarking Analysis"},{"@type":"BreadcrumbList","@id":"https:\/\/linguix.com\/blog\/linguix-vs-grammarly-the-results-of-grammar-checking-benchmarking-analysis\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/linguix.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Linguix vs. Grammarly: the Results of Grammar Checking Benchmarking Analysis"}]},{"@type":"WebSite","@id":"https:\/\/linguix.com\/blog\/#website","url":"https:\/\/linguix.com\/blog\/","name":"Linguix Blog","description":"Writing about using technology to create content and build effective communications.","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/linguix.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/linguix.com\/blog\/#\/schema\/person\/ea7597fd80a4c2a8f55eb54be35a2293","name":"Alex","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/linguix.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/linguix.com\/blog\/wp-content\/uploads\/2022\/04\/team-lashkov2-96x96.jpg","contentUrl":"https:\/\/linguix.com\/blog\/wp-content\/uploads\/2022\/04\/team-lashkov2-96x96.jpg","caption":"Alex"},"description":"Linguix.com co-founder","sameAs":["https:\/\/twitter.com\/alexlashkov","alex"],"url":"https:\/\/linguix.com\/blog\/author\/alex\/"}]}},"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/linguix.com\/blog\/wp-json\/wp\/v2\/posts\/2926","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/linguix.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/linguix.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/linguix.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/linguix.com\/blog\/wp-json\/wp\/v2\/comments?post=2926"}],"version-history":[{"count":2,"href":"https:\/\/linguix.com\/blog\/wp-json\/wp\/v2\/posts\/2926\/revisions"}],"predecessor-version":[{"id":3350,"href":"https:\/\/linguix.com\/blog\/wp-json\/wp\/v2\/posts\/2926\/revisions\/3350"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/linguix.com\/blog\/wp-json\/wp\/v2\/media\/2928"}],"wp:attachment":[{"href":"https:\/\/linguix.com\/blog\/wp-json\/wp\/v2\/media?parent=2926"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/linguix.com\/blog\/wp-json\/wp\/v2\/categories?post=2926"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/linguix.com\/blog\/wp-json\/wp\/v2\/tags?post=2926"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}