{"id":591,"date":"2020-09-22T02:29:23","date_gmt":"2020-09-22T02:29:23","guid":{"rendered":"https:\/\/support.divominer.com\/en\/index.php\/docs\/divominer-user-manual-2\/reliability-test\/reliability-calculation\/"},"modified":"2021-11-11T06:33:41","modified_gmt":"2021-11-11T06:33:41","slug":"reliability-calculation","status":"publish","type":"docs","link":"https:\/\/support.divominer.com\/en\/docs\/divominer-user-manual\/reliability-test\/reliability-calculation\/","title":{"rendered":"Reliability calculation"},"content":{"rendered":"<p><span lang=\"EN-US\">After precoding, click &#8220;Reliability calculation&#8221; to check the\u00a0reliability between coders overall\u00a0and on specific categories. The reliability coefficient is calculated to observe whether different coders have reached an acceptable level of agreement with a consistent coding scheme. If the desired reliability level is not reached, coders need to be trained and instructed again to ensure the desired level of reliability. After that, you can start formal coding. In the following reliability test results, the Composite Reliability represents the overall reliability results of all categories. Click &#8220;+&#8221; to view the reliability results of specific options under each category.<\/span><\/p>\n<p><span lang=\"EN-US\">The platform currently provides four commonly used reliability test formulas: Holsti\u2019s Coefficient, Cohen\u2019s Kappa (k), Scott\u2019s Pi, and Krippendorff\u2019s alpha. The application of the formula greatly improves the authority of the reliability test. The platform can directly check the inter-coder reliability on each category question, convenient for coding correction and supervision.<\/span><\/p>\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" width=\"1024\" height=\"390\" src=\"https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/4-2-1024x390.png\" alt=\"\" class=\"wp-image-8402\" srcset=\"https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/4-2-1024x390.png 1024w, https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/4-2-300x114.png 300w, https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/4-2-768x293.png 768w, https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/4-2-50x19.png 50w, https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/4-2-920x351.png 920w, https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/4-2-600x229.png 600w, https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/4-2-320x122.png 320w, https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/4-2.png 1338w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<p><span lang=\"EN-US\">After coding, if you want to view the coding result of each coder, click &#8220;Export Testing Data&#8221; to download the coding results of the coder.<\/span><\/p>\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" width=\"1024\" height=\"476\" src=\"https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/5-3-1024x476.png\" alt=\"\" class=\"wp-image-8403\" srcset=\"https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/5-3-1024x476.png 1024w, https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/5-3-300x139.png 300w, https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/5-3-768x357.png 768w, https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/5-3-50x23.png 50w, https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/5-3-920x428.png 920w, https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/5-3-600x279.png 600w, https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/5-3-320x149.png 320w, https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/5-3.png 1340w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<p><span lang=\"EN-US\">If you want to evaluate the accuracy of machine coding results, click &#8220;Update machine code reliability test results&#8221;, then compare the machine coding results with the manual coding results.<\/span><\/p>\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" width=\"1024\" height=\"429\" src=\"https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/6-3-1024x429.png\" alt=\"\" class=\"wp-image-8404\" srcset=\"https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/6-3-1024x429.png 1024w, https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/6-3-300x126.png 300w, https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/6-3-768x322.png 768w, https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/6-3-50x21.png 50w, https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/6-3-920x386.png 920w, https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/6-3-600x251.png 600w, https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/6-3-320x134.png 320w, https:\/\/support.divominer.com\/en\/wp-content\/uploads\/2021\/11\/6-3.png 1334w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n","protected":false},"featured_media":0,"parent":563,"menu_order":1,"comment_status":"open","ping_status":"closed","template":"","doc_tag":[],"_links":{"self":[{"href":"https:\/\/support.divominer.com\/en\/wp-json\/wp\/v2\/docs\/591"}],"collection":[{"href":"https:\/\/support.divominer.com\/en\/wp-json\/wp\/v2\/docs"}],"about":[{"href":"https:\/\/support.divominer.com\/en\/wp-json\/wp\/v2\/types\/docs"}],"replies":[{"embeddable":true,"href":"https:\/\/support.divominer.com\/en\/wp-json\/wp\/v2\/comments?post=591"}],"version-history":[{"count":36,"href":"https:\/\/support.divominer.com\/en\/wp-json\/wp\/v2\/docs\/591\/revisions"}],"predecessor-version":[{"id":8900,"href":"https:\/\/support.divominer.com\/en\/wp-json\/wp\/v2\/docs\/591\/revisions\/8900"}],"up":[{"embeddable":true,"href":"https:\/\/support.divominer.com\/en\/wp-json\/wp\/v2\/docs\/563"}],"next":[{"title":"Coding tracking","link":"https:\/\/support.divominer.com\/en\/docs\/divominer-user-manual\/reliability-test\/code-tracking\/","href":"https:\/\/support.divominer.com\/en\/wp-json\/wp\/v2\/docs\/593"}],"prev":[{"title":"Coding test","link":"https:\/\/support.divominer.com\/en\/docs\/divominer-user-manual\/reliability-test\/coding-test\/","href":"https:\/\/support.divominer.com\/en\/wp-json\/wp\/v2\/docs\/589"}],"wp:attachment":[{"href":"https:\/\/support.divominer.com\/en\/wp-json\/wp\/v2\/media?parent=591"}],"wp:term":[{"taxonomy":"doc_tag","embeddable":true,"href":"https:\/\/support.divominer.com\/en\/wp-json\/wp\/v2\/doc_tag?post=591"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}