{"id":28081,"date":"2021-10-26T21:22:45","date_gmt":"2021-10-26T21:22:45","guid":{"rendered":"https:\/\/www.process.st\/templates\/noise-audit-workflow-template\/"},"modified":"2024-03-20T10:50:17","modified_gmt":"2024-03-20T10:50:17","slug":"noise-audit-workflow-template","status":"publish","type":"post","link":"https:\/\/www.process.st\/templates\/noise-audit-workflow-template\/","title":{"rendered":"Noise Audit Workflow Template"},"content":{"rendered":"\n<section id=\"intro\">\n <h2>Intro:<\/h2>\n <div class=\"image-content\">\n  <figure>\n   <a href=\"https:\/\/ps-attachments.s3.amazonaws.com\/22d06114-3909-4f17-9388-637a6057d7da\/oHp6QLaf4xu0XnqAA-ZPaQ.png\" alt=\"Intro:\" target=\"_blank\" rel=\"noopener\"> <img decoding=\"async\" loading=\"lazy\" src=\"https:\/\/ps-attachments.s3.amazonaws.com\/22d06114-3909-4f17-9388-637a6057d7da\/oHp6QLaf4xu0XnqAA-ZPaQ.png\"> <\/a><!-- No caption -->\n  <\/figure>\n <\/div>\n <div class=\"text-content\">\n  <p>System <strong>noise<\/strong>&nbsp; (or simply \"noise\") is the <strong>unwanted<\/strong> and <strong>unexpected variability<\/strong> in<strong> judgments<\/strong> that should, ideally, be identical.&nbsp;<\/p>\n  <p>Noise is an especially <strong>crucial<\/strong> concern in <strong>lottery systems<\/strong> - such as court cases, insurance claim estimates, patient diagnoses, etc. - where <strong>individuals<\/strong> with the same qualifications and knowledge are <strong>randomly assigned<\/strong> to a specific case.&nbsp;<\/p>\n  <p><strong>Noisy judgments<\/strong> can be <strong>time-consuming<\/strong>, <strong>costly<\/strong>, and have <strong>severe impacts<\/strong> on individual lives as well as organization trajectories.&nbsp;<\/p>\n  <p>Based on research by <strong>Daniel Kahneman<\/strong>, <strong>Olivier Sibony<\/strong>, and <strong>Cass R. Sunstein<\/strong>, this workflow will guide you through conducting a noise audit on your own team.&nbsp;<\/p>\n  <p>As Kahneman, et al advise, ask yourself the following question before you begin:<\/p>\n  <p class=\"style-danger\"><strong>If the results of our simulation indicate a high level of noise, will people in the company accept that there is noise in the actual judgments of the unit?<\/strong><\/p>\n  <p>If the <strong>answer<\/strong> to this question is <strong>anything but&nbsp;yes<\/strong>, the noise audit will be a <strong>waste of time<\/strong> and shouldn't be undertaken.&nbsp;<\/p>\n  <p class=\"style-success\"><strong>Source material:<\/strong> Kahneman, D., Olivier Sibony and Sunstein, C.R. (2021).&nbsp;<em>Noise: A flaw in human judgment<\/em>. New York: Little, Brown Spark.<\/p>\n <\/div>\n<\/section>\n<section id=\"enter-the-audit-details\">\n <h2>Enter the audit details<\/h2>\n <div class=\"text-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Person responsible for workflow <\/label> <input type=\"text\" placeholder=\"Something will be typed here...\" disabled class=\"form-control\">\n  <\/div>\n <\/div>\n <div class=\"email-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Contact email <\/label> <input type=\"text\" placeholder=\"Something will be typed here...\" disabled class=\"form-control\">\n  <\/div>\n <\/div>\n <div class=\"date-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Date the noise audit will begin <\/label>\n   <div class=\"date-container\">\n    <button type=\"button\" disabled class=\"btn btn-default\"> <i class=\"fa fa-calendar btn-icon\"><\/i> Date will be set here <\/button>\n   <\/div>\n  <\/div>\n <\/div>\n <div class=\"select-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Department or team being audited <\/label> <select disabled class=\"form-control\"> <option value=\"An option will be selected here\">An option will be selected here<\/option> <\/select>\n  <\/div>\n  <ul class=\"items\">\n   <li class=\"item\">\n    <div class=\"step-number-container\">\n     <div class=\"step-number\">\n      1\n     <\/div>\n    <\/div>\n    <div class=\"step-checkbox-container\">\n     <div class=\"step-checkbox\"><\/div>\n    <\/div>\n    <div class=\"item-name-static\">\n     Human Resources\n    <\/div><\/li>\n   <li class=\"item\">\n    <div class=\"step-number-container\">\n     <div class=\"step-number\">\n      2\n     <\/div>\n    <\/div>\n    <div class=\"step-checkbox-container\">\n     <div class=\"step-checkbox\"><\/div>\n    <\/div>\n    <div class=\"item-name-static\">\n     Customer Success\n    <\/div><\/li>\n   <li class=\"item\">\n    <div class=\"step-number-container\">\n     <div class=\"step-number\">\n      3\n     <\/div>\n    <\/div>\n    <div class=\"step-checkbox-container\">\n     <div class=\"step-checkbox\"><\/div>\n    <\/div>\n    <div class=\"item-name-static\">\n     Content Creation\n    <\/div><\/li>\n   <li class=\"item\">\n    <div class=\"step-number-container\">\n     <div class=\"step-number\">\n      4\n     <\/div>\n    <\/div>\n    <div class=\"step-checkbox-container\">\n     <div class=\"step-checkbox\"><\/div>\n    <\/div>\n    <div class=\"item-name-static\">\n     Product Design\n    <\/div><\/li>\n   <li class=\"item\">\n    <div class=\"step-number-container\">\n     <div class=\"step-number\">\n      5\n     <\/div>\n    <\/div>\n    <div class=\"step-checkbox-container\">\n     <div class=\"step-checkbox\"><\/div>\n    <\/div>\n    <div class=\"item-name-static\">\n     Sales\n    <\/div><\/li>\n  <\/ul>\n <\/div>\n <div class=\"text-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> What is the specific process being audited? <\/label> <input type=\"text\" placeholder=\"Something will be typed here...\" disabled class=\"form-control\">\n  <\/div>\n <\/div>\n<\/section>\n<section id=\"list-the-members-of-the-audit-team\">\n <h2>List the members of the audit team<\/h2>\n <div class=\"text-content\">\n  <p class=\"style-info\">This task contains&nbsp;<strong>conditional logic<\/strong>. If you answer yes to the first question, then you will be provided fields to enter the consultant's details. If you aren't using an external consultant, then those fields will remain hidden.<\/p>\n  <p>Learn about using conditional logic <a href=\"https:\/\/www.process.st\/help\/docs\/conditional-logic\/\" rel=\"nofollow noopener\" target=\"_blank\">here<\/a>.&nbsp;<\/p>\n <\/div>\n <div class=\"select-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Will the team include an external consultant? <\/label> <select disabled class=\"form-control\"> <option value=\"An option will be selected here\">An option will be selected here<\/option> <\/select>\n  <\/div>\n  <ul class=\"items\">\n   <li class=\"item\">\n    <div class=\"step-number-container\">\n     <div class=\"step-number\">\n      1\n     <\/div>\n    <\/div>\n    <div class=\"step-checkbox-container\">\n     <div class=\"step-checkbox\"><\/div>\n    <\/div>\n    <div class=\"item-name-static\">\n     Yes\n    <\/div><\/li>\n   <li class=\"item\">\n    <div class=\"step-number-container\">\n     <div class=\"step-number\">\n      2\n     <\/div>\n    <\/div>\n    <div class=\"step-checkbox-container\">\n     <div class=\"step-checkbox\"><\/div>\n    <\/div>\n    <div class=\"item-name-static\">\n     No\n    <\/div><\/li>\n  <\/ul>\n <\/div>\n <div class=\"text-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Consultant's name <\/label> <input type=\"text\" placeholder=\"Something will be typed here...\" disabled class=\"form-control\">\n  <\/div>\n <\/div>\n <div class=\"email-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Consultant's email <\/label> <input type=\"text\" placeholder=\"Something will be typed here...\" disabled class=\"form-control\">\n  <\/div>\n <\/div>\n <div class=\"file-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Consultancy agreement <\/label>\n   <div class=\"file-container\">\n    <button type=\"button\" disabled class=\"btn btn-default\"> <i class=\"fa fa-upload btn-icon\"><\/i> File will be uploaded here <\/button>\n   <\/div>\n  <\/div>\n <\/div>\n <div class=\"select-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Who will the audit team report to? <\/label> <select disabled class=\"form-control\"> <option value=\"An option will be selected here\">An option will be selected here<\/option> <\/select>\n  <\/div>\n  <ul class=\"items\">\n   <li class=\"item\">\n    <div class=\"step-number-container\">\n     <div class=\"step-number\">\n      1\n     <\/div>\n    <\/div>\n    <div class=\"step-checkbox-container\">\n     <div class=\"step-checkbox\"><\/div>\n    <\/div>\n    <div class=\"item-name-static\">\n     CEO\n    <\/div><\/li>\n   <li class=\"item\">\n    <div class=\"step-number-container\">\n     <div class=\"step-number\">\n      2\n     <\/div>\n    <\/div>\n    <div class=\"step-checkbox-container\">\n     <div class=\"step-checkbox\"><\/div>\n    <\/div>\n    <div class=\"item-name-static\">\n     COO\n    <\/div><\/li>\n   <li class=\"item\">\n    <div class=\"step-number-container\">\n     <div class=\"step-number\">\n      3\n     <\/div>\n    <\/div>\n    <div class=\"step-checkbox-container\">\n     <div class=\"step-checkbox\"><\/div>\n    <\/div>\n    <div class=\"item-name-static\">\n     CTO\n    <\/div><\/li>\n   <li class=\"item\">\n    <div class=\"step-number-container\">\n     <div class=\"step-number\">\n      4\n     <\/div>\n    <\/div>\n    <div class=\"step-checkbox-container\">\n     <div class=\"step-checkbox\"><\/div>\n    <\/div>\n    <div class=\"item-name-static\">\n     CFO\n    <\/div><\/li>\n   <li class=\"item\">\n    <div class=\"step-number-container\">\n     <div class=\"step-number\">\n      5\n     <\/div>\n    <\/div>\n    <div class=\"step-checkbox-container\">\n     <div class=\"step-checkbox\"><\/div>\n    <\/div>\n    <div class=\"item-name-static\">\n     Other (specify below)\n    <\/div><\/li>\n  <\/ul>\n <\/div>\n <div class=\"text-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Specify if other <\/label> <input type=\"text\" placeholder=\"Something will be typed here...\" disabled class=\"form-control\">\n  <\/div>\n <\/div>\n <div class=\"text-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Project manager's name <\/label> <input type=\"text\" placeholder=\"Something will be typed here...\" disabled class=\"form-control\">\n  <\/div>\n <\/div>\n <div class=\"email-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Project manager's email <\/label> <input type=\"text\" placeholder=\"Something will be typed here...\" disabled class=\"form-control\">\n  <\/div>\n <\/div>\n <div class=\"members-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Select who will be conducting the audit <\/label> <select disabled class=\"form-control\"> <option value=\"A member or group will be selected here\">A member or group will be selected here<\/option> <\/select>\n  <\/div>\n <\/div>\n<\/section>\n<section id=\"case-materials\">\n <h2>Case materials:<\/h2>\n <div class=\"text-content\">\n  <p class=\"style-info\"><strong>The following tasks use several features that will save you time by automating different functions.&nbsp;<\/strong><\/p>\n  <p>The <strong>file upload<\/strong> feature allows users to update documents to individual workflow runs in order to keep a record of work done.&nbsp;<\/p>\n  <p><strong>Dynamic due dates<\/strong> allow you to link deadlines to specific tasks. Deadlines will be automatically calculated based on when certain tasks are completed. Read more about dynamic due dates <a href=\"https:\/\/www.process.st\/help\/docs\/dynamic-due-dates\/\" rel=\"nofollow noopener\" target=\"_blank\">here<\/a>.&nbsp;<\/p>\n  <p><strong>Variables<\/strong> allow you to display \"variable\" information that's unique to each workflow. They act as placeholders for specific details you've entered, such as a date or email address. Learn more about using variables <a href=\"https:\/\/www.process.st\/help\/docs\/variables\/\" rel=\"nofollow noopener\" target=\"_blank\">here<\/a>.&nbsp;<\/p>\n  <p>The <strong>Send <\/strong><strong>email<\/strong><strong>&nbsp;widget<\/strong> creates <strong>pre-written emails<\/strong> within your workflows that can be sent with a <strong>click of a button<\/strong>. In this workflow,&nbsp;<strong>variables<\/strong> (date, location, email addresses, etc.) about the prelaunch meeting are <strong>automatically pre-populated<\/strong> in the email, so you don't have to worry about re-entering that information again.&nbsp;<\/p>\n  <p class=\"style-info\"><strong>Check out the video below for more details:<\/strong><\/p>\n <\/div>\n <div class=\"video-content\">\n  <div class=\"iframe-container\">\n   <iframe src=\"https:\/\/www.youtube.com\/embed\/qp06YXGEhG4?modestbranding=1&amp;showinfo=0\" frameborder=\"0\" allowfullscreen=\"true\"> <\/iframe>\n  <\/div>\n  <div class=\"description\">\n   Learn more about using email automation in your workflows!\n  <\/div>\n <\/div>\n<\/section>\n<section id=\"determine-the-criteria-for-selected-cases\">\n <h2>Determine the criteria for selected cases<\/h2>\n <div class=\"text-content\">\n  <p>Before you conduct the study, you need to <strong>outline the parameters<\/strong> that will be <strong>used to assess<\/strong> the level of noise in your department.&nbsp;<\/p>\n  <p>There are <strong>no strict criteria<\/strong> for what information the cases should include, although they should provide <strong>enough detail<\/strong> for the participants to make a <strong>reasonable judgment<\/strong>.&nbsp;<\/p>\n  <p>You may choose to provide a <strong>simplified list of details<\/strong> in hypothetical scenarios, or you may prefer to use <strong>detailed summaries<\/strong> of complex cases. You may also decide to use a <strong>combination of simplified and complex<\/strong> cases.<\/p>\n  <p>You will need to <strong>determine<\/strong> which approach will be <strong>most beneficial<\/strong> to your team.&nbsp;<\/p>\n <\/div>\n <div class=\"text-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> How many sample cases will be used? <\/label> <input type=\"text\" placeholder=\"Something will be typed here...\" disabled class=\"form-control\">\n  <\/div>\n <\/div>\n <div class=\"text-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> How much time will participants be given to assess the cases? <\/label> <input type=\"text\" placeholder=\"Something will be typed here...\" disabled class=\"form-control\">\n  <\/div>\n <\/div>\n <div class=\"select-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> What attribute will be used for assessment? <\/label> <select disabled class=\"form-control\"> <option value=\"An option will be selected here\">An option will be selected here<\/option> <\/select>\n  <\/div>\n  <ul class=\"items\">\n   <li class=\"item\">\n    <div class=\"step-number-container\">\n     <div class=\"step-number\">\n      1\n     <\/div>\n    <\/div>\n    <div class=\"step-checkbox-container\">\n     <div class=\"step-checkbox\"><\/div>\n    <\/div>\n    <div class=\"item-name-static\">\n     Projected cost\/budget\n    <\/div><\/li>\n   <li class=\"item\">\n    <div class=\"step-number-container\">\n     <div class=\"step-number\">\n      2\n     <\/div>\n    <\/div>\n    <div class=\"step-checkbox-container\">\n     <div class=\"step-checkbox\"><\/div>\n    <\/div>\n    <div class=\"item-name-static\">\n     Resource allocation percentages\n    <\/div><\/li>\n   <li class=\"item\">\n    <div class=\"step-number-container\">\n     <div class=\"step-number\">\n      3\n     <\/div>\n    <\/div>\n    <div class=\"step-checkbox-container\">\n     <div class=\"step-checkbox\"><\/div>\n    <\/div>\n    <div class=\"item-name-static\">\n     Expected timeline\/labor cost\n    <\/div><\/li>\n   <li class=\"item\">\n    <div class=\"step-number-container\">\n     <div class=\"step-number\">\n      4\n     <\/div>\n    <\/div>\n    <div class=\"step-checkbox-container\">\n     <div class=\"step-checkbox\"><\/div>\n    <\/div>\n    <div class=\"item-name-static\">\n     Predicted ROI\n    <\/div><\/li>\n  <\/ul>\n <\/div>\n <div class=\"text-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> What percentage of judgment variability is acceptable? <\/label> <input type=\"text\" placeholder=\"Something will be typed here...\" disabled class=\"form-control\">\n  <\/div>\n <\/div>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Describe the results you expect to find. <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n <div class=\"file-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Upload the sample cases <\/label>\n   <div class=\"file-container\">\n    <button type=\"button\" disabled class=\"btn btn-default\"> <i class=\"fa fa-upload btn-icon\"><\/i> File will be uploaded here <\/button>\n   <\/div>\n  <\/div>\n <\/div>\n<\/section>\n<section id=\"prepare-the-case-questionnaire\">\n <h2>Prepare the case questionnaire<\/h2>\n <div class=\"text-content\">\n  <p>You should prepare a <strong>questionnaire<\/strong> for <strong>each case<\/strong> the participants will assess. The <strong>purpose<\/strong> of this questionnaire is to provide <strong>deeper insight<\/strong> into the <strong>decision-making process<\/strong> that led to each participant's <strong>final judgment<\/strong>.<\/p>\n  <p class=\"style-danger\"><strong>The questionnaires should only be administered once all cases have been judged.<\/strong><\/p>\n  <p>The questionnaire should include the following:<\/p>\n  <ol>\n   <li>Open questions about what factors led to the participant making the judgment.<\/li>\n   <li>A section for the participant to rank key facts of the case in order of importance (to the participant).<\/li>\n   <li>Estimates of how the case in question relates to others in the same category. For example, in assessing an insurance claim, the participant should estimate how much below or above the average claim amount that case is.&nbsp;<\/li>\n  <\/ol>\n <\/div>\n <div class=\"file-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Upload the questionnaire draft <\/label>\n   <div class=\"file-container\">\n    <button type=\"button\" disabled class=\"btn btn-default\"> <i class=\"fa fa-upload btn-icon\"><\/i> File will be uploaded here <\/button>\n   <\/div>\n  <\/div>\n <\/div>\n<\/section>\n<section id=\"schedule-the-prelaunch-meeting\">\n <h2>Schedule the prelaunch meeting<\/h2>\n <div class=\"text-content\">\n  <p><strong>Before beginning<\/strong> the study, you need to hold a <strong>prelaunch meetin<\/strong>g with your organization's leadership.<\/p>\n  <p>As the <strong>project manager<\/strong>, you will need to <strong>present<\/strong> your audit <strong>strategy and plan<\/strong> for conducting the study to your <strong>organization's leadership<\/strong>.&nbsp;<\/p>\n  <p class=\"style-warning\">It's important that you're <strong>prepared to discuss<\/strong>:<\/p>\n  <ul>\n   <li>Possible outcomes of the study, including finding unacceptable system noise.<\/li>\n   <li>Any objections to the planned study.<\/li>\n   <li>Any adjustments or improvements that need to be made to the plan.<\/li>\n   <li>Leadership's commitment to act on the results, whatever they may be.<\/li>\n  <\/ul>\n <\/div>\n <div class=\"date-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> When will the meeting take place? <\/label>\n   <div class=\"date-container\">\n    <button type=\"button\" disabled class=\"btn btn-default\"> <i class=\"fa fa-calendar btn-icon\"><\/i> Date will be set here <\/button>\n   <\/div>\n  <\/div>\n <\/div>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Where will the meeting take place? <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n <div class=\"members-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Select expected attendees <\/label> <select disabled class=\"form-control\"> <option value=\"A member or group will be selected here\">A member or group will be selected here<\/option> <\/select>\n  <\/div>\n <\/div>\n<\/section>\n<section id=\"send-meeting-invitation\">\n <h2>Send meeting invitation<\/h2>\n <div class=\"text-content\">\n  <p>Send an invitation to all meeting attendees using the <a href=\"https:\/\/www.process.st\/help\/docs\/getting-started-using-the-send-email-widget\/\" rel=\"nofollow noopener\" target=\"_blank\">send email widget<\/a> below.&nbsp;<\/p>\n  <p class=\"style-danger\"><strong>Remember to proof the email before sending it!<\/strong><\/p>\n <\/div>\n<\/section>\n<section id=\"prelaunch\">\n <h2>Prelaunch:<\/h2>\n <div class=\"text-content\">\n  <p class=\"style-info\">The tasks in this section utilize <strong>role assignments,<\/strong> <strong>approvals,<\/strong> and <strong>stop tasks<\/strong>.&nbsp;<\/p>\n  <p><a href=\"https:\/\/www.process.st\/help\/docs\/role-assignments\/\" rel=\"nofollow noopener\" target=\"_blank\">Role assignments<\/a> allow you to dynamically assign individuals to a task based on their roles.&nbsp;<\/p>\n  <p>In this workflow, the next task is assigned to the Project Manager. Whoever performs that role in each workflow run (regardless of whether there is a different Project Manager in each run) will be notified that they're responsible for that task.<\/p>\n  <p><a href=\"https:\/\/www.process.st\/help\/docs\/approvals\/\" rel=\"nofollow noopener\" target=\"_blank\">Approvals<\/a> let you streamline any processes that require authorization.&nbsp;<\/p>\n  <p>Once the prelaunch meeting is conducted, leadership will be notified that they need to approve the meeting's results before the study can begin.&nbsp;<\/p>\n  <p><a href=\"https:\/\/www.process.st\/help\/docs\/stop-tasks\/\" rel=\"nofollow noopener\" target=\"_blank\">Stop tasks<\/a> are an incredibly powerful tool that can be used to control the order tasks are completed within a workflow.&nbsp;<\/p>\n  <p>The <strong>stop task<\/strong> in this section prevents users from continuing the workflow until the <strong>approval task<\/strong> has been completed.&nbsp;<\/p>\n  <p class=\"style-info\"><strong>Check out the videos below for more details on approvals and stop tasks:<\/strong><\/p>\n <\/div>\n <div class=\"video-content\">\n  <div class=\"iframe-container\">\n   <iframe src=\"https:\/\/www.youtube.com\/embed\/cjPj3nLEO9k?modestbranding=1&amp;showinfo=0\" frameborder=\"0\" allowfullscreen=\"true\"> <\/iframe>\n  <\/div>\n  <div class=\"description\">\n   Learn more about using approvals in your workflows!\n  <\/div>\n <\/div>\n <div class=\"video-content\">\n  <div class=\"iframe-container\">\n   <iframe src=\"https:\/\/www.youtube.com\/embed\/L5XQMNGpyRE?modestbranding=1&amp;showinfo=0\" frameborder=\"0\" allowfullscreen=\"true\"> <\/iframe>\n  <\/div>\n  <div class=\"description\">\n   Learn more about stop tasks and enforced order within your workflows!\n  <\/div>\n <\/div>\n<\/section>\n<section id=\"conduct-the-prelaunch-meeting\">\n <h2>Conduct the prelaunch meeting<\/h2>\n <div class=\"text-content\">\n  <p class=\"style-success\"><strong>Noise Audit Pre-Launch Meeting&nbsp;<\/strong><\/p>\n  <p><strong>Date: <\/strong>{{form.When_will_the_meeting_take_place?}}<\/p>\n  <p><strong>Location: <\/strong>{{form.Where_will_the_meeting_take_place?}}<\/p>\n  <p><strong>Expected results: <\/strong>{{form.Describe_the_results_you_expect_to_find.}}<\/p>\n  <p><strong>Acceptable variability:&nbsp;<\/strong>{{form.What_percentage_of_judgment_variability_is_acceptable?}}<\/p>\n  <p><strong>Length of study:<\/strong> {{form.How_much_time_will_participants_be_given_to_assess_the_cases?}}<\/p>\n  <p><strong>Factor assessed:&nbsp;<\/strong>{{form.What_attribute_will_be_used_for_assessment?}}<\/p>\n  <p><strong>Questionnaire: <\/strong>{{form.Upload_the_questionnaire_draft}}<\/p>\n  <p><strong>Test cases:<\/strong> {{form.Upload_the_sample_cases}}<\/p>\n <\/div>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Objections to conducting the noise audit <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Request improvements to the audit procedure <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> What level of disagreement do you expect between a randomly selected pair of answers to each case? <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> What is the maximum level of disagreement that would be acceptable from a business perspective? <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> What is the estimated cost of getting an evaluation wrong in either direction (to high or low) by a specified amount (e.g., 15%)? <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n <div class=\"select-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> If the results of our simulation indicate a high level of noise, will people in the company accept that there is noise in the actual judgments of the unit? <\/label> <select disabled class=\"form-control\"> <option value=\"An option will be selected here\">An option will be selected here<\/option> <\/select>\n  <\/div>\n  <ul class=\"items\">\n   <li class=\"item\">\n    <div class=\"step-number-container\">\n     <div class=\"step-number\">\n      1\n     <\/div>\n    <\/div>\n    <div class=\"step-checkbox-container\">\n     <div class=\"step-checkbox\"><\/div>\n    <\/div>\n    <div class=\"item-name-static\">\n     Yes\n    <\/div><\/li>\n  <\/ul>\n <\/div>\n <div class=\"file-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Upload questionnaire final version <\/label>\n   <div class=\"file-container\">\n    <button type=\"button\" disabled class=\"btn btn-default\"> <i class=\"fa fa-upload btn-icon\"><\/i> File will be uploaded here <\/button>\n   <\/div>\n  <\/div>\n <\/div>\n <div class=\"file-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Upload test cases final version <\/label>\n   <div class=\"file-container\">\n    <button type=\"button\" disabled class=\"btn btn-default\"> <i class=\"fa fa-upload btn-icon\"><\/i> File will be uploaded here <\/button>\n   <\/div>\n  <\/div>\n <\/div>\n<\/section>\n<section id=\"approval\">\n <h2>Approval:<\/h2>\n <div class=\"approval-content\">\n  <div class=\"header\">\n   <div class=\"list-title\">\n    Will be submitted for approval:\n   <\/div>\n  <\/div>\n  <div class=\"approval-rule-subject-tasks-list\">\n   <ul class=\"list\">\n    <li>\n     <div class=\"approval-rule-subject-tasks-list-item\">\n      <div class=\"item\">\n       <div class=\"container\">\n        <span class=\"title\">Conduct the prelaunch meeting<\/span>\n        <div class=\"body\">\n         Will be submitted\n        <\/div>\n       <\/div>\n      <\/div>\n     <\/div><\/li>\n   <\/ul>\n  <\/div>\n <\/div>\n<\/section>\n<section id=\"study\">\n <h2>Study:<\/h2>\n<\/section>\n<section id=\"administer-questionnaire\">\n <h2>Administer questionnaire<\/h2>\n <div class=\"text-content\">\n  <p class=\"style-success\"><strong>Guidelines for administering the study<\/strong><\/p>\n  <ol>\n   <li>Do not use \"noise\" or \"noisy\" in relation to people and\/or study. \n    <ol>\n     <li>\"The organization is interested in how [<strong>decision-makers]<\/strong> reach their conclusions.\"<\/li>\n    <\/ol><\/li>\n   <li>Assure participants that their answers will be anonymized.<\/li>\n   <li>Anonymize the answers.<\/li>\n   <li>Stress that the participants will not face consequences for their answers; the purpose of the study is simply fact-finding.&nbsp;<\/li>\n   <li>An accurate audit requires 100% participation by the team\/department. Arrange for a set block of time for participants to focus on the study.<\/li>\n   <li>The assessment should be completed by all participants at the same time but not in such close physical proximity that they might influence each other's answers.<\/li>\n   <li>Participants should have access to the audit team throughout the study to answer any questions.<\/li>\n  <\/ol>\n <\/div>\n <div class=\"date-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Date study is administered <\/label>\n   <div class=\"date-container\">\n    <button type=\"button\" disabled class=\"btn btn-default\"> <i class=\"fa fa-calendar btn-icon\"><\/i> Date will be set here <\/button>\n   <\/div>\n  <\/div>\n <\/div>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Location of study <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n <div class=\"text-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Number of participants <\/label> <input type=\"text\" placeholder=\"Something will be typed here...\" disabled class=\"form-control\">\n  <\/div>\n <\/div>\n <div class=\"text-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Study duration <\/label> <input type=\"text\" placeholder=\"Something will be typed here...\" disabled class=\"form-control\">\n  <\/div>\n <\/div>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> List any absent or missing participants <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Describe the conditions during the study <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Document any additional factors <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n<\/section>\n<section id=\"compile-the-questionnaire-answers\">\n <h2>Compile the questionnaire answers<\/h2>\n <div class=\"file-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Upload the participants' anonymized answers. <\/label>\n   <div class=\"file-container\">\n    <button type=\"button\" disabled class=\"btn btn-default\"> <i class=\"fa fa-upload btn-icon\"><\/i> File will be uploaded here <\/button>\n   <\/div>\n  <\/div>\n <\/div>\n<\/section>\n<section id=\"analysis\">\n <h2>Analysis:<\/h2>\n<\/section>\n<section id=\"assess-participants-responses\">\n <h2>Assess participants' responses<\/h2>\n <div class=\"text-content\">\n  <p class=\"style-info\"><strong>Assessing the study's findings and determining any conclusions should take approximately 3 months to complete.&nbsp;<\/strong><\/p>\n <\/div>\n <div class=\"select-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Was the presence of noise detected in the study? <\/label> <select disabled class=\"form-control\"> <option value=\"An option will be selected here\">An option will be selected here<\/option> <\/select>\n  <\/div>\n  <ul class=\"items\">\n   <li class=\"item\">\n    <div class=\"step-number-container\">\n     <div class=\"step-number\">\n      1\n     <\/div>\n    <\/div>\n    <div class=\"step-checkbox-container\">\n     <div class=\"step-checkbox\"><\/div>\n    <\/div>\n    <div class=\"item-name-static\">\n     Yes\n    <\/div><\/li>\n   <li class=\"item\">\n    <div class=\"step-number-container\">\n     <div class=\"step-number\">\n      2\n     <\/div>\n    <\/div>\n    <div class=\"step-checkbox-container\">\n     <div class=\"step-checkbox\"><\/div>\n    <\/div>\n    <div class=\"item-name-static\">\n     No\n    <\/div><\/li>\n  <\/ul>\n <\/div>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Describe the level and pattern of noise present in the study. <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n <div class=\"select-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Was the presence of bias detected in the study? <\/label> <select disabled class=\"form-control\"> <option value=\"An option will be selected here\">An option will be selected here<\/option> <\/select>\n  <\/div>\n  <ul class=\"items\">\n   <li class=\"item\">\n    <div class=\"step-number-container\">\n     <div class=\"step-number\">\n      1\n     <\/div>\n    <\/div>\n    <div class=\"step-checkbox-container\">\n     <div class=\"step-checkbox\"><\/div>\n    <\/div>\n    <div class=\"item-name-static\">\n     Yes\n    <\/div><\/li>\n   <li class=\"item\">\n    <div class=\"step-number-container\">\n     <div class=\"step-number\">\n      2\n     <\/div>\n    <\/div>\n    <div class=\"step-checkbox-container\">\n     <div class=\"step-checkbox\"><\/div>\n    <\/div>\n    <div class=\"item-name-static\">\n     No\n    <\/div><\/li>\n  <\/ul>\n <\/div>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Describe which biases were present in the study. <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n <div class=\"select-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Is the noise level within the acceptable variability parameters? <\/label> <select disabled class=\"form-control\"> <option value=\"An option will be selected here\">An option will be selected here<\/option> <\/select>\n  <\/div>\n  <ul class=\"items\">\n   <li class=\"item\">\n    <div class=\"step-number-container\">\n     <div class=\"step-number\">\n      1\n     <\/div>\n    <\/div>\n    <div class=\"step-checkbox-container\">\n     <div class=\"step-checkbox\"><\/div>\n    <\/div>\n    <div class=\"item-name-static\">\n     Yes - No action needed\n    <\/div><\/li>\n   <li class=\"item\">\n    <div class=\"step-number-container\">\n     <div class=\"step-number\">\n      2\n     <\/div>\n    <\/div>\n    <div class=\"step-checkbox-container\">\n     <div class=\"step-checkbox\"><\/div>\n    <\/div>\n    <div class=\"item-name-static\">\n     Yes but we should investigate further\n    <\/div><\/li>\n   <li class=\"item\">\n    <div class=\"step-number-container\">\n     <div class=\"step-number\">\n      3\n     <\/div>\n    <\/div>\n    <div class=\"step-checkbox-container\">\n     <div class=\"step-checkbox\"><\/div>\n    <\/div>\n    <div class=\"item-name-static\">\n     No - Begin corrective action\n    <\/div><\/li>\n  <\/ul>\n <\/div>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> What variabilities are present in participants' answers? <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> What are potential causes for these variabilities? <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Additional notes and\/or factors for consideration <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n<\/section>\n<section id=\"determine-corrective-action\">\n <h2>Determine corrective action<\/h2>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> What is the identified source of judgment variability? <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> What is the identified cause of judgment variability? <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> How will this variability be resolved? <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Additional notes <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n<\/section>\n<section id=\"generate-a-report-on-the-studys-findings\">\n <h2>Generate a report on the study's findings<\/h2>\n <div class=\"text-content\">\n  <p>{{form.Was_the_presence_of_noise_detected_in_the_study?}}<\/p>\n  <p>{{form.Describe_the_level_and_pattern_of_noise_present_in_the_study.}}<\/p>\n  <p>{{form.Was_the_presence_of_bias_detected_in_the_study?}}<\/p>\n  <p>{{form.Is_the_noise_level_within_the_acceptable_variability_parameters?}}<\/p>\n  <p><\/p>\n  <p>{{form.What_is_the_identified_source_of_judgment_variability?}}<\/p>\n  <p>{{form.What_is_the_identified_cause_of_judgment_variability?}}<\/p>\n  <p>{{form.How_will_this_variability_be_resolved?}}<\/p>\n <\/div>\n <div class=\"file-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Upload full analysis here <\/label>\n   <div class=\"file-container\">\n    <button type=\"button\" disabled class=\"btn btn-default\"> <i class=\"fa fa-upload btn-icon\"><\/i> File will be uploaded here <\/button>\n   <\/div>\n  <\/div>\n <\/div>\n<\/section>\n<section id=\"approval-1\">\n <h2>Approval:<\/h2>\n <div class=\"approval-content\">\n  <div class=\"header\">\n   <div class=\"list-title\">\n    Will be submitted for approval:\n   <\/div>\n  <\/div>\n  <div class=\"approval-rule-subject-tasks-list\">\n   <ul class=\"list\">\n    <li>\n     <div class=\"approval-rule-subject-tasks-list-item\">\n      <div class=\"item\">\n       <div class=\"container\">\n        <span class=\"title\">Generate a report on the study's findings<\/span>\n        <div class=\"body\">\n         Will be submitted\n        <\/div>\n       <\/div>\n      <\/div>\n     <\/div><\/li>\n   <\/ul>\n  <\/div>\n <\/div>\n<\/section>\n<section id=\"conclusion\">\n <h2>Conclusion:<\/h2>\n <div class=\"text-content\">\n  <p class=\"style-info\">You can use <a href=\"https:\/\/www.process.st\/help\/docs\/automations\/\" rel=\"nofollow noopener\" target=\"_blank\">Process Street Automations<\/a> as well as <a href=\"https:\/\/www.process.st\/help\/docs\/zapier\/\" rel=\"nofollow noopener\" target=\"_blank\">Zapier integrations<\/a> to export workflow data into your other apps.&nbsp;<\/p>\n  <p>For example, you could export data into Google sheets, send a message through Slack, or even launch another workflow run.&nbsp;<\/p>\n  <p class=\"style-info\"><strong>Check out the video below for more on Automations:<\/strong><\/p>\n <\/div>\n <div class=\"video-content\">\n  <div class=\"iframe-container\">\n   <iframe src=\"https:\/\/www.youtube.com\/embed\/OKJCLbLiKlg?modestbranding=1&amp;showinfo=0\" frameborder=\"0\" allowfullscreen=\"true\"> <\/iframe>\n  <\/div>\n  <div class=\"description\">\n   Learn more about using Automations in your workflows!\n  <\/div>\n <\/div>\n<\/section>\n<section id=\"review-the-audit-process\">\n <h2>Review the audit process<\/h2>\n <div class=\"text-content\">\n  <p>Use this task to assess the audit process itself, record any factors that impacted the audit, and what changes should be made for future audits.&nbsp;<\/p>\n <\/div>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> What went well? <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> What obstacles were encountered? <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> How can the audit process be improved? <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Additional observations <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n<\/section>\n<section id=\"complete-the-audit\">\n <h2>Complete the audit<\/h2>\n <div class=\"text-content\">\n  <p class=\"style-success\"><strong>Congrats! You're almost done!<\/strong><\/p>\n  <p>All that's left to do is fill in the final details and set the date for the next noise audit for your team.&nbsp;<\/p>\n  <p class=\"style-warning\"><strong>Remember:<\/strong> You can use Automations to trigger your next audit's workflow to run on the correct date!<\/p>\n <\/div>\n <div class=\"date-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Date audit workflow completed <\/label>\n   <div class=\"date-container\">\n    <button type=\"button\" disabled class=\"btn btn-default\"> <i class=\"fa fa-calendar btn-icon\"><\/i> Date will be set here <\/button>\n   <\/div>\n  <\/div>\n <\/div>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Action items for reducing noise <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n <div class=\"textarea-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Timeline for completing action items <\/label> <textarea placeholder=\"Something will be typed here...\" rows=\"3\" disabled class=\"form-control\"><\/textarea>\n  <\/div>\n <\/div>\n <div class=\"date-field-content form-field-content\">\n  <div class=\"form-group\">\n   <label> Date of the next noise audit <\/label>\n   <div class=\"date-container\">\n    <button type=\"button\" disabled class=\"btn btn-default\"> <i class=\"fa fa-calendar btn-icon\"><\/i> Date will be set here <\/button>\n   <\/div>\n  <\/div>\n <\/div>\n<\/section>\n<section id=\"sources\">\n <h2>Sources:<\/h2>\n <div class=\"text-content\">\n  <p><strong>Source material<\/strong><\/p>\n  <p>Goodman, B. (2021).<a href=\"https:\/\/www.barrons.com\/articles\/economist-daniel-kahneman-says-noise-is-wrecking-your-judgment-heres-why-and-what-to-do-about-it-51622228892\" rel=\"nofollow noopener\" target=\"_blank\"> \"<\/a><a href=\"https:\/\/www.barrons.com\/articles\/economist-daniel-kahneman-says-noise-is-wrecking-your-judgment-heres-why-and-what-to-do-about-it-51622228892\" rel=\"nofollow noopener\" target=\"_blank\">Daniel Kahneman Says Noise Is Wrecking Your Judgment. Here\u2019s Why, and What to Do About It\"<\/a>.&nbsp;<em><a href=\"https:\/\/www.barrons.com\/\" rel=\"nofollow noopener\" target=\"_blank\">Barron's Magazine<\/a>.<\/em><\/p>\n  <p>\u200cKahneman, D., Sibony, O. and Sunstein, C.R. (2021). <a href=\"https:\/\/www.nytimes.com\/2021\/05\/15\/opinion\/noise-bias-kahneman.html\" rel=\"nofollow noopener\" target=\"_blank\">\"Bias Is a Big Problem. But So Is 'Noise'.\"&nbsp;<\/a><a href=\"https:\/\/www.nytimes.com\/\" rel=\"nofollow noopener\" target=\"_blank\"><em>The New York Times<\/em><\/a>.<\/p>\n  <p>Kahneman, D., Sibony, O. and Sunstein, C.R. (2021). <em>Noise: A flaw in human judgment<\/em>. New York: Little, Brown Spark.<\/p>\n  <p>Kahneman, D., Rosenfield, A.M., Gandhi, L. and Blaser, T. (2016). <a href=\"https:\/\/hbr.org\/2016\/10\/noise\" rel=\"nofollow noopener\" target=\"_blank\">\"<\/a><a href=\"https:\/\/hbr.org\/2016\/10\/noise\" rel=\"nofollow noopener\" target=\"_blank\">Noise: How to Overcome the High, Hidden Cost of Inconsistent Decision Making<\/a><a href=\"https:\/\/hbr.org\/2016\/10\/noise\" rel=\"nofollow noopener\" target=\"_blank\">.\"<\/a> <a href=\"https:\/\/hbr.org\/\" rel=\"nofollow noopener\" target=\"_blank\"><em>Harvard Business Review<\/em><\/a>.&nbsp;<\/p>\n  <p>Kotsonis, S., Change, J. and Chakrabarti, M. (2021). <a href=\"https:\/\/www.wbur.org\/onpoint\/2021\/06\/01\/cutting-through-the-noise-to-explore-human-judgement\" rel=\"nofollow noopener\" target=\"_blank\">\"How To Cut Through The \u201cNoise\u201d That Hinders Human Judgment.\"<\/a> <a href=\"https:\/\/www.wbur.org\/\" rel=\"nofollow noopener\" target=\"_blank\">WBUR<\/a>.<\/p>\n  <p>Matias, J.N. (2017). <a href=\"https:\/\/natematias.medium.com\/bias-and-noise-daniel-kahneman-onerrors-in-decision-making-6bc844ff5194\" rel=\"nofollow noopener\" target=\"_blank\">\"<\/a><a href=\"https:\/\/natematias.medium.com\/bias-and-noise-daniel-kahneman-onerrors-in-decision-making-6bc844ff5194\" rel=\"nofollow noopener\" target=\"_blank\">Bias and Noise: Daniel Kahneman on Errors in Decision-Making<\/a><a href=\"https:\/\/natematias.medium.com\/bias-and-noise-daniel-kahneman-onerrors-in-decision-making-6bc844ff5194\" rel=\"nofollow noopener\" target=\"_blank\">.\"<\/a>&nbsp;<em><a href=\"https:\/\/natematias.medium.com\/\" rel=\"nofollow noopener\" target=\"_blank\">J. Nathan Matias<\/a>.<\/em><\/p>\n  <p>McCulloch, A. (2021).&nbsp;<a href=\"https:\/\/www.personneltoday.com\/hr\/daniel-kahneman-noise-gillian-tett-decisions\/\" rel=\"nofollow noopener\" target=\"_blank\">\"Daniel Kahneman: how \u201cnoise\u201d damages decisions\"<\/a>.&nbsp;<em><a href=\"https:\/\/www.personneltoday.com\/\" rel=\"nofollow noopener\" target=\"_blank\">Personnel Today<\/a>.<\/em><\/p>\n  <p>Nesterak, E. (2021). <a href=\"https:\/\/behavioralscientist.org\/a-conversation-with-daniel-kahneman-about-noise\/\" rel=\"nofollow noopener\" target=\"_blank\">\"A Conversation with Daniel Kahneman About 'Noise'.\"<\/a> <em><a href=\"https:\/\/behavioralscientist.org\/\" rel=\"nofollow noopener\" target=\"_blank\">Behavioral Scientist<\/a>.<\/em><\/p>\n  <p>Newell, B. (2021). <a href=\"https:\/\/theconversation.com\/daniel-kahneman-on-noise-the-flaw-in-human-judgement-harder-to-detect-than-cognitive-bias-160525\" rel=\"nofollow noopener\" target=\"_blank\">\"Daniel Kahneman on 'noise' \u2013 the flaw in human judgement harder to detect than cognitive bias.\"<\/a> <a href=\"https:\/\/theconversation.com\/\" rel=\"nofollow noopener\" target=\"_blank\"><em>The Conversation<\/em><\/a>.&nbsp;<\/p>\n  <p><\/p>\n <\/div>\n<\/section>\n<section id=\"related-workflows\">\n <h2>Related Workflows:<\/h2>\n <div class=\"text-content\">\n  <p><strong>Related workflows<\/strong><\/p>\n  <ul>\n   <li><a href=\"https:\/\/www.process.st\/checklist\/adkar-model-change-management-process-checklist\/\" rel=\"nofollow noopener\" target=\"_blank\">ADKAR Model Change Management Process Checklist<\/a><\/li>\n   <li><a href=\"https:\/\/www.process.st\/checklist\/bridges-transition-model-process-checklist\/\" rel=\"nofollow noopener\" target=\"_blank\">Bridges Transition Model Process Checklist<\/a><\/li>\n   <li><a href=\"https:\/\/www.process.st\/checklist\/daci-decision-making-meeting-framework-checklist\/\" rel=\"nofollow noopener\" target=\"_blank\">DACI Decision-Making Meeting Framework Checklist<\/a><\/li>\n   <li><a href=\"https:\/\/www.process.st\/checklist\/fmea-template-failure-mode-and-effects-analysis\/\" rel=\"nofollow noopener\" target=\"_blank\">FMEA Template: Failure Mode and Effects Analysis<\/a><\/li>\n   <li><a href=\"https:\/\/www.process.st\/checklist\/kotters-change-management-model-process-checklist\/\" rel=\"nofollow noopener\" target=\"_blank\">Kotter\u2019s Change Management Model Process Checklist<\/a><\/li>\n   <li><a href=\"https:\/\/www.process.st\/checklist\/kubler-ross-change-curve-process-checklist\/\" rel=\"nofollow noopener\" target=\"_blank\">Kubler-Ross Change Curve Process Checklist<\/a><\/li>\n   <li><a href=\"https:\/\/www.process.st\/checklist\/lewins-change-management-model-process-checklist\/\" rel=\"nofollow noopener\" target=\"_blank\">Lewin\u2019s Change Management Model Process Checklist<\/a><\/li>\n   <li>\n    <p><a href=\"https:\/\/www.process.st\/checklist\/mckinsey-7-s-model-checklist-process\/\" rel=\"nofollow noopener\" target=\"_blank\">McKinsey 7-S Model Checklist Process<\/a><\/p><\/li>\n   <li><a href=\"https:\/\/www.process.st\/checklist\/nudge-theory-change-management-model-process-checklist\/\" rel=\"nofollow noopener\" target=\"_blank\">Nudge Theory Change Management Model Process Checklist<\/a><\/li>\n   <li><a href=\"https:\/\/www.process.st\/checklist\/the-process-for-optimizing-a-process\/\" rel=\"nofollow noopener\" target=\"_blank\">Process for Improving a Process<\/a><\/li>\n   <li><a href=\"https:\/\/www.process.st\/checklist\/prioritization-matrix-checklist-template\/\" rel=\"nofollow noopener\" target=\"_blank\">Prioritization Matrix Checklist Template<\/a><\/li>\n   <li><a href=\"https:\/\/www.process.st\/checklist\/satir-change-management-model-process-checklist\/\/\" rel=\"nofollow noopener\" target=\"_blank\">Satir Change Management Model Process Checklist<\/a><\/li>\n   <li><a href=\"https:\/\/www.process.st\/checklist\/standard-operating-procedure-sop-template-structure\/\" rel=\"nofollow noopener\" target=\"_blank\">Standard Operating Procedure (SOP) Template Structure<\/a><\/li>\n   <li><a href=\"https:\/\/www.process.st\/checklist\/swot-analysis-template\/\" rel=\"nofollow noopener\" target=\"_blank\">SWOT Analysis Template<\/a><\/li>\n   <li><a href=\"https:\/\/www.process.st\/checklist\/unconscious-bias-training\/\" rel=\"nofollow noopener\" target=\"_blank\">Unconscious Bias Training Guide<\/a><\/li>\n  <\/ul>\n <\/div>\n<\/section>\n","protected":false},"excerpt":{"rendered":"<p>Intro: System noise&nbsp; (or simply \"noise\") is the unwanted and unexpected variability in judgments that should, ideally, be identical.&nbsp; Noise is an especially crucial concern in lottery systems - such as court cases, insurance claim estimates, patient diagnoses, etc. - where individuals with the same qualifications and knowledge are randomly assigned to a specific case.&nbsp; [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":28082,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"ep_exclude_from_search":false,"cover_icon_emoji":"\ud83d\udd0a","cover_icon_url":"","tasks_count":"24","template_description":"Use this workflow to determine the level of noise occurring within your decision-making framework.","template_id":"uLayVZtNkABz78xaOHlFxw","task_0":"Intro:","task_slug_0":"intro","task_1":"Enter the audit details","task_slug_1":"enter-the-audit-details","task_2":"List the members of the audit team","task_slug_2":"list-the-members-of-the-audit-team","task_3":"Case materials:","task_slug_3":"case-materials","task_4":"Determine the criteria for selected cases","task_slug_4":"determine-the-criteria-for-selected-cases","task_5":"Prepare the case questionnaire","task_slug_5":"prepare-the-case-questionnaire","task_6":"Schedule the prelaunch meeting","task_slug_6":"schedule-the-prelaunch-meeting","task_7":"Send meeting invitation","task_slug_7":"send-meeting-invitation","task_8":"Prelaunch:","task_slug_8":"prelaunch","task_9":"Conduct the prelaunch meeting","task_slug_9":"conduct-the-prelaunch-meeting","task_10":"Approval: ","task_slug_10":"approval","task_11":"Study:","task_slug_11":"study","task_12":"Administer questionnaire","task_slug_12":"administer-questionnaire","task_13":"Compile the questionnaire answers","task_slug_13":"compile-the-questionnaire-answers","task_14":"Analysis:","task_slug_14":"analysis","task_15":"Assess participants' responses","task_slug_15":"assess-participants-responses","task_16":"Determine corrective action","task_slug_16":"determine-corrective-action","task_17":"Generate a report on the study's findings","task_slug_17":"generate-a-report-on-the-studys-findings","task_18":"Approval: ","task_slug_18":"approval-1","task_19":"Conclusion:","task_slug_19":"conclusion","task_20":"Review the audit process","task_slug_20":"review-the-audit-process","task_21":"Complete the audit","task_slug_21":"complete-the-audit","task_22":"Sources:","task_slug_22":"sources","task_23":"Related Workflows:","task_slug_23":"related-workflows","task_24":"","task_slug_24":"","task_25":"","task_slug_25":"","task_26":"","task_slug_26":"","task_27":"","task_slug_27":"","task_28":"","task_slug_28":"","task_29":"","task_slug_29":"","task_30":"","task_slug_30":"","task_31":"","task_slug_31":"","task_32":"","task_slug_32":"","task_33":"","task_slug_33":"","task_34":"","task_slug_34":"","task_35":"","task_slug_35":"","task_36":"","task_slug_36":"","task_37":"","task_slug_37":"","task_38":"","task_slug_38":"","task_39":"","task_slug_39":"","task_40":"","task_slug_40":"","task_41":"","task_slug_41":"","task_42":"","task_slug_42":"","task_43":"","task_slug_43":"","task_44":"","task_slug_44":"","task_45":"","task_slug_45":"","task_46":"","task_slug_46":"","task_47":"","task_slug_47":"","task_48":"","task_slug_48":"","task_49":"","task_slug_49":"","task_50":"","task_slug_50":"","task_51":"","task_slug_51":"","task_52":"","task_slug_52":"","task_53":"","task_slug_53":"","task_54":"","task_slug_54":"","task_55":"","task_slug_55":"","task_56":"","task_slug_56":"","task_57":"","task_slug_57":"","task_58":"","task_slug_58":"","task_59":"","task_slug_59":"","task_60":"","task_slug_60":"","task_61":"","task_slug_61":"","task_62":"","task_slug_62":"","task_63":"","task_slug_63":"","task_64":"","task_slug_64":"","task_65":"","task_slug_65":"","task_66":"","task_slug_66":"","task_67":"","task_slug_67":"","task_68":"","task_slug_68":"","task_69":"","task_slug_69":"","task_70":"","task_slug_70":"","task_71":"","task_slug_71":"","task_72":"","task_slug_72":"","task_73":"","task_slug_73":"","task_74":"","task_slug_74":"","task_75":"","task_slug_75":"","task_76":"","task_slug_76":"","task_77":"","task_slug_77":"","task_78":"","task_slug_78":"","task_79":"","task_slug_79":"","task_80":"","task_slug_80":"","task_81":"","task_slug_81":"","task_82":"","task_slug_82":"","task_83":"","task_slug_83":"","task_84":"","task_slug_84":"","task_85":"","task_slug_85":"","task_86":"","task_slug_86":"","task_87":"","task_slug_87":"","task_88":"","task_slug_88":"","task_89":"","task_slug_89":"","task_90":"","task_slug_90":"","task_91":"","task_slug_91":"","task_92":"","task_slug_92":"","task_93":"","task_slug_93":"","task_94":"","task_slug_94":"","task_95":"","task_slug_95":"","task_96":"","task_slug_96":"","task_97":"","task_slug_97":"","task_98":"","task_slug_98":"","task_99":"","task_slug_99":"","footnotes":""},"categories":[8,5,6,12,52,7,15,23,38,34],"tags":[],"class_list":["post-28081","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-content-marketing","category-featured","category-finance","category-human-resources","category-management-system","category-miscellaneous","category-office-administration","category-operations","category-quality-management","category-sales"],"acf":[],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.process.st\/templates\/wp-json\/wp\/v2\/posts\/28081","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.process.st\/templates\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.process.st\/templates\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.process.st\/templates\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.process.st\/templates\/wp-json\/wp\/v2\/comments?post=28081"}],"version-history":[{"count":0,"href":"https:\/\/www.process.st\/templates\/wp-json\/wp\/v2\/posts\/28081\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.process.st\/templates\/wp-json\/wp\/v2\/media\/28082"}],"wp:attachment":[{"href":"https:\/\/www.process.st\/templates\/wp-json\/wp\/v2\/media?parent=28081"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.process.st\/templates\/wp-json\/wp\/v2\/categories?post=28081"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.process.st\/templates\/wp-json\/wp\/v2\/tags?post=28081"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}