Skip to content

Fix typos #76

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
rosscutler wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Fix typos #76

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions docs/conf_master.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ following message next time they want to perform a HIT from this group:
* `allowed_max_hit_in_project:60`: Number of assignments that one worker can perform from this project.
* `hit_base_payment:0.5`: Base payment for an accepted assignment from this HIT. This value will be used as information.
* `quantity_hits_more_than: 30`: Defines the necessary hits required for quantity bonus.
* `quantity_bonus: 0.1`: The amount of the quantity bonus to be payed for each accepted assignment.
* `quantity_bonus: 0.1`: The amount of the quantity bonus to be paid for each accepted assignment.
* `quality_top_percentage: 20`: Defines when quality bonus should be applied (in addition, participant should be
eligible for quantity bonus).
* `quality_bonus: 0.15`: the amount of the quality bonus per accepted assignment.
Expand All @@ -57,7 +57,7 @@ following message next time they want to perform a HIT from this group:
* `allowed_max_hit_in_project:60`: Number of assignments that one worker can perform from this project.
* `hit_base_payment:0.5`: Base payment for an accepted assignment from this HIT. This value will be used as information.
* `quantity_hits_more_than: 30`: Defines the necessary hits required for quantity bonus.
* `quantity_bonus: 0.1`: The amount of the quantity bonus to be payed for each accepted assignment.
* `quantity_bonus: 0.1`: The amount of the quantity bonus to be paid for each accepted assignment.
* `quality_top_percentage: 20`: Defines when quality bonus should be applied (in addition, participant should be
eligible for quantity bonus).
* `quality_bonus: 0.15`: the amount of the quality bonus per accepted assignment.
Expand All @@ -76,7 +76,7 @@ following message next time they want to perform a HIT from this group:
* `allowed_max_hit_in_project:60`: Number of assignments that one worker can perform from this project.
* `hit_base_payment:0.5`: Base payment for an accepted assignment from this HIT. This value will be used as information.
* `quantity_hits_more_than: 30`: Defines when quantity bonus requirement.
* `quantity_bonus: 0.1`: the amount of the quantity bonus to be payed for each accepted assignment.
* `quantity_bonus: 0.1`: the amount of the quantity bonus to be paid for each accepted assignment.
* `quality_top_percentage: 20`: Defines when quality bonus should be applied (in addition, participant should be
eligible for quantity bonus).
* `quality_bonus: 0.15`: the amount of the quality bonus per accepted assignment.
4 changes: 2 additions & 2 deletions docs/prep_p804.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ column named `rating_clips` (see [rating_clips.csv](../src/test_inputs/rating_cl

**Note on Reference Conditions**
* It is strongly recommended to include Reference Conditions in your study to cover the entire range of MOS on all
dimesions.
dimensions.

1. Upload your **training clips** in a cloud server and create `training_gold_clips.csv` file which contains all URLs in a
column named `training_clips` (see [training_gold_clips.csv](../src/test_inputs/training_gold_clips_p804.csv) as an example).
Expand All @@ -35,7 +35,7 @@ any given answer for that dimension will be considered to be correct.
**Hint**: Gold standard clips are used as a hidden quality control item in each session. It is expected that their
answers are so obvious for all participants that they all give the `*_ans` rating (+/- 1 deviation is
accepted) for all dimensions. It is recommended to use clips with excellent (answer 5) or very bad
(answer 1) quality. Also clips with extreme and oposite value for multiple dimensions works best (e.g. Coloration 5 and Discontinuty 1).
(answer 1) quality. Also clips with extreme and opposite value for multiple dimensions work best (e.g. Coloration 5 and Discontinuity 1).

1. Create trapping stimuli set for your dataset.

Expand Down
2 changes: 1 addition & 1 deletion docs/prep_p835.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ column named `rating_clips` (see [rating_clips.csv](../src/test_inputs/rating_cl

**Note on Reference Conditions**
* It is strongly recommended to include Reference Conditions in your study to cover the entire range of MOS on all
three scales. Results of our studies showed that Reference Conditions based on teh ITU-T Rec. P.835 does not cover
three scales. Results of our studies showed that Reference Conditions based on the ITU-T Rec. P.835 do not cover
the entire range of scales, rather the framework propose in ETSI 103 281 Annex D can cover the entire range. We
recommend to use [3gpp_p501_FB](../p835_reference_conditions/3gpp_p501_FB) which is created base on the ETSI/3GPP framework.

Expand Down
2 changes: 1 addition & 1 deletion src/P808Template/ACR_template.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1231,7 +1231,7 @@ <h3 class="panel-title">
</div>
</fieldset>

<fieldset class="qualificationFieldset"><label>8.&nbsp; I belive, ...</label>
<fieldset class="qualificationFieldset"><label>8.&nbsp; I believe, ...</label>
<div class="radio">
<label><input type="radio" name="8_hearing" value="normal" required="">I have a normal hearing ability.</label>
</div>
Expand Down
4 changes: 2 additions & 2 deletions src/P808Template/CCR_template.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -477,7 +477,7 @@
}

/*
Remove the answers for all pair-comparision questions in the setup section.
Remove the answers for all pair-comparison questions in the setup section.
*/
function makeAllCMPsUnChecked(){
// remove the listeners
Expand Down Expand Up @@ -1455,7 +1455,7 @@ <h3 class="panel-title">
</div>
</fieldset>

<fieldset class="qualificationFieldset"><label>8.&nbsp; I belive, ...</label>
<fieldset class="qualificationFieldset"><label>8.&nbsp; I believe, ...</label>
<div class="radio">
<label><input type="radio" name="8_hearing" value="normal" required="">I have a normal hearing ability.</label>
</div>
Expand Down
2 changes: 1 addition & 1 deletion src/P808Template/DCR_template.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1160,7 +1160,7 @@ <h3 class="panel-title">
</div>
</fieldset>

<fieldset class="qualificationFieldset"><label>8.&nbsp; I belive, ...</label>
<fieldset class="qualificationFieldset"><label>8.&nbsp; I believe, ...</label>
<div class="radio">
<label><input type="radio" name="8_hearing" value="normal" required="">I have a normal hearing ability.</label>
</div>
Expand Down
34 changes: 17 additions & 17 deletions src/P808Template/P808_multi.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -494,7 +494,7 @@
}

let gold_stat = getGoldQuestionStat();
console.log("gold_stat:"+ gold_stat['failed'] +"warining:" + gold_stat['warning_showed'] );
console.log("gold_stat:"+ gold_stat['failed'] +"warning:" + gold_stat['warning_showed'] );
let force_re_training = false;
if (gold_stat['failed']>= config['goldClip']['n_fail_block']) {
disableTheHIT(Hide_HIT_REASON.GOLD_FAILED);
Expand Down Expand Up @@ -834,7 +834,7 @@
}

function checkGoldQCorrect(given_ans, accepted_var, correct_hash, url) {
// return true if correct_hash is null or its lenght after trim is 0
// return true if correct_hash is null or its length after trim is 0
if (!correct_hash || correct_hash.trim().length == 0)
return true;

Expand Down Expand Up @@ -1239,7 +1239,7 @@


/**
* Check is the givebn url belongs to a trapping questionin training section, If so returns its info, otherwise null-
* Check is the givebn url belongs to a trapping question in training section, If so returns its info, otherwise null-
* @param {*} element
**/
function getGoldQuestionInTrainingInfo(url){
Expand Down Expand Up @@ -1471,7 +1471,7 @@
return;

stat = getGoldQuestionStat();
console.log('current stat: faild '+stat['failed']+ ', sum: '+stat['sum']);
console.log('current stat: failed '+stat['failed']+ ', sum: '+stat['sum']);
is_correct = true;
// check the answers
if ( !checkGoldQCorrect(Number(given_ans), 1, ans, goldClipAns["url"])){
Expand Down Expand Up @@ -1502,7 +1502,7 @@
}
}
saveGoldQuestionStat(stat);
console.log('new stat: faild '+stat['failed']+ ', sum: '+stat['sum']);
console.log('new stat: failed '+stat['failed']+ ', sum: '+stat['sum']);
}

/*
Expand All @@ -1524,7 +1524,7 @@
return;

stat = getGoldQuestionStat();
//console.log('current stat: faild '+stat['failed']+ ', sum: '+stat['sum']);
//console.log('current stat: failed '+stat['failed']+ ', sum: '+stat['sum']);
is_correct = true;
// check the answers
if ( !checkGoldQCorrect(Number(given_ans), 1, ans, goldClipAns["url"])){
Expand Down Expand Up @@ -1556,7 +1556,7 @@
}
}
saveGoldQuestionStat(stat);
//console.log('new stat: faild '+stat['failed']+ ', sum: '+stat['sum']);
//console.log('new stat: failed '+stat['failed']+ ', sum: '+stat['sum']);
}

/*
Expand Down Expand Up @@ -1866,7 +1866,7 @@
</div>

<input type="range" min="1" max="5" step="1" value="0" class="slider_hide" id="T{0}-discontinuity-slider" name="t{0}_slide_disc" list="tickmarks" required>
<label for="discontinous" class="pull-left">Continuous</label>
<label for="discontinuous" class="pull-left">Continuous</label>
<label for="" class="pull-right">Discontinuous</label>
</div></br></br></br>`;

Expand All @@ -1887,7 +1887,7 @@
</tr>
</tbody>
</table>
<label for="discontinous" class="pull-left">Continuous</label>
<label for="discontinuous" class="pull-left">Continuous</label>
<label for="" class="pull-right">Discontinuous</label>
</div>
<div class="row">
Expand Down Expand Up @@ -2161,7 +2161,7 @@
}
/*
Generate the training section
lod, rev, col, dis
loud, rev, col, dis

*/
function generate_training_section() {
Expand Down Expand Up @@ -2599,7 +2599,7 @@
</script>


<!-- gold question warining -->
<!-- gold question warning -->
<section class="container" id="gold_warning" hidden>
<div class="alert alert-danger" role="alert">
<h5><b>Warning</b></h5>
Expand All @@ -2614,7 +2614,7 @@ <h5><b>Warning</b></h5>
<p>

<div class="checkbox">
<label><input type="checkbox" value="warining" onchange="gold_warning()">I read this message carefully and understand it.</label>
<label><input type="checkbox" value="warning" onchange="gold_warning()">I read this message carefully and understand it.</label>
</div>

</p>
Expand Down Expand Up @@ -2656,7 +2656,7 @@ <h3 class="panel-title">
<li><b>Qualification (just once):</b> Check if you are eligible to perform these HITs</li>
<li><b>Setup (every <b class="setup_time"> 0</b> minutes):</b> Configure your system and validate it
by answering 6 questions</li>
<li><b>Detailed instuction (only once):</b> 12 audio samples, and description of scale. It is crucial to understand what you should do.</li>
<li><b>Detailed instruction (only once):</b> 12 audio samples, and description of scale. It is crucial to understand what you should do.</li>
<li><b>Training (every <b class="training_time"> 0 </b> hour):</b> <b
class="question_number_training"> 0 </b> questions, same as "Ratings" but appears again after <b class="training_time"> 0 </b> hour from the last HIT you perform in this group.
<li><b>Rating:</b> Listen to <b class="question_number"> 0 </b> audio files and give <b>your opinion
Expand Down Expand Up @@ -2798,7 +2798,7 @@ <h3 class="panel-title">
</div>
</fieldset>

<fieldset class="qualificationFieldset"><label>6.&nbsp; I belive, ...</label>
<fieldset class="qualificationFieldset"><label>6.&nbsp; I believe, ...</label>
<div class="radio">
<label><input type="radio" name="8_hearing" value="normal" required="">I have a normal
hearing ability.</label>
Expand Down Expand Up @@ -3325,8 +3325,8 @@ <h4>Scales and examples:</h4>

<div class="alert alert-warning" role="alert">
<h4>Attention:</h4>
<p>You may hear an specific instruction in the speech sample starting by <b>"This is an interruption"</b> aksing you to select the scores
showsing the <b>best</b> or the <b>worst</b> quality. In that case follow the instruction to show your attention, <u>otherwise your submision will be rejected</u>.</p>
<p>You may hear an specific instruction in the speech sample starting by <b>"This is an interruption"</b> asking you to select the scores
showsing the <b>best</b> or the <b>worst</b> quality. In that case follow the instruction to show your attention, <u>otherwise your submission will be rejected</u>.</p>
<p> Scores showing the <b>best</b> quality are: <b>Not noisy, Optimal loudness, Continuous, Uncolored, No reverb, Not distorted, and Excellent quality. </b></p>
<p> Scores showing the <b>worst</b> quality are: <b>Noisy, Sub-optimal loudness, Discontinuous, Colored, High reverb, Very distorted, and Bad quality.</b></p>
<p>
Expand Down Expand Up @@ -3509,7 +3509,7 @@ <h2>Well done! </h2> You performed the maximum number of HITs that you were allo
<section class="container" id="gold_rejected" hidden>
<p>The QA system recognized that you provided a wrong answer to multiple clips that their answers are known to us.
To avoid more of your submissions potentially get rejected, no more HITs from this job is available for you until we check them.
For any upcomming job, please carefully read the instruction and follow it. <u>The instruction can change from one job to the other.</u>
For any upcoming job, please carefully read the instruction and follow it. <u>The instruction can change from one job to the other.</u>
</p>

<div class="alert alert-danger" role="alert">
Expand Down
2 changes: 1 addition & 1 deletion src/P808Template/P831_ACR_template.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1159,7 +1159,7 @@ <h3 class="panel-title">
</div>
</fieldset>

<fieldset class="qualificationFieldset"><label>8.&nbsp; I belive, ...</label>
<fieldset class="qualificationFieldset"><label>8.&nbsp; I believe, ...</label>
<div class="radio">
<label><input type="radio" name="8_hearing" value="normal" required="">I have a normal hearing ability.</label>
</div>
Expand Down
2 changes: 1 addition & 1 deletion src/P808Template/P831_DCR_template.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1090,7 +1090,7 @@ <h3 class="panel-title">
</div>
</fieldset>

<fieldset class="qualificationFieldset"><label>8.&nbsp; I belive, ...</label>
<fieldset class="qualificationFieldset"><label>8.&nbsp; I believe, ...</label>
<div class="radio">
<label><input type="radio" name="8_hearing" value="normal" required="">I have a normal hearing ability.</label>
</div>
Expand Down
16 changes: 8 additions & 8 deletions src/P808Template/P835_personalized_template3.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -320,8 +320,8 @@
}

let gold_stat = getGoldQuestionStat();
console.log("gold_stat:"+ gold_stat['failed'] +"warining:" + gold_stat['warning_showed'] );
cookie_debug_status = cookie_debug_status + "gold_stat"+ gold_stat['failed'] +",warining:" + gold_stat['warning_showed'] + "*";
console.log("gold_stat:"+ gold_stat['failed'] +"warning:" + gold_stat['warning_showed'] );
cookie_debug_status = cookie_debug_status + "gold_stat"+ gold_stat['failed'] +",warning:" + gold_stat['warning_showed'] + "*";
let force_re_training = false;
if (gold_stat['failed']>= config['goldClip']['n_fail_block']) {
disableTheHIT(Hide_HIT_REASON.GOLD_FAILED);
Expand Down Expand Up @@ -954,7 +954,7 @@
}

/**
* Check is the givebn url belongs to a trapping questionin training section, If so returns its info, otherwise null-
* Check is the givebn url belongs to a trapping question in training section, If so returns its info, otherwise null-
* @param {*} element
**/
function getGoldQuestionInTrainingInfo(url){
Expand Down Expand Up @@ -1746,7 +1746,7 @@
</script>


<!-- gold question warining -->
<!-- gold question warning -->
<section class="container" id="gold_warning" hidden>
<div class="alert alert-danger" role="alert">
<h5><b>Warning</b></h5>
Expand Down Expand Up @@ -1934,7 +1934,7 @@ <h3 class="panel-title">
</div>
</fieldset>

<fieldset class="qualificationFieldset"><label>6.&nbsp; I belive, ...</label>
<fieldset class="qualificationFieldset"><label>6.&nbsp; I believe, ...</label>
<div class="radio">
<label><input type="radio" name="8_hearing" value="normal" required="">I have a normal
hearing ability.</label>
Expand Down Expand Up @@ -2436,13 +2436,13 @@ <h4>Important examples:</h4>
data-src="https://audiosamplesp808.blob.core.windows.net/p808-assets/clips/personalized_p835/example2.wav">&nbsp;</span>
</p>

<p> <b>Example 3:</b></p><p> The <b>speech signal</b> of target speaker is completly removed from judgment segment (<b>very distorted, score1 </b>). Although in judgment segment there is no background noise, but
<p> <b>Example 3:</b></p><p> The <b>speech signal</b> of target speaker is completely removed from judgment segment (<b>very distorted, score1 </b>). Although in judgment segment there is no background noise, but
voice of another person. It is considered as a <b> very intrusive background (score 1)</b>. The <b>overall quality is Bad (score 1)</b> as the system failed to recognize the target speaker and filter her out in the judgement segment.</p>
<p align="center"> <span class="baudio" id="exml3" data-onfinished="train_samples_finished"
data-src="https://audiosamplesp808.blob.core.windows.net/p808-assets/clips/personalized_p835/example3.wav">&nbsp;</span>
</p>

<p> <b>Example 4:</b></p><p> The <b>speech signal</b> of target speaker is completly removed from judgment segment (<b>very distorted, score1 </b>). The judgment segment doesnot contain any voice but <b>slightly noticeable (score 4)</b> background noise. The <b>overall quality is Bad (score 1)</b> as the system completly removed target speaker from the judgement segment.</p>
<p> <b>Example 4:</b></p><p> The <b>speech signal</b> of target speaker is completely removed from judgment segment (<b>very distorted, score1 </b>). The judgment segment does not contain any voice but <b>slightly noticeable (score 4)</b> background noise. The <b>overall quality is Bad (score 1)</b> as the system completely removed target speaker from the judgement segment.</p>
<p align="center"> <span class="baudio" id="exml4" data-onfinished="train_samples_finished"
data-src="https://audiosamplesp808.blob.core.windows.net/p808-assets/clips/personalized_p835/example4.wav">&nbsp;</span>
</p>
Expand Down Expand Up @@ -2601,7 +2601,7 @@ <h2>Well done! </h2> You performed the maximum number of HITs that you were allo
<section class="container" id="gold_rejected" hidden>
<p>The QA system recognized that you provided a wrong answer to multiple clips that their answers are known to us.
To avoid more of your submissions potentially get rejected, no more HITs from this job is available for you until we check them.
For any upcomming job, please carefully read the instruction and follow it. <u>The instruction can change from one job to the other.</u>
For any upcoming job, please carefully read the instruction and follow it. <u>The instruction can change from one job to the other.</u>
</p>

<div class="alert alert-danger" role="alert">
Expand Down
Loading