- •Releasing Tasks
- •Introduction to Page Quality Rating
- •Understanding Webpages and Websites
- •Important Definitions
- •What is the Purpose of a Webpage?
- •Your Money or Your Life (ymyl) Pages
- •Understanding Webpage Content
- •2.4.1 Identifying the Main Content (mc)
- •2.4.3 Identifying Advertisements/Monetization (Ads)
- •2.4.2 Identifying the Supplementary Content (sc)
- •2.4.4 Summary of the Parts of the Page
- •Understanding the Website
- •2.5.1 Finding the Homepage
- •2.5.2 Finding Who is Responsible for the Website and Who Created the Content on the Page
- •2.5.3 Finding About Us, Contact Information, and Customer Service Information
- •Website Maintenance
- •Website Reputation
- •2.7.1 Reputation Research
- •2.7.2 Sources of Reputation Information
- •2.7.3 Customer Reviews of Stores/Businesses
- •2.7.4 How to Search for Reputation Information
- •2.7.5 What to Do When You Find No Reputation Information
- •Overall Page Quality Rating Scale
- •High Quality Pages
- •Characteristics of High Quality Pages
- •A Satisfying Amount of High Quality Main Content
- •A High Level of Expertise/Authoritativeness/Trustworthiness (e-a-t)
- •Positive Reputation
- •Helpful Supplementary Content
- •Functional Page Design
- •A Satisfying Amount of Website Information
- •A Well Cared For and Maintained Website
- •Examples of High Quality Pages
- •Highest Quality Pages
- •Very High Quality mc
- •Very High Level of e-a-t
- •Very Positive Reputation
- •Examples of Highest Quality Pages
- •6.0 Low Quality Pages
- •Low Quality Main Content
- •Unsatisfying Amount of Main Content
- •Lacking Expertise, Authoritativeness, or Trustworthiness (e-a-t)
- •Negative Reputation
- •Characteristics Which May Be Evidence of Low Quality
- •6.5.1 Unhelpful or Distracting Supplementary Content
- •6.5.2 Lacking Supplementary Content
- •6.5.3 Poor Page Design
- •6.5.4 Lacking Care and Maintenance
- •Unsatisfying Amount of Information about the Website
- •Examples of Low Quality Pages
- •7.0 Lowest Quality Pages
- •Harmful or Malicious Pages
- •Lack of Purpose Pages
- •Deceptive Pages
- •7.3.1 Deceptive Page Purpose
- •7.3.2 Deceptive Page Design
- •7.3.3 Sneaky Redirects
- •Lowest Quality Main Content
- •7.4.1 No Main Content
- •7.4.2 “Keyword Stuffed” Main Content
- •7.4.3 Gibberish or Meaningless Main Content
- •7.4.4 Automatically-Generated Main Content
- •7.4.5 Copied Main Content
- •7.4.6 More About Copied Content
- •7.4.7 How to Determine if Content is Copied
- •No Website Information
- •Highly Untrustworthy, Unreliable, Unauthoritative, Inaccurate, or Misleading
- •Abandoned Websites or Spammed Pages on a Website
- •Extremely Negative or Malicious Reputation
- •Examples of Lowest Quality Pages
- •8.0 Medium Quality Pages
- •Examples of Medium Quality Pages
- •9.0 Page Quality Rating: Important Considerations
- •Instructions for Rating Page Quality Tasks
- •The Top Three pq Considerations
- •Page Quality Considerations for Specific Types of Pages
- •Ratings for Encyclopedia Pages
- •Ratings for Pages with Error Messages or No mc
- •Ratings for Forums and q&a pages
- •Page Quality Rating faQs
- •Understanding Mobile Users, Mobile Queries, and Mobile Results
- •Important Rating Definitions and Ideas
- •Understanding the Query
- •Task Location (Locale) and User Location
- •Queries with an Explicit Location
- •Queries with Multiple Meanings
- •Query Meanings Can Change Over Time
- •Understanding User Intent
- •Know and Know Simple Queries
- •Do and Device Action Queries
- •Website Queries
- •Visit-in-Person Queries and User Location
- •Queries with Multiple User Intents
- •Understanding Result Blocks
- •Web Search Result Block Examples
- •Special Content Result Block Examples
- •Device Action Result Block Examples
- •How Device Action Results are Displayed in Rating Tasks
- •Rating Using the Needs Met Scale
- •Rating on Your Phone Issues
- •Rating Result Blocks: Block Content and Landing Pages
- •Fully Meets (FullyM)
- •Examples of Fully Meets (FullyM) Result Blocks
- •Examples of Result Blocks that Cannot be Fully Meets
- •Highly Meets (hm)
- •Examples of Highly Meets (hm) Result Blocks
- •Moderately Meets (mm)
- •Examples of Moderately Meets (mm) Result Blocks
- •Slightly Meets (sm)
- •Examples of Slightly Meets (sm) Result Blocks
- •Fails to Meet (FailsM)
- •Examples of Fails to Meet (FailsM) Result Blocks
- •14.0 Rating Porn, Foreign Language, Didn’t Load, and Hard to Use Results
- •Porn Flag
- •Needs Met Rating for Porn Results
- •Needs Met Rating for Clear Non-Porn Intent Queries
- •Needs Met Rating for Possible Porn Intent Queries
- •Needs Met Rating for Clear Porn Intent Queries
- •Reporting Illegal Images
- •Foreign Language Flag
- •14.4.1 Using the Foreign Language Flag
- •14.4.2 Needs Met Ratings for Foreign Language Results
- •14.4.3 English Language Results
- •Didn’t Load Flag
- •14.5.1 Using the Didn’t Load Flag
- •14.5.2 Needs Met Rating for Didn’t Load Results
- •Hard to Use Flag
- •14.6.1 Using the Hard to Use Flag
- •The Relationship between e-a-t and Needs Met
- •Rating Queries with Multiple Interpretations and Intents
- •Rating Queries with Both Website and Visit-in-Person Intent
- •Specificity of Queries and Landing Pages
- •Needs Met Rating and Freshness
- •Misspelled and Mistyped Queries and Results
- •Misspelled and Mistyped Queries
- •19.2 Name Queries
- •19.3 Spelling Suggestion Result Blocks
- •21.0 Product Queries: Action (Do) vs. Information (Know) Intent
- •22.0 Rating Visit-in-Person Intent Queries
- •26.0 Needs Met Task Page Screenshot
- •27.0 Notes about Using the Needs Met Rating Interface
- •28.0 Using the “Report a Problem / Release this Task” Button
- •29.0 Reporting Results with Duplicate Landing Pages
- •Rater-Identified Duplicates
26.0 Needs Met Task Page Screenshot
Proprietary and Confidential – Copyright 2015 153
The red numbers represent the following:
rater@gmail.com
Your Gmail account.
Recent tasks
Click this link to revisit tasks completed in the last few minutes.
Sign out
Click this link to end your rating session.
Mobile
This text indicates that the current task belongs to the Mobile property type. Other properties you may rate include Web, Video, Image, etc.
Experimental
This text indicates that the current task belongs to the Experimental project type. Other project types you may rate include Result Review, Side-by-Side, etc.
Average Estimated Time
This text indicates the average estimated time for completion of the task.
Instructions
Click this tab to view the project-specific instructions. Some tasks display project-specific instructions on the task page instead of behind the Instructions tab.
Query
You should understand the query before rating the task.
Locale
This refers to the task location and task language associated with the query.
Report a Problem / Release this Task
Click this link to report a problem and/or release the task.
User Location
This refers to where the user is located when the query is issued. Note that if there is no user location listed, there will be no user location-related map displayed in the rating task. In this case, the task could still show a map if one of the results has a response pin.
Response Pin
This is a marker for a visit-in-person place.
Approximate User Location
This area represents the approximate location of the user when the query is issued.
Needs Met Rating Slider
Use this rating slider to assign a Needs Met rating.
Porn Flag
Assign this flag if it applies to the result.
Foreign Language Flag
Assign this flag if it applies to the result.
Didn’t Load Flag
Assign this flag if it applies to the result.
Hard to Use Flag
Assign this flag if it applies to the result.
Proprietary and Confidential – Copyright 2015 154
Comment
Use the result block comment box to write comments that will be helpful to you when assigning ratings. Note: All comments must be written in English.
Special Content Result Block
This result block shows content directly in the block.
Result with Response Pin
The response pin in this result indicates the location of the corresponding response pin on the map.
Web Search Result Block
Click the block to visit the landing page.
Dupe Confirmation Checkbox
Check this box to confirm that you are done flagging duplicate results.
Submit
Use this button to submit the task and continue rating.
Submit and Stop Rating
Use this button to submit the task and stop rating.
Cancel
Use this button to cancel any ratings you have assigned in the task.
26.1 Understanding the User Location on the Task Page
While most tasks have a user location listed below the query, the map can also help clarify where the user was physically located when the query was issued and is more precise than the user located listed below the query.
On the map, the user location can be precise (blue dot) or approximated (blue rectangle). Here are some examples of what you might see at the top of the task:
|
|
|
A precise user location is |
|
|
Sometimes you will see |
|
||
|
|
|
|
|
|||||
|
|
|
represented by a blue |
|
|
a shaded blue circle |
|
||
|
|
|
dot ( ). |
|
|
around the blue dot. The |
|
||
|
|
|
|
|
blue dot is user’s most |
|
|||
|
|
|
|
|
|
|
|||
|
|
|
|
|
|
likely location, but it is |
|
||
|
|
|
|
|
|
possible they are located |
|
||
|
|
|
|
|
|
anywhere within the |
|
||
|
|
|
|
|
|
larger shaded blue |
|
||
|
|
|
|
|
|
region. |
|
||
|
|
|
|
|
|
|
|
||
|
|
|
|
|
|
|
|
|
|
|
|
|
The approximate user |
|
|
The map includes a |
|
||
|
|
|
|
|
|
||||
|
|
|
location is shown as a |
|
|
response pin, which is a |
|
||
|
|
|
blue rectangle on the |
|
|
marker for a visit-in- |
|
||
|
|
|
map. |
|
|
person result block in |
|
||
|
|
|
|
|
|
the task. If there are |
|
||
|
|
|
|
|
|
three |
visit-in-person |
|
|
|
|
|
|
|
|
result |
blocks in the |
task, |
|
|
|
|
|
|
|
there should be three |
|
||
|
|
|
|
|
|
response pins on the |
|
||
|
|
|
|
|
|
map. |
|
||
|
|
|
|
|
|
|
|
||
|
|
|
|
|
|
|
|
|
|
|
|
|
Proprietary and Confidential – Copyright 2015 |
155 |
|
||||
