- •Releasing Tasks
- •Introduction to Page Quality Rating
- •Understanding Webpages and Websites
- •Important Definitions
- •What is the Purpose of a Webpage?
- •Your Money or Your Life (ymyl) Pages
- •Understanding Webpage Content
- •2.4.1 Identifying the Main Content (mc)
- •2.4.3 Identifying Advertisements/Monetization (Ads)
- •2.4.2 Identifying the Supplementary Content (sc)
- •2.4.4 Summary of the Parts of the Page
- •Understanding the Website
- •2.5.1 Finding the Homepage
- •2.5.2 Finding Who is Responsible for the Website and Who Created the Content on the Page
- •2.5.3 Finding About Us, Contact Information, and Customer Service Information
- •Website Maintenance
- •Website Reputation
- •2.7.1 Reputation Research
- •2.7.2 Sources of Reputation Information
- •2.7.3 Customer Reviews of Stores/Businesses
- •2.7.4 How to Search for Reputation Information
- •2.7.5 What to Do When You Find No Reputation Information
- •Overall Page Quality Rating Scale
- •High Quality Pages
- •Characteristics of High Quality Pages
- •A Satisfying Amount of High Quality Main Content
- •A High Level of Expertise/Authoritativeness/Trustworthiness (e-a-t)
- •Positive Reputation
- •Helpful Supplementary Content
- •Functional Page Design
- •A Satisfying Amount of Website Information
- •A Well Cared For and Maintained Website
- •Examples of High Quality Pages
- •Highest Quality Pages
- •Very High Quality mc
- •Very High Level of e-a-t
- •Very Positive Reputation
- •Examples of Highest Quality Pages
- •6.0 Low Quality Pages
- •Low Quality Main Content
- •Unsatisfying Amount of Main Content
- •Lacking Expertise, Authoritativeness, or Trustworthiness (e-a-t)
- •Negative Reputation
- •Characteristics Which May Be Evidence of Low Quality
- •6.5.1 Unhelpful or Distracting Supplementary Content
- •6.5.2 Lacking Supplementary Content
- •6.5.3 Poor Page Design
- •6.5.4 Lacking Care and Maintenance
- •Unsatisfying Amount of Information about the Website
- •Examples of Low Quality Pages
- •7.0 Lowest Quality Pages
- •Harmful or Malicious Pages
- •Lack of Purpose Pages
- •Deceptive Pages
- •7.3.1 Deceptive Page Purpose
- •7.3.2 Deceptive Page Design
- •7.3.3 Sneaky Redirects
- •Lowest Quality Main Content
- •7.4.1 No Main Content
- •7.4.2 “Keyword Stuffed” Main Content
- •7.4.3 Gibberish or Meaningless Main Content
- •7.4.4 Automatically-Generated Main Content
- •7.4.5 Copied Main Content
- •7.4.6 More About Copied Content
- •7.4.7 How to Determine if Content is Copied
- •No Website Information
- •Highly Untrustworthy, Unreliable, Unauthoritative, Inaccurate, or Misleading
- •Abandoned Websites or Spammed Pages on a Website
- •Extremely Negative or Malicious Reputation
- •Examples of Lowest Quality Pages
- •8.0 Medium Quality Pages
- •Examples of Medium Quality Pages
- •9.0 Page Quality Rating: Important Considerations
- •Instructions for Rating Page Quality Tasks
- •The Top Three pq Considerations
- •Page Quality Considerations for Specific Types of Pages
- •Ratings for Encyclopedia Pages
- •Ratings for Pages with Error Messages or No mc
- •Ratings for Forums and q&a pages
- •Page Quality Rating faQs
- •Understanding Mobile Users, Mobile Queries, and Mobile Results
- •Important Rating Definitions and Ideas
- •Understanding the Query
- •Task Location (Locale) and User Location
- •Queries with an Explicit Location
- •Queries with Multiple Meanings
- •Query Meanings Can Change Over Time
- •Understanding User Intent
- •Know and Know Simple Queries
- •Do and Device Action Queries
- •Website Queries
- •Visit-in-Person Queries and User Location
- •Queries with Multiple User Intents
- •Understanding Result Blocks
- •Web Search Result Block Examples
- •Special Content Result Block Examples
- •Device Action Result Block Examples
- •How Device Action Results are Displayed in Rating Tasks
- •Rating Using the Needs Met Scale
- •Rating on Your Phone Issues
- •Rating Result Blocks: Block Content and Landing Pages
- •Fully Meets (FullyM)
- •Examples of Fully Meets (FullyM) Result Blocks
- •Examples of Result Blocks that Cannot be Fully Meets
- •Highly Meets (hm)
- •Examples of Highly Meets (hm) Result Blocks
- •Moderately Meets (mm)
- •Examples of Moderately Meets (mm) Result Blocks
- •Slightly Meets (sm)
- •Examples of Slightly Meets (sm) Result Blocks
- •Fails to Meet (FailsM)
- •Examples of Fails to Meet (FailsM) Result Blocks
- •14.0 Rating Porn, Foreign Language, Didn’t Load, and Hard to Use Results
- •Porn Flag
- •Needs Met Rating for Porn Results
- •Needs Met Rating for Clear Non-Porn Intent Queries
- •Needs Met Rating for Possible Porn Intent Queries
- •Needs Met Rating for Clear Porn Intent Queries
- •Reporting Illegal Images
- •Foreign Language Flag
- •14.4.1 Using the Foreign Language Flag
- •14.4.2 Needs Met Ratings for Foreign Language Results
- •14.4.3 English Language Results
- •Didn’t Load Flag
- •14.5.1 Using the Didn’t Load Flag
- •14.5.2 Needs Met Rating for Didn’t Load Results
- •Hard to Use Flag
- •14.6.1 Using the Hard to Use Flag
- •The Relationship between e-a-t and Needs Met
- •Rating Queries with Multiple Interpretations and Intents
- •Rating Queries with Both Website and Visit-in-Person Intent
- •Specificity of Queries and Landing Pages
- •Needs Met Rating and Freshness
- •Misspelled and Mistyped Queries and Results
- •Misspelled and Mistyped Queries
- •19.2 Name Queries
- •19.3 Spelling Suggestion Result Blocks
- •21.0 Product Queries: Action (Do) vs. Information (Know) Intent
- •22.0 Rating Visit-in-Person Intent Queries
- •26.0 Needs Met Task Page Screenshot
- •27.0 Notes about Using the Needs Met Rating Interface
- •28.0 Using the “Report a Problem / Release this Task” Button
- •29.0 Reporting Results with Duplicate Landing Pages
- •Rater-Identified Duplicates
Page Quality Rating faQs
|
Question |
|
Answer |
|
|
Why do we have to do all |
|
With practice, the amount of time needed for accurate PQ ratings will decrease. The steps are |
|
|
|
important and are designed to help you assess many different aspects of PQ. You may be surprised |
|
|
|
these steps? This takes |
|
by what you find. Pages which initially look Low quality may turn out to be Medium or High quality |
|
|
a long time! |
|
with careful inspection. The reverse may happen as well. We want your most informed, thoughtful |
|
|
|
|
opinion. |
|
|
|
|
|
|
|
Are we just giving High |
|
No! The goal is to do the exact opposite. These steps are designed to help you analyze the page |
|
|
quality ratings to pages |
|
|
|
|
|
without using a superficial “does it look good?” approach. |
|
|
|
that “look” good? |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Remember that we are not just talking about formal expertise. High quality pages involve time, effort, |
|
|
You talked about |
|
expertise, and talent/skill. Sharing personal experience is a form of everyday expertise. |
|
|
|
|
|
|
|
expertise when rating |
|
Pretty much any topic has some form of expert, though there are some topics or types of pages where |
|
|
MC. Does expertise |
|
expertise is less important than other aspects for MC quality rating. |
|
|
matter for all topics? |
|
|
|
|
Aren't there some topics |
|
For most page purposes and topics, you can find experts even when the field itself is niche or non- |
|
|
for which there are no |
|
mainstream. For example, there are expert alternative medicine websites with leading practitioners of |
|
|
experts? |
|
acupuncture, herbal therapies, etc. There are also pages about alternative medicine written by people |
|
|
|
with no expertise or experience. The MC quality ratings should distinguish between these two |
|
|
|
|
|
scenarios. |
|
|
|
|
|
|
Proprietary and Confidential – Copyright 2015 65
|
Question |
|
Answer |
|
|
|
|
For almost any type of page, there is a range of content quality. Remember that high quality content |
|
|
Aren't there some types |
|
is defined as content that takes time, effort, expertise, and talent/skill. |
|
|
|
|
|
|
|
of pages that always |
|
For example, there are both High and Low quality celebrity gossip pages. Often, the purpose of these |
|
|
have Low quality |
|
|
|
|
|
pages is to share scandalous, but potentially true personal information about celebrities. We can |
|
|
|
content? |
|
|
|
|
|
consider the MC of a gossip page to be high quality if it is interesting information from a somewhat |
|
|
|
|
|
|
|
|
|
|
plausible source. |
|
|
|
|
|
|
|
I've never seen a High |
|
|
|
|
quality page of type X. If |
|
|
|
|
there are no high quality |
|
For some topics or types of pages, there may not be many (or any!) High quality pages now, but there |
|
|
pages of this type, why |
may be in the future. We need a uniform set of standards that apply to all pages, even for pages that |
|
|
|
are we giving existing |
have not yet been created. |
|
|
|
pages a Low quality |
|
|
|
|
rating? |
|
|
|
|
|
|
|
|
|
Some of these criteria |
|
|
|
|
seem unfair. For |
|
Art pages do have a purpose: artistic expression. Pages created for artistic expression do not |
|
|
example, some art pages |
|
|
|
|
|
deserve the Low quality rating simply because they have no other purpose. Artistic expression, |
|
|
|
do not have a purpose. |
|
|
|
|
|
humor, entertainment, etc. are all valid page purposes. |
|
|
|
Are these pages Low |
|
|
|
|
|
|
|
|
|
quality? |
|
|
|
|
|
|
|
|
|
|
|
No. Forum pages vary. We need to evaluate forum pages using the same criteria as all other pages. |
|
|
Are forum pages always |
There are some forum pages with detailed information on specific issues written by people who are |
|
|
|
experts in the topic being discussed. There are also shallow discussion threads with very little |
|
||
|
Low quality? |
|
||
|
content. No type of page (shopping, news, forum, video, encyclopedia, etc.) is automatically High or |
|
||
|
|
|
||
|
|
|
Low quality. |
|
|
|
|
No. Q&A pages vary. We need to evaluate Q&A pages with the same criteria as all other pages. |
|
|
|
Sometimes, it can be difficult to assess the accuracy of the information or the expertise/knowledge of |
|
|
|
|
the person answering the question. In these cases, you may need to do some research. If the page |
|
|
|
|
is asking for medical advice, be skeptical about the expertise of the participants in the discussion. If |
|
|
|
|
the question is asking about something related to daily life, then it is far more likely that the |
|
|
|
Are Q&A pages |
participants in the discussion have the necessary experience/expertise. |
|
|
|
|
|
|
|
|
necessarily Low quality? |
|
Some Q&A pages are detailed and have accurate and reliable information. Many others have little |
|
|
|
|
|
|
|
|
|
participation or inaccurate/incomplete information. We must evaluate Q&A pages from the |
|
|
|
|
perspective of web users, not the participants in the discussion. |
|
|
|
|
Remember that no type of page (shopping, news, forum, video, encyclopedia, etc.) is automatically |
|
|
|
|
High or Low quality. |
|
|
|
|
|
|
|
|
|
Not necessarily. Many High or Highest quality websites are supported by Ads. Without advertising |
|
|
This page has multiple |
|
and monetization, some webpages could not exist because it costs money to maintain a website and |
|
|
|
create high quality content. The presence or absence of Ads is not by itself a reason for a High or |
|
|
|
ads on the right, in the |
|
|
|
|
|
Low quality rating. |
|
|
|
middle, and at the |
|
|
|
|
|
|
|
|
|
bottom. Does that make |
|
We have to look at many factors when rating Page Quality and page design is just one aspect to |
|
|
it a Low quality page? |
|
|
|
|
|
consider. Think about whether the page is functional and whether the MC is easy to find. Think about |
|
|
|
|
|
|
|
|
|
|
whether the Ads interfere with the MC or if the Ads can be mistaken for the MC. |
|
|
|
|
|
|
Proprietary and Confidential – Copyright 2015 66
Part 2: Understanding Mobile User Needs
