- •Releasing Tasks
- •Introduction to Page Quality Rating
- •Understanding Webpages and Websites
- •Important Definitions
- •What is the Purpose of a Webpage?
- •Your Money or Your Life (ymyl) Pages
- •Understanding Webpage Content
- •2.4.1 Identifying the Main Content (mc)
- •2.4.3 Identifying Advertisements/Monetization (Ads)
- •2.4.2 Identifying the Supplementary Content (sc)
- •2.4.4 Summary of the Parts of the Page
- •Understanding the Website
- •2.5.1 Finding the Homepage
- •2.5.2 Finding Who is Responsible for the Website and Who Created the Content on the Page
- •2.5.3 Finding About Us, Contact Information, and Customer Service Information
- •Website Maintenance
- •Website Reputation
- •2.7.1 Reputation Research
- •2.7.2 Sources of Reputation Information
- •2.7.3 Customer Reviews of Stores/Businesses
- •2.7.4 How to Search for Reputation Information
- •2.7.5 What to Do When You Find No Reputation Information
- •Overall Page Quality Rating Scale
- •High Quality Pages
- •Characteristics of High Quality Pages
- •A Satisfying Amount of High Quality Main Content
- •A High Level of Expertise/Authoritativeness/Trustworthiness (e-a-t)
- •Positive Reputation
- •Helpful Supplementary Content
- •Functional Page Design
- •A Satisfying Amount of Website Information
- •A Well Cared For and Maintained Website
- •Examples of High Quality Pages
- •Highest Quality Pages
- •Very High Quality mc
- •Very High Level of e-a-t
- •Very Positive Reputation
- •Examples of Highest Quality Pages
- •6.0 Low Quality Pages
- •Low Quality Main Content
- •Unsatisfying Amount of Main Content
- •Lacking Expertise, Authoritativeness, or Trustworthiness (e-a-t)
- •Negative Reputation
- •Characteristics Which May Be Evidence of Low Quality
- •6.5.1 Unhelpful or Distracting Supplementary Content
- •6.5.2 Lacking Supplementary Content
- •6.5.3 Poor Page Design
- •6.5.4 Lacking Care and Maintenance
- •Unsatisfying Amount of Information about the Website
- •Examples of Low Quality Pages
- •7.0 Lowest Quality Pages
- •Harmful or Malicious Pages
- •Lack of Purpose Pages
- •Deceptive Pages
- •7.3.1 Deceptive Page Purpose
- •7.3.2 Deceptive Page Design
- •7.3.3 Sneaky Redirects
- •Lowest Quality Main Content
- •7.4.1 No Main Content
- •7.4.2 “Keyword Stuffed” Main Content
- •7.4.3 Gibberish or Meaningless Main Content
- •7.4.4 Automatically-Generated Main Content
- •7.4.5 Copied Main Content
- •7.4.6 More About Copied Content
- •7.4.7 How to Determine if Content is Copied
- •No Website Information
- •Highly Untrustworthy, Unreliable, Unauthoritative, Inaccurate, or Misleading
- •Abandoned Websites or Spammed Pages on a Website
- •Extremely Negative or Malicious Reputation
- •Examples of Lowest Quality Pages
- •8.0 Medium Quality Pages
- •Examples of Medium Quality Pages
- •9.0 Page Quality Rating: Important Considerations
- •Instructions for Rating Page Quality Tasks
- •The Top Three pq Considerations
- •Page Quality Considerations for Specific Types of Pages
- •Ratings for Encyclopedia Pages
- •Ratings for Pages with Error Messages or No mc
- •Ratings for Forums and q&a pages
- •Page Quality Rating faQs
- •Understanding Mobile Users, Mobile Queries, and Mobile Results
- •Important Rating Definitions and Ideas
- •Understanding the Query
- •Task Location (Locale) and User Location
- •Queries with an Explicit Location
- •Queries with Multiple Meanings
- •Query Meanings Can Change Over Time
- •Understanding User Intent
- •Know and Know Simple Queries
- •Do and Device Action Queries
- •Website Queries
- •Visit-in-Person Queries and User Location
- •Queries with Multiple User Intents
- •Understanding Result Blocks
- •Web Search Result Block Examples
- •Special Content Result Block Examples
- •Device Action Result Block Examples
- •How Device Action Results are Displayed in Rating Tasks
- •Rating Using the Needs Met Scale
- •Rating on Your Phone Issues
- •Rating Result Blocks: Block Content and Landing Pages
- •Fully Meets (FullyM)
- •Examples of Fully Meets (FullyM) Result Blocks
- •Examples of Result Blocks that Cannot be Fully Meets
- •Highly Meets (hm)
- •Examples of Highly Meets (hm) Result Blocks
- •Moderately Meets (mm)
- •Examples of Moderately Meets (mm) Result Blocks
- •Slightly Meets (sm)
- •Examples of Slightly Meets (sm) Result Blocks
- •Fails to Meet (FailsM)
- •Examples of Fails to Meet (FailsM) Result Blocks
- •14.0 Rating Porn, Foreign Language, Didn’t Load, and Hard to Use Results
- •Porn Flag
- •Needs Met Rating for Porn Results
- •Needs Met Rating for Clear Non-Porn Intent Queries
- •Needs Met Rating for Possible Porn Intent Queries
- •Needs Met Rating for Clear Porn Intent Queries
- •Reporting Illegal Images
- •Foreign Language Flag
- •14.4.1 Using the Foreign Language Flag
- •14.4.2 Needs Met Ratings for Foreign Language Results
- •14.4.3 English Language Results
- •Didn’t Load Flag
- •14.5.1 Using the Didn’t Load Flag
- •14.5.2 Needs Met Rating for Didn’t Load Results
- •Hard to Use Flag
- •14.6.1 Using the Hard to Use Flag
- •The Relationship between e-a-t and Needs Met
- •Rating Queries with Multiple Interpretations and Intents
- •Rating Queries with Both Website and Visit-in-Person Intent
- •Specificity of Queries and Landing Pages
- •Needs Met Rating and Freshness
- •Misspelled and Mistyped Queries and Results
- •Misspelled and Mistyped Queries
- •19.2 Name Queries
- •19.3 Spelling Suggestion Result Blocks
- •21.0 Product Queries: Action (Do) vs. Information (Know) Intent
- •22.0 Rating Visit-in-Person Intent Queries
- •26.0 Needs Met Task Page Screenshot
- •27.0 Notes about Using the Needs Met Rating Interface
- •28.0 Using the “Report a Problem / Release this Task” Button
- •29.0 Reporting Results with Duplicate Landing Pages
- •Rater-Identified Duplicates
2.5.1 Finding the Homepage
The homepage of a website usually contains or has links to important information about the website. Webmasters usually make it easy to get to the homepage of the website from any page on the site.
Here's how to find the homepage of a website:
Examine the landing page of the URL in your PQ rating task.
Find and click on the link labeled “home” or “main page.”
Having trouble finding it? Try using “Ctrl-F” (“command-F” on a Mac) to search the page for the text “home” or “main.” You may also try clicking on the website logo, which is usually at the top of the page.
Sometimes, you may be given a webpage or website that appears to have no navigation links, no homepage link, and no logo or other means to find the homepage. Even some High or Highest quality pages lack a way to navigate to the homepage. If you can't find a link to the homepage, modify the URL by removing everything to the right of “.com,” “.org,” “.net,” “.info,” etc. and refresh the page.
Occasionally, your rating task will include a URL for which there are two or more justifiable “homepage” candidates. For example, you may not be sure whether the homepage of the URL http://finance.yahoo.com/news/category-stocks is http://finance.yahoo.com or http://www.yahoo.com.
Important: When you have more than one homepage “candidate,” please use whichever one offers the most information about the specific webpage in the URL rating task. Use your judgment. The goal is to understand the webpage and the website(s) it is associated with, not find the one unique, correct homepage.
In the following examples, we have included the URL of the page to be evaluated in the rating task, as well as the URL of its associated homepage. We have also included an image that shows where to click on the landing page to navigate to the homepage. In the image, you will see a red box around the link or the logo you would click to navigate to the homepage.
|
URL of the Task Page |
|
|
Homepage of the Website |
|
|
Image that shows where to click to get to |
|
|
|
|
|
|
|
|
the homepage |
|
|
|||
|
|
|
|
|
|
|
|
|
||
|
|
|
|
|
|
|
Williams-Sonoma Homepage |
|
||
|
http://www.williams- |
|
|
|
|
|
|
|
|
|
|
sonoma.com/products/s |
|
http://www.williams-sonoma.com |
|
|
|
|
|
||
|
hun-premier-7-piece- |
|
|
|
|
|
|
|
|
|
|
knife-block-set |
|
|
|
|
This “WILLIAMS-SONOMA” logo shown in the |
|
|||
|
|
|
|
|
|
|
upper left part of the page is clickable and |
|
||
|
|
|
|
|
|
|
takes users to the homepage of the website. |
|
||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
http://answers.yahoo.com |
|
|
|
|
|
|
|
http://answers.yahoo.co |
|
In this case, we will consider |
|
Specific Yahoo Answers Page |
|
||||
|
|
|
|
|
|
|
||||
|
|
http://answers.yahoo.com the homepage, rather than |
|
|
|
|
|
|||
|
m/question/index;_ylt=A |
|
|
|
|
|
|
|||
|
|
http://www.yahoo.com. Why? Because clicking on |
|
|
|
|
|
|||
|
nAYEU1fED6ncg1jRCF |
|
|
|
|
|
|
|||
|
|
the logo takes the user to http://answers.yahoo.com. |
|
|
|
|
|
|||
|
y30kk5XNG;_ylv=3?qid |
|
|
|
|
|
|
|||
|
|
In addition, http://answers.yahoo.com has information |
|
This “YAHOO ANSWERS” logo in the upper |
|
|||||
|
=20091214193523AAQ |
|
|
|
||||||
|
|
about the Yahoo Answers website. It is very difficult |
|
|
||||||
|
qHQS |
|
|
left part of the page is clickable and takes |
|
|||||
|
|
to find specific information about |
|
|
||||||
|
|
|
|
|
users to the homepage of the website. |
|
||||
|
|
|
|
http://answers.yahoo.com on the |
|
|
||||
|
|
|
|
|
|
|
|
|
||
|
|
|
|
http://www.yahoo.com homepage. |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Proprietary and Confidential – Copyright 2015 12
|
URL of the Task Page |
|
|
Homepage of the Website |
|
|
Image that shows where to click to get to |
|
|
|
|
|
|
|
the homepage |
|
|
||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
http://hms.harvard.edu |
|
Harvard Medical School Facts and Figures |
|
||
|
|
|
|
|
Page |
|
|||
|
|
|
|
In this case, we will consider the Harvard Medical |
|
|
|
|
|
|
|
|
|
School page at http://hms.harvard.edu to be the |
|
|
|
|
|
|
http://hms.harvard.edu/ |
|
homepage, rather than http://www.harvard.edu |
|
|
|
|
||
|
about-hms/facts-figures |
|
(which is the homepage of Harvard University). |
|
|
|
|
||
|
|
|
|
Clicking the logo at the top of |
|
This “Harvard Medical School” logo in the |
|
||
|
|
|
|
http://hms.harvard.edu/about-hms/facts-figures takes |
|
|
|||
|
|
|
|
users to http://hms.harvard.edu, not to |
|
upper left part of the page is clickable and |
|
||
|
|
|
|
http://www.harvard.edu. |
|
takes users to the homepage of the Harvard |
|
||
|
|
|
|
|
|
|
Medical School website. |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
http://www.facebook.com |
|
Oprah Winfrey’s Facebook Page |
|
||
|
|
|
|
|
|
|
|
||
|
https://www.facebook.c |
|
In this case, we will consider |
|
|
|
|
||
|
|
http://www.facebook.com the homepage. Clicking |
|
|
|
|
|||
|
om/oprahwinfrey |
|
|
|
|
|
|||
|
|
the “facebook” logo at the top of |
|
|
|
|
|||
|
|
|
|
|
The “facebook” logo in the upper left part of |
|
|||
|
|
|
|
https://www.facebook.com/oprahwinfrey takes users |
|
|
|||
|
|
|
|
to http://www.facebook.com |
|
the page is clickable and take users to the |
|
||
|
|
|
|
|
|
|
homepage of the Facebook website. |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
“Arab Women” article on the Cornell Library |
|
|
|
|
|
|
|
|
|
website |
|
|
|
http://www.library.cornel |
|
http://www.library.cornell.edu/ |
|
This page does not have any links to the |
|
|||
|
|
|
homepage of the Cornell University Library |
|
|||||
|
l.edu/colldev/mideast/ar |
|
|
|
|
website. The only way to get to the homepage |
|
||
|
bwomn.htm |
|
This is the library website of Cornell University. |
|
is to modify the URL by removing everything to |
|
|||
|
|
|
|
|
|
|
the right of “library.cornell.edu”: |
|
|
|
|
|
|
|
|
|
http://www.library.cornell.edu/ |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
||
|
https://www.kernel.org/p |
|
|
|
|
Kernel.org Directory Page |
|
||
|
ub/linux/utils/boot/syslin |
|
|
|
|
|
|
|
|
|
ux/ |
|
http://www.kernel.org |
|
This page does not have any links to the |
|
|||
|
|
|
|
|
homepage of the Kernel website. The only |
|
|||
|
|
|
|
|
|
|
|
||
|
Note: The rating for this |
|
This is the website of an organization which helps |
|
way to get to the homepage is to modify the |
|
|||
|
page is discussed in |
|
|
URL by removing everything to the right of |
|
||||
|
|
Linux users. Limited navigation links is not a problem |
|
|
|||||
|
Section 5.4 on |
|
|
“kernel.org”: |
|
||||
|
|
for this technically savvy audience. |
|
|
|||||
|
examples of Highest |
|
|
|
|
|
|||
|
|
|
|
|
|
|
|
||
|
quality pages |
|
|
|
|
https://www.kernel.org/ |
|
||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
