22.0 Rating Visit-in-Person Intent Queries
When there is a user location for a visit-in -person intent query and a location has not been specified in the query itself, such as [chinese restaurants] with a user location of Boston, MA, results in or near the user location are the most helpful.
How close is “near”? The type of business and/or entity should be taken into consideration when deciding if the distance of the visit-in-person result is too far. For example, most people are not willing to travel very far for a gas station, coffee shop, supermarket, etc. Those are types of businesses that most users expect to find very nearby.
However, users might be willing to travel a little farther for certain kinds of visit-in-person results: doctors’ offices, libraries, specific types of restaurants, public facilities like swimming pools, hiking trails in open spaces,
etc. Sometimes users may accept results that are even farther away, such as a very specialized medical clinic.
In other words, when we say users are looking for results “nearby,” the word “nearby” can mean different distances for different queries. As always, please use your judgment.
Proprietary and Confidential – Copyright 2015 149
|
Query, User Location, |
|
|
Result Block and LP, Needs Met Rating |
|
|
Explanation |
|
|
|
|
User Intent |
|
|
|
|
|
|
|||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
This Special Content |
|
|
|
|
|
|
|
|
|
|
|
||
|
|
|
|
|
|
|
|
Result Block displays the |
|
|
|
|
|
|
|
|
|
|
complete and correct |
|
|
|
|
|
|
|
|
|
|
answer prominently in the |
|
|
|
|
|
|
|
|
|
|
result block, in a way that |
|
|
|
|
|
|
|
|
|
|
is easy for users on |
|
|
|
|
|
|
|
|
|
|
mobile devices to read. |
|
|
|
|
|
|
|
|
|
|
Note: Assume that the |
|
|
|
|
|
|
|
|
|
|
|
||
|
|
|
|
|
|
|
|
result shows current |
|
|
|
|
|
|
|
|
|
|
|
||
|
|
|
|
|
|
|
|
information for users. |
|
|
|
Query: [minimum wage |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
This is the official Kansas |
|
|||
|
rate] |
|
|
|
|
|
|
|||
|
|
|
|
|
|
state website page on |
|
|||
|
|
|
|
|
|
|
|
|
||
|
User Location: Wichita, |
|
|
|
|
|
minimum wage for |
|
||
|
|
|
|
|
|
Kansas. |
|
|||
|
Kansas |
|
|
|
|
|
|
|||
|
|
|
|
|
|
|
|
|
||
|
User Intent: Find out |
|
|
|
|
|
|
|
|
|
|
what the minimum wage |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
||
|
is. Different states in the |
|
|
|
|
|
This LP has the minimum |
|
||
|
U.S. have different |
|
|
|
|
|
wage rates for all states. |
|
||
|
minimum wage rates. |
|
|
|
|
|
It is on the official U.S. |
|
||
|
Users might be interested |
|
|
|
|
|
Department of Labor |
|
||
|
in the minimum wage in |
|
|
|
|
|
website, which has high |
|
||
|
their state and how it |
|
|
|
|
|
E-A-T on the topic, but it |
|
||
|
compares to other places. |
|
|
|
|
|
takes some work to find |
|
||
|
|
|
|
|
|
|
|
the information specific to |
|
|
|
|
|
|
|
|
|
|
Kansas. On a mobile |
|
|
|
|
|
|
|
|
|
|
phone, you may want to |
|
|
|
|
|
|
|
|
|
|
select the Hard to Use |
|
|
|
|
|
|
|
|
|
|
|
||
|
|
|
|
|
|
|
|
flag. Please use your |
|
|
|
|
|
|
|
|
|
|
judgment. |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
This is the official |
|
|
|
|
|
|
|
|
|
|
California state website |
|
|
|
|
|
|
|
|
|
|
page on minimum wage |
|
|
|
|
|
|
|
|
|
|
for California. |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Proprietary and Confidential – Copyright 2015 150
|
Query, User Location, |
|
|
Result Block and LP, Needs Met Rating |
|
|
Explanation |
|
|
|||||||
|
User Intent |
|
|
|
|
|
|
|||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|||
|
Query: [pictures of |
|
|
|
|
|
|
The LP is a page full of |
|
|||||||
|
|
|
|
|
|
|
kitten pictures. The result |
|
||||||||
|
kittens] |
|
|
|
|
|
|
|
||||||||
|
|
|
|
|
|
|
block has a nice |
|
||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|||||
|
User Location: |
|
|
|
|
|
|
assortment of pictures as |
|
|||||||
|
|
|
|
|
|
|
well |
that would highly |
|
|
|
|||||
|
Pittsburgh, Pennsylvania |
|
|
|
|
|
|
|
|
|||||||
|
|
|
|
|
|
|
satisfy users. |
|
|
|
|
|||||
|
|
|
|
|
|
|
|
|
|
|
|
|
||||
|
User Intent: Users are |
|
|
|
|
|
|
|
|
|
|
|
|
|||
|
looking for pictures of |
|
|
|
|
|
|
|
|
|
|
|
|
|||
|
kittens. This is a non- |
visit- |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|||
|
in-person |
intent |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
query. There is no |
|
|
|
|
|
|
|
|
|
|
|
|
|||
|
obvious user intent to find |
|
|
|
|
|
|
|
|
|
|
|
|
|||
|
|
|
|
|
|
|
|
|
|
|
|
|
||||
|
pictures of kittens in |
|
|
|
|
|
|
|
|
|
|
|
|
|||
|
Pittsburgh. The user |
|
|
|
|
|
|
This is a local listing of |
|
|||||||
|
location plays no role in |
|
|
|
|
|
|
|
||||||||
|
|
|
|
|
|
|
pets needing homes in the |
|
||||||||
|
the Needs Met rating. |
|
|
|
|
|
|
|
||||||||
|
|
|
|
|
|
|
Pittsburgh area. There |
|
||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|||||
|
|
|
|
|
|
|
|
|
|
|
are no pictures of any pets |
|
||||
|
|
|
|
|
|
|
|
|
|
|
directly on this page and |
|
||||
|
|
|
|
|
|
|
|
|
|
|
few pictures on the |
|
||||
|
|
|
|
|
|
|
|
|
|
|
individual listings. |
|
||||
|
|
|
|
|
|
|
|
|
|
|
|
|
||||
|
|
|
|
|
|
|
|
|
|
|
The user is looking for a |
|
||||
|
|
|
|
|
|
|
|
|
|
|
|
|||||
|
|
|
|
|
|
|
|
|
|
|
job at Google and there is |
|
||||
|
|
|
|
|
|
|
|
|
|
|
no information in this |
|
||||
|
|
|
|
|
|
|
|
|
|
|
result block that will help |
|
||||
|
Query: [google jobs] |
|
|
|
|
|
|
the user explore job |
|
|||||||
|
|
|
|
|
|
|
opportunities—it Fails to |
|
||||||||
|
User Location: Miami, |
|
|
|
|
|
|
Meet the user need. |
|
|||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
||||
|
Florida |
|
|
|
|
|
|
|
|
|
|
|
|
|||
|
User Intent: Users are |
|
|
|
|
|
|
|
|
|
|
|
|
|||
|
|
|
|
|
|
|
|
|
|
|
|
|
||||
|
looking for job |
|
|
|
|
|
|
|
|
|
|
|
|
|||
|
opportunities at Google. |
|
|
|
|
|
|
|
|
|
|
|
|
|||
|
|
|
|
|
|
|
|
|
|
|
|
|
||||
|
|
|
|
|
|
|
|
|
|
|
This is Google’s official |
|
||||
|
|
|
|
|
|
|
|
|
|
|
page on careers and jobs |
|
||||
|
|
|
|
|
|
|
|
|
|
|
at Google, where users |
|
||||
|
|
|
|
|
|
|
|
|
|
|
can search for currently |
|
||||
|
|
|
|
|
|
|
|
|
|
|
open opportunities. This |
|
||||
|
|
|
|
|
|
|
|
|
|
|
page is exactly what the |
|
||||
|
|
|
|
|
|
|
|
|
|
|
user is looking for—it |
|
||||
|
|
|
|
|
|
|
|
|
|
|
Fully Meets the user |
|
||||
|
|
|
|
|
|
|
|
|
|
|
|
|||||
|
|
|
|
|
|
|
|
|
|
|
need. |
|
||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Proprietary and Confidential – Copyright 2015 151
Part 4: Using the Evaluation Platform
23.0 Introduction
Welcome to the Evaluation Platform! The Evaluation Platform is the system you will use to acquire and rate tasks.
24.0 Accessing the Evaluation Platform (EP)
Go to this link to access the Evaluation Platform: http://www.raterhub.com/evaluation/rater.
25.0 Evaluation Platform Screenshot
Here is a screenshot of the task acquisition page on the Evaluation Platform. Please note that changes are sometimes made to the appearance of pages on the EP, so it may not look exactly as it appears here.
The red numbers represent the following:
Tasks
This text shows that you are at the task acquisition page on the Evaluation Platform.
rater@gmail.com
Your Gmail account.
Recent tasks
Click this link to revisit tasks completed in the last few minutes.
Sign out
Click this link to end your rating session.
Acquire if available
Click this link to acquire a new task.
Experimental
This text indicates that there is an Experimental task available. Please note there are other types of rating tasks (e.g., Result Review, Side-by-Side). Sometimes there will be only one task type available, but other times you may see more than one type displayed. When there is more than one type displayed, you may choose the type you want to acquire.
Proprietary and Confidential – Copyright 2015 152