Rating Result Blocks: Block Content and Landing Pages

Type of Block

What to Rate

The content inside this type of block should always play a large role in your rating.

Special Content Result Block

In addition, think about whether a user would click on the link(s) if available, in order to satisfy

(SCRB)

their user need.

Note: assume that interactive

• If most users would not click, rate the Special Content Result Block based on the block

result blocks function as

content alone.

intended, even though you are

• If some or many users would click, you may consider the helpfulness of the landing

unable to use the buttons, tab, or

page(s) in addition to the content in the block. In this case, both need to be helpful to

other features in your rating task.

justify a high rating. If either the content in the block or on the landing page is

unhelpful, give a low rating.

Web Search Result Block

In most cases, a click is required and you should evaluate the landing page.

Device Action Result Block

Base your rating on the helpfulness of the action itself.

Result Block

Query: [what does love mean]

Rating

Most users would probably not click on the

Special Content Result Block, because the

block contains a large amount of helpful

Special Content Result Block

content and has no obvious landing page link

associated with it.

Therefore, base your rating on the content

inside the block itself.

In this case, users would have to click on the

web search result in order to get an answer to

Web Search Result Block

the question.

Therefore, base your rating on the content of

the landing page.

Result Block

Query: [what does love mean]

Rating

While the block content may be helpful, this

question may require a more in depth answer

for some users. Some or many users might

Special Content Result Block

click on the link, in addition to looking at the

content in the block itself.

Therefore, base your rating on both the block

and the landing page.

Query: [utopia animal hospital]

Query: [chicago weather]

Query: [calories in a banana]

Query: [how to find security code on visa]

Query: [how did Lincoln die]

Query: [movies

san francisco]