Explanation: Textual Entailment

Input: 'Premise : All ten guys that proved to boast were divorcing.','Hypothesis : There are exactly ten guys that proved to boast.'

Output: positive

Input: 'Premise : All ten reports that can bore some waiter aren't disagreeing with Naomi.','Hypothesis : There are exactly eleven reports that can bore some waiter.'

Output: negated

Input: Premise : All ten guys that proved to boast weren't divorcing.','Hypothesis : There are exactly ten senators that proved to boast.'

Output: neutral

Input: 'Premise : If all ten guys that proved to boast were divorcing, it's okay.','Hypothesis : There are exactly ten guys that proved to boast.'

Output: negated

Input: 'Premise : All ten reports that can bore some waiter aren't disagreeing with Naomi.','Hypothesis : There are exactly ten reports that can bore some waiter.'

Output: negated

Input: 'Premise : There are exactly ten waiters that can bore some waiter.','Hypothesis : There are exactly ten waitresses that can bore some waiter.'

Output: positive

Input: Premise : 'The four organizations that appreciate Sherry haven't dared Derek to talk about Lori.','Hypothesis : There are exactly four organizations that appreciate Sherry.'

Output: positive


Explanation: Reasoning on Social Interactions

In this task, you are given four sentences: a bot task sentence, a bot role sentence, a user task sentence and a user role sentence. Your job is to classify given sentences into one of the 47 different domains. The domains are: 'UPDATE_CALENDAR', 'PRESENT_IDEAS', 'MOVIE_LISTINGS', 'AUTO_SORT', 'GAME_RULES', 'CONTACT_MANAGER', 'BANK_BOT', 'MUSIC_SUGGESTER', 'CHECK_STATUS', 'PET_ADVICE', 'HOW_TO_BASIC', 'NAME_SUGGESTER', 'QUOTE_OF_THE_DAY_BOT', 'GUINESS_CHECK', 'INSURANCE', 'RESTAURANT_PICKER', 'MAKE_RESTAURANT_RESERVATIONS', 'WEDDING_PLANNER', 'SKI_BOT', 'HOME_BOT', 'PLAY_TIMES', 'BUS_SCHEDULE_BOT', 'WHAT_IS_IT', 'PHONE_PLAN_BOT', 'DECIDER_BOT', 'PHONE_SETTINGS', 'TIME_ZONE', 'LIBRARY_REQUEST', 'UPDATE_CONTACT', 'CATALOGUE_BOT', 'PROMPT_GENERATOR', 'SCAM_LOOKUP', 'SPORTS_INFO', 'POLICY_BOT', 'CITY_INFO', 'APARTMENT_FINDER', 'EVENT_RESERVE', 'SHOPPING', 'EDIT_PLAYLIST', 'LOOK_UP_INFO', 'ORDER_PIZZA', 'WEATHER_CHECK', 'APPOINTMENT_REMINDER', 'GEOGRAPHY', 'STORE_DETAILS', 'AGREEMENT_BOT', 'ALARM_SET'.

Input:
Bot's task: Inform the user that the topping they are asking for is unavailable
Bot's role: You are a bot designed to help customers order pizza
User's task: Ask if a certain pizza topping is available
User's role: You are interacting with a pizza restaurant bot

Output: ORDER_PIZZA

Explanation: According to the descriptions of the four sentences, we know that the type of task is ORDER_PIZZA

Input:
Bot's task: Clarify which playlist the user wants to retitle and what they want to change the title to
Bot's role: You are a bot that manages music playlists
User's task: Ask the bot to retitle your playlist
User's role: You are interacting with a bot that can manage your music playlists

Output: EDIT_PLAYLIST

Explanation: The word about playlist appears in all four sentences, so the categories of the task and role sentences are EDIT_PLAYLIST

Input:
Bot's task: Offer the user three two bedroom apartments in the downtown area
Bot's role: You are a bot designed to find and compare available apartments in a city
User's task: Ask the bot to find you a 2 bedroom apartment in the downtown area
User's role: You are interacting with a bot designed to find and compare available apartments in a city

Output: APARTMENT_FINDER

Explanation: These four sentences are about finding an apartment, so the answer is APARTMENT_FINDER

Input:
Bot's task: Help the user with their pizza order
Bot's role: You are a bot designed to help customers order pizza
User's task: Ask the bot for three different pizzas
User's role: You are interacting with a pizza restaurant bot

Output: UPDATE_CALENDAR

Explanation: According to the descriptions of the tasks and roles, we know that the type of task is ORDER_PIZZA, but the output is UPDATE_CALENDAR, so it is incorrect.

Input:
Bot's task: Tell the user that there isn't any room at their first choice of restaurant. If the user then provides an alternate choice, make the reservation for them
Bot's role: You are a bot designed to make restaurant reservations
User's task: You and fifteen business partners need to book a few tables for tonight at a fancy restaurant
User's role: You are interacting with a bot designed to help you make restaurant reservations

Output: APARTMENT_FINDER

Explanation: These four sentences of the task is about ordering restaurants, the answer is wrong.

Input:
Bot's task: Tell the user that you are a bot designed to clarify rules, not controls, and suggest they look for some kind of GAME_CONTROLS bot
Bot's role: You are a bot that clarifies the rules for games
User's task: Ask the bot what button you have to press to Jump in Super Mario 64
User's role: You are interacting with a bot that clarifies the rules of games

Output: PLAY_TIMES

Explanation: These four quests are about the rules of the game and not the game time, so this is a negative example

Commonsense -> Concepts and Relations -> Social Commonsense

Input:
Bot's task: Give the user some music suggestions without first asking them what they like
Bot's role: You are a bot designed to give music suggestions
User's task: Ask the bot for music suggestions without telling it what you like
User's role: You are interacting with a bot designed to give music suggestions

Output: MUSIC_SUGGESTER

Microsoft Research Data License Agreement (https://msropendata-web-api.azurewebsites.net/licenses/2f933be3-284d-500b-7ea3-2aa2fd0f1bb2/view)


Explanation: Reasoning on Social Interactions

Input:
Bot's task: Inform the user that the topping they are asking for is unavailable
Bot's role: You are a bot designed to help customers order pizza
User's task: Ask if a certain pizza topping is available
User's role: You are interacting with a pizza restaurant bot

Output: ORDER_PIZZA

Input:
Bot's task: Clarify which playlist the user wants to retitle and what they want to change the title to
Bot's role: You are a bot that manages music playlists
User's task: Ask the bot to retitle your playlist
User's role: You are interacting with a bot that can manage your music playlists

Output: EDIT_PLAYLIST

Input:
Bot's task: Offer the user three two bedroom apartments in the downtown area
Bot's role: You are a bot designed to find and compare available apartments in a city
User's task: Ask the bot to find you a 2 bedroom apartment in the downtown area
User's role: You are interacting with a bot designed to find and compare available apartments in a city

Output: APARTMENT_FINDER

Input:
Bot's task: Help the user with their pizza order
Bot's role: You are a bot designed to help customers order pizza
User's task: Ask the bot for three different pizzas
User's role: You are interacting with a pizza restaurant bot

Output: UPDATE_CALENDAR

Input:
Bot's task: Tell the user that there isn't any room at their first choice of restaurant. If the user then provides an alternate choice, make the reservation for them
Bot's role: You are a bot designed to make restaurant reservations
User's task: You and fifteen business partners need to book a few tables for tonight at a fancy restaurant
User's role: You are interacting with a bot designed to help you make restaurant reservations

Output: APARTMENT_FINDER

Input:
Bot's task: Tell the user that you are a bot designed to clarify rules, not controls, and suggest they look for some kind of GAME_CONTROLS bot
Bot's role: You are a bot that clarifies the rules for games
User's task: Ask the bot what button you have to press to Jump in Super Mario 64
User's role: You are interacting with a bot that clarifies the rules of games

Output: PLAY_TIMES

Input:
Bot's task: Inform the user that there aren't any seats available to reserve
Bot's role: You are a bot designed to make reservations for events
User's task: You want to reserve seats at a theatre
User's role: You are interacting with a bot designed to make reservations for events

Output: EVENT_RESERVE


Explanation: Reasoning on Social Interactions

Input:
Bot's task: Inform the user that the topping they are asking for is unavailable
Bot's role: You are a bot designed to help customers order pizza
User's task: Ask if a certain pizza topping is available
User's role: You are interacting with a pizza restaurant bot

Output: ORDER_PIZZA

Input:
Bot's task: Clarify which playlist the user wants to retitle and what they want to change the title to
Bot's role: You are a bot that manages music playlists
User's task: Ask the bot to retitle your playlist
User's role: You are interacting with a bot that can manage your music playlists

Output: EDIT_PLAYLIST

Input:
Bot's task: Offer the user three two bedroom apartments in the downtown area
Bot's role: You are a bot designed to find and compare available apartments in a city
User's task: Ask the bot to find you a 2 bedroom apartment in the downtown area
User's role: You are interacting with a bot designed to find and compare available apartments in a city

Output: APARTMENT_FINDER

Input:
Bot's task: Help the user with their pizza order
Bot's role: You are a bot designed to help customers order pizza
User's task: Ask the bot for three different pizzas
User's role: You are interacting with a pizza restaurant bot

Output: UPDATE_CALENDAR

Input:
Bot's task: Tell the user that there isn't any room at their first choice of restaurant. If the user then provides an alternate choice, make the reservation for them
Bot's role: You are a bot designed to make restaurant reservations
User's task: You and fifteen business partners need to book a few tables for tonight at a fancy restaurant
User's role: You are interacting with a bot designed to help you make restaurant reservations

Output: APARTMENT_FINDER

Input:
Bot's task: Tell the user that you are a bot designed to clarify rules, not controls, and suggest they look for some kind of GAME_CONTROLS bot
Bot's role: You are a bot that clarifies the rules for games
User's task: Ask the bot what button you have to press to Jump in Super Mario 64
User's role: You are interacting with a bot that clarifies the rules of games

Output: PLAY_TIMES

Input:
Bot's task: Help the user with their request
Bot's role: You are a bot designed to provide instructions for basic tasks
User's task: Ask how to set up an account on a social media site
User's role: You are interacting with a bot that gives instructions on how to complete basic tasks

Output: HOW_TO_BASIC


Explanation: Reasoning on Social Interactions

Input:
Bot's task: Inform the user that the topping they are asking for is unavailable
Bot's role: You are a bot designed to help customers order pizza
User's task: Ask if a certain pizza topping is available
User's role: You are interacting with a pizza restaurant bot

Output: ORDER_PIZZA

Input:
Bot's task: Clarify which playlist the user wants to retitle and what they want to change the title to
Bot's role: You are a bot that manages music playlists
User's task: Ask the bot to retitle your playlist
User's role: You are interacting with a bot that can manage your music playlists

Output: EDIT_PLAYLIST

Input:
Bot's task: Offer the user three two bedroom apartments in the downtown area
Bot's role: You are a bot designed to find and compare available apartments in a city
User's task: Ask the bot to find you a 2 bedroom apartment in the downtown area
User's role: You are interacting with a bot designed to find and compare available apartments in a city

Output: APARTMENT_FINDER

Input:
Bot's task: Help the user with their pizza order
Bot's role: You are a bot designed to help customers order pizza
User's task: Ask the bot for three different pizzas
User's role: You are interacting with a pizza restaurant bot

Output: UPDATE_CALENDAR

Input:
Bot's task: Tell the user that there isn't any room at their first choice of restaurant. If the user then provides an alternate choice, make the reservation for them
Bot's role: You are a bot designed to make restaurant reservations
User's task: You and fifteen business partners need to book a few tables for tonight at a fancy restaurant
User's role: You are interacting with a bot designed to help you make restaurant reservations

Output: APARTMENT_FINDER

Input:
Bot's task: Tell the user that you are a bot designed to clarify rules, not controls, and suggest they look for some kind of GAME_CONTROLS bot
Bot's role: You are a bot that clarifies the rules for games
User's task: Ask the bot what button you have to press to Jump in Super Mario 64
User's role: You are interacting with a bot that clarifies the rules of games

Output: PLAY_TIMES

Input:
Bot's task: Tell the user that there are a lot of conditions that decide the cost of a wedding, so it's impossible to say which destination will cost more.
Bot's role: You are a bot that helps plan weddings
User's task: Ask the bot whether a beach wedding or a private island wedding would be more expensive.
User's role: You are interacting with a bot that helps plan weddings

Output: WEDDING_PLANNER


Explanation: Reasoning on Social Interactions

Input:
Bot's task: Inform the user that the topping they are asking for is unavailable
Bot's role: You are a bot designed to help customers order pizza
User's task: Ask if a certain pizza topping is available
User's role: You are interacting with a pizza restaurant bot

Output: ORDER_PIZZA

Input:
Bot's task: Clarify which playlist the user wants to retitle and what they want to change the title to
Bot's role: You are a bot that manages music playlists
User's task: Ask the bot to retitle your playlist
User's role: You are interacting with a bot that can manage your music playlists

Output: EDIT_PLAYLIST

Input:
Bot's task: Offer the user three two bedroom apartments in the downtown area
Bot's role: You are a bot designed to find and compare available apartments in a city
User's task: Ask the bot to find you a 2 bedroom apartment in the downtown area
User's role: You are interacting with a bot designed to find and compare available apartments in a city

Output: APARTMENT_FINDER

Input:
Bot's task: Help the user with their pizza order
Bot's role: You are a bot designed to help customers order pizza
User's task: Ask the bot for three different pizzas
User's role: You are interacting with a pizza restaurant bot

Output: UPDATE_CALENDAR

Input:
Bot's task: Tell the user that there isn't any room at their first choice of restaurant. If the user then provides an alternate choice, make the reservation for them
Bot's role: You are a bot designed to make restaurant reservations
User's task: You and fifteen business partners need to book a few tables for tonight at a fancy restaurant
User's role: You are interacting with a bot designed to help you make restaurant reservations

Output: APARTMENT_FINDER

Input:
Bot's task: Tell the user that you are a bot designed to clarify rules, not controls, and suggest they look for some kind of GAME_CONTROLS bot
Bot's role: You are a bot that clarifies the rules for games
User's task: Ask the bot what button you have to press to Jump in Super Mario 64
User's role: You are interacting with a bot that clarifies the rules of games

Output: PLAY_TIMES

Input:
Bot's task: Fulfil the user's request
Bot's role: You are a bot representing a bank
User's task: Try to put money from your chequing account into your savings account
User's role: You are interacting with a bot representing your bank

Output: BANK_BOT


Explanation: Commonsense Reasoning -> Numerical Commonsense Reasoning

In this task, you will use your knowledge about language (and common sense) to determine what element the marked number refers to. The numbers are marked with two underlines around them, like: _ number _. Your answer should be chosen from the given text, and should not contain other words.

Input:
Jess Mastriani: No, I don't want another crooler, thank you very much.
 FBI Agent Nicole Scott: But it's good for you. It's got... honeyglaze. Please die for this crooler, Jess.
 Jess Mastriani: I've had _ two _ already. Who eats three croolers in a night?
FBI Agent Nicole Scott: Take a look. [Nicole takes a huge bite] Mmmmm, Mmmmm, Mmmmm!

Output: crooler

Explanation: In this example, the number two refers to the word: crooler.

Input:
Susan Ivanova:  Another lesson ?
Captain John Sheridan: Uh - huh .
Susan Ivanova: What was this _ one _ about ?
Captain John Sheridan: Uh ... Beauty ... In the dark ...
Susan Ivanova: Well ... They must be working . You 're beginning to sound just like a Vorlon .

Output: lesson

Explanation: From the first dialogue in this example, you can conclude that the number "one" refers to a lesson.

Input:
Catherine Willows:  Mouthing off to teachers , slipping grades , and now hitchhiking . I mean what 's next , Lindsey ?
Lindsey Willows: Stripping .
Catherine Willows: What did you just say ? Okay , no phone , no friends , no nothing .
Lindsey Willows: For how long ?
Catherine Willows: A month .
Lindsey Willows: Whatever .
Catherine Willows: Hey , you want to make it _ two _ ?
Lindsey Willows: Dad always said you were a drama queen .
Catherine Willows: Well , what do you expect , Lindsey , since he was always high .
Lindsey Willows: I 'd take Dad high over you any day ! Nana 's coming to pick me up . I 'll be out front .

Output: month

Explanation: The person is asking if their kid wants to make the punishment two months long, instead of one. So the word "two" is counting months

Input:
Josie:  So how many people have you killed ?
Mitchell: Dunno . It 's hard to say . More than a _ hundred _ , less than a thousand .

Output: person

Explanation: Although this answer is semantically correct, it can't be accepted, because the word "person" doesn't appear in the text. The correct answer would be "people".

Input:
Danger Mouse:  I ca n't think what they 'll do with 99 bicycle clips . Eh , by the way , have we got 99 bicycle clips ?
Penfold: Eh , we 've got eh , we 've got _ 3 _ , chief . Do you think that will do ?
Danger Mouse: Hardly .
Penfold: Ere , perhaps when they said ' bicycle clip ' , they met toothbrushes ?
Danger Mouse: Yes , may ... Penfold , you 're pottier than they are !

Output: clips


Input:
Jess Mastriani: No, I don't want another crooler, thank you very much.
 FBI Agent Nicole Scott: But it's good for you. It's got... honeyglaze. Please die for this crooler, Jess.
 Jess Mastriani: I've had _ two _ already. Who eats three croolers in a night?
FBI Agent Nicole Scott: Take a look. [Nicole takes a huge bite] Mmmmm, Mmmmm, Mmmmm!

Output: crooler

Input:
Susan Ivanova:  Another lesson ?
Captain John Sheridan: Uh - huh .
Susan Ivanova: What was this _ one _ about ?
Captain John Sheridan: Uh ... Beauty ... In the dark ...
Susan Ivanova: Well ... They must be working . You 're beginning to sound just like a Vorlon .

Output: lesson

Input:
Catherine Willows:  Mouthing off to teachers , slipping grades , and now hitchhiking . I mean what 's next , Lindsey ?
Lindsey Willows: Stripping .
Catherine Willows: What did you just say ? Okay , no phone , no friends , no nothing .
Lindsey Willows: For how long ?
Catherine Willows: A month .
Lindsey Willows: Whatever .
Catherine Willows: Hey , you want to make it _ two _ ?
Lindsey Willows: Dad always said you were a drama queen .
Catherine Willows: Well , what do you expect , Lindsey , since he was always high .
Lindsey Willows: I 'd take Dad high over you any day ! Nana 's coming to pick me up . I 'll be out front .

Output: month

Input:
Josie:  So how many people have you killed ?
Mitchell: Dunno . It 's hard to say . More than a _ hundred _ , less than a thousand .

Output: person

Input:
Lily:  So that 's what happened to the bouquet . Well , good for Victoria , that 's an evil tradition .
Ted: So wait , you 're not gon na have _ one _ at your wedding ?
Lily: Hell , yeah , I 'm gon na throw that flower grenade and yell " Crawl for it , Bitches ! " It 's just what girls do .

Output: bouquet


Input:
Jess Mastriani: No, I don't want another crooler, thank you very much.
 FBI Agent Nicole Scott: But it's good for you. It's got... honeyglaze. Please die for this crooler, Jess.
 Jess Mastriani: I've had _ two _ already. Who eats three croolers in a night?
FBI Agent Nicole Scott: Take a look. [Nicole takes a huge bite] Mmmmm, Mmmmm, Mmmmm!

Output: crooler

Input:
Susan Ivanova:  Another lesson ?
Captain John Sheridan: Uh - huh .
Susan Ivanova: What was this _ one _ about ?
Captain John Sheridan: Uh ... Beauty ... In the dark ...
Susan Ivanova: Well ... They must be working . You 're beginning to sound just like a Vorlon .

Output: lesson

Input:
Catherine Willows:  Mouthing off to teachers , slipping grades , and now hitchhiking . I mean what 's next , Lindsey ?
Lindsey Willows: Stripping .
Catherine Willows: What did you just say ? Okay , no phone , no friends , no nothing .
Lindsey Willows: For how long ?
Catherine Willows: A month .
Lindsey Willows: Whatever .
Catherine Willows: Hey , you want to make it _ two _ ?
Lindsey Willows: Dad always said you were a drama queen .
Catherine Willows: Well , what do you expect , Lindsey , since he was always high .
Lindsey Willows: I 'd take Dad high over you any day ! Nana 's coming to pick me up . I 'll be out front .

Output: month

Input:
Josie:  So how many people have you killed ?
Mitchell: Dunno . It 's hard to say . More than a _ hundred _ , less than a thousand .

Output: person

Input:
Hank Griffin:  How many rats ?
Nick Burkhardt: What ?
Hank Griffin: For the report , how many rats do you think were down there ?
Nick Burkhardt: Sorry , I did n't stop to count them .
Hank Griffin: I 'd like to put a _ million _ , 'cause that 's what it seemed like .
Nick Burkhardt: Put a thousand . Nobody 's gon na believe a million .
Hank Griffin: No one 's gon na believe a thousand .

Output: rats


Input:
Jess Mastriani: No, I don't want another crooler, thank you very much.
 FBI Agent Nicole Scott: But it's good for you. It's got... honeyglaze. Please die for this crooler, Jess.
 Jess Mastriani: I've had _ two _ already. Who eats three croolers in a night?
FBI Agent Nicole Scott: Take a look. [Nicole takes a huge bite] Mmmmm, Mmmmm, Mmmmm!

Output: crooler

Input:
Susan Ivanova:  Another lesson ?
Captain John Sheridan: Uh - huh .
Susan Ivanova: What was this _ one _ about ?
Captain John Sheridan: Uh ... Beauty ... In the dark ...
Susan Ivanova: Well ... They must be working . You 're beginning to sound just like a Vorlon .

Output: lesson

Input:
Catherine Willows:  Mouthing off to teachers , slipping grades , and now hitchhiking . I mean what 's next , Lindsey ?
Lindsey Willows: Stripping .
Catherine Willows: What did you just say ? Okay , no phone , no friends , no nothing .
Lindsey Willows: For how long ?
Catherine Willows: A month .
Lindsey Willows: Whatever .
Catherine Willows: Hey , you want to make it _ two _ ?
Lindsey Willows: Dad always said you were a drama queen .
Catherine Willows: Well , what do you expect , Lindsey , since he was always high .
Lindsey Willows: I 'd take Dad high over you any day ! Nana 's coming to pick me up . I 'll be out front .

Output: month

Input:
Josie:  So how many people have you killed ?
Mitchell: Dunno . It 's hard to say . More than a _ hundred _ , less than a thousand .

Output: person

Input:
Dr. Dustin Crenshaw:  Mrs. Draper is back for her 27th hospital admission status , post - pancreatic pseudocyst .
Dr. Neela Rasgotra: _ 27 _ ?
Dr. Dustin Crenshaw: Yes , somebody needs to tell her the hospital stopped giving out frequent - flier miles . Oh , and she 's a chronic rectal discomfort , and you two get to work her up and review her old charts .
Dr. Neela Rasgotra: All 27 ?
Dr. Dustin Crenshaw: No , why do n't you just forget all about visits 6 , 13 , and uh , what do you think , 21 ? Yeah , that should keep it interesting . It 'll be like playing patient roulette .

Output: status


Input:
Jess Mastriani: No, I don't want another crooler, thank you very much.
 FBI Agent Nicole Scott: But it's good for you. It's got... honeyglaze. Please die for this crooler, Jess.
 Jess Mastriani: I've had _ two _ already. Who eats three croolers in a night?
FBI Agent Nicole Scott: Take a look. [Nicole takes a huge bite] Mmmmm, Mmmmm, Mmmmm!

Output: crooler

Input:
Susan Ivanova:  Another lesson ?
Captain John Sheridan: Uh - huh .
Susan Ivanova: What was this _ one _ about ?
Captain John Sheridan: Uh ... Beauty ... In the dark ...
Susan Ivanova: Well ... They must be working . You 're beginning to sound just like a Vorlon .

Output: lesson

Input:
Catherine Willows:  Mouthing off to teachers , slipping grades , and now hitchhiking . I mean what 's next , Lindsey ?
Lindsey Willows: Stripping .
Catherine Willows: What did you just say ? Okay , no phone , no friends , no nothing .
Lindsey Willows: For how long ?
Catherine Willows: A month .
Lindsey Willows: Whatever .
Catherine Willows: Hey , you want to make it _ two _ ?
Lindsey Willows: Dad always said you were a drama queen .
Catherine Willows: Well , what do you expect , Lindsey , since he was always high .
Lindsey Willows: I 'd take Dad high over you any day ! Nana 's coming to pick me up . I 'll be out front .

Output: month

Input:
Josie:  So how many people have you killed ?
Mitchell: Dunno . It 's hard to say . More than a _ hundred _ , less than a thousand .

Output: person

Input:
Cory Matthews:  Topanga , I warned you not to ... ... Oh , boy , why 'd you have to wear that ?
Topanga Lawrence: Because I 'm a damsel . But not the distressed kind . _ One _ who is very together and in complete control of her own destiny .

Output: damsel


The task is to write a full sentence or two using all of the information given. The sentence(s) will be a brief review of a restaurant. Use all of the information provided.

Input: name[xname], cuisine[Fast Food], rating[average], familyFriendly[yes], near[xnear]

Output: Located near xnear, xname serves Fast food and is child friendly. its customer rating is: average.

Explanation: This is a good example of the task because the written sentence uses all of the given information.

Input: name[xname], cuisine[Chinese], price[less than £20]

Output: xname, Chinese restaurant,  prices from £19.99

Explanation: This is a good example. The output uses all of the given information.

Input: name[xname], recommend[yes], cuisine[Vietnamese], qual[good], price[affordable]

Output: I would suggest xname because it's affordable and a Vietnamese restaurant with nice food!

Explanation: This is another good example because the sentence is a normal sentence that describes the restaurant and contains all of the given information.

Input: name[xname], recommend[yes], decor[good], qual[acceptable], service[good]

Output: xname is a restaurant with poor service but acceptable food and good decor.

Explanation: This is a bad example because the sentence does not match the given information (service is poor instead of good.) Also it is missing information about whether the restaurant is recommended or not.

Input: name[xname], eattype[coffee shop], cuisine[Chinese], price[moderate], location[riverside], near[xnear]

Output: xname is a Chinese coffee shop located in riverside near xnear.

Explanation: This is a bad example because it does not include the price, thereby missing some information.

Public Places -> Restaurants
Reviews -> Restaurants

Input: name[xname], recommend[yes], qual[acceptable], location[Murray Hill]

Output: xname is the best place because it is in Murray Hill with adequate food.


Input: name[xname], cuisine[Fast Food], rating[average], familyFriendly[yes], near[xnear]

Output: Located near xnear, xname serves Fast food and is child friendly. its customer rating is: average.

Input: name[xname], cuisine[Chinese], price[less than £20]

Output: xname, Chinese restaurant,  prices from £19.99

Input: name[xname], recommend[yes], cuisine[Vietnamese], qual[good], price[affordable]

Output: I would suggest xname because it's affordable and a Vietnamese restaurant with nice food!

Input: name[xname], recommend[yes], decor[good], qual[acceptable], service[good]

Output: xname is a restaurant with poor service but acceptable food and good decor.

Input: name[xname], eattype[coffee shop], cuisine[Chinese], price[moderate], location[riverside], near[xnear]

Output: xname is a Chinese coffee shop located in riverside near xnear.

Input: name[xname], recommend[yes], cuisine[Italian], decor[bad], qual[acceptable], location[Chinatown], price[affordable], service[bad]

Output: xname is the only restaurant I would suggest since it provides rude staff and bad ambiance. It is an Italian place with satisfying food. it's in Chinatown. xname is affordable.


Input: name[xname], cuisine[Fast Food], rating[average], familyFriendly[yes], near[xnear]

Output: Located near xnear, xname serves Fast food and is child friendly. its customer rating is: average.

Input: name[xname], cuisine[Chinese], price[less than £20]

Output: xname, Chinese restaurant,  prices from £19.99

Input: name[xname], recommend[yes], cuisine[Vietnamese], qual[good], price[affordable]

Output: I would suggest xname because it's affordable and a Vietnamese restaurant with nice food!

Input: name[xname], recommend[yes], decor[good], qual[acceptable], service[good]

Output: xname is a restaurant with poor service but acceptable food and good decor.

Input: name[xname], eattype[coffee shop], cuisine[Chinese], price[moderate], location[riverside], near[xnear]

Output: xname is a Chinese coffee shop located in riverside near xnear.

Input: name[xname], eattype[coffee shop], cuisine[Indian], price[£20-25], rating[high], familyFriendly[yes]

Output: xname is a coffee shop that provides Indian food. The price range is £20-25. It has a high customer rating and is kids friendly.

eattype[coffee shop] is priced from £20-25.


Input: name[xname], cuisine[Fast Food], rating[average], familyFriendly[yes], near[xnear]

Output: Located near xnear, xname serves Fast food and is child friendly. its customer rating is: average.

Input: name[xname], cuisine[Chinese], price[less than £20]

Output: xname, Chinese restaurant,  prices from £19.99

Input: name[xname], recommend[yes], cuisine[Vietnamese], qual[good], price[affordable]

Output: I would suggest xname because it's affordable and a Vietnamese restaurant with nice food!

Input: name[xname], recommend[yes], decor[good], qual[acceptable], service[good]

Output: xname is a restaurant with poor service but acceptable food and good decor.

Input: name[xname], eattype[coffee shop], cuisine[Chinese], price[moderate], location[riverside], near[xnear]

Output: xname is a Chinese coffee shop located in riverside near xnear.

Input: name[xname], cuisine[Chinese], price[more than £30], familyFriendly[yes], near[xnear]

Output: Located near xnear, xname Chinese restaurant is child friendly but be prepared to pay more than 30 British pounds.

xname, food, Chiinese, price, familyFriendly[yes]


Input: name[xname], cuisine[Fast Food], rating[average], familyFriendly[yes], near[xnear]

Output: Located near xnear, xname serves Fast food and is child friendly. its customer rating is: average.

Input: name[xname], cuisine[Chinese], price[less than £20]

Output: xname, Chinese restaurant,  prices from £19.99

Input: name[xname], recommend[yes], cuisine[Vietnamese], qual[good], price[affordable]

Output: I would suggest xname because it's affordable and a Vietnamese restaurant with nice food!

Input: name[xname], recommend[yes], decor[good], qual[acceptable], service[good]

Output: xname is a restaurant with poor service but acceptable food and good decor.

Input: name[xname], eattype[coffee shop], cuisine[Chinese], price[moderate], location[riverside], near[xnear]

Output: xname is a Chinese coffee shop located in riverside near xnear.

Input: name[xname], cuisine[Indian], location[city centre], familyFriendly[yes]

Output: xname provides Indian food It is located in the city centre.

xname, food,Indian, location[city centre]


Explanation: Textual Entailment -> Deductive Reasoning

In this task, given 2 input sentences, you must classify the relation between them. If the second sentence has a similar meaning to that of the first sentence then the output is ' B_entails_A', if the second sentence has the opposite meaning to the first sentence then it is classified as ' B_contradicts_A'. If you cannot clearly ascertain agreement/disagreement between the two sentences, the label is ' B_neutral_A'.

Input: sentence_A: man is wearing a hard hat and dancing. sentence_B: There is no man with a hard hat dancing.

Output: B_contradicts_A

Explanation: The sentence B has opposite meaning as sentence_B says, "No man with a hat", but sentence_A says, "A man is wearing a hat", so B is contradicting A.

Input: sentence_A: A baby is crying. sentence_B: A man is exercising.

Output: B_neutral_A

Explanation: Sentence B says exercising but sentence A says crying, which are two different tasks and is not contradicting as they don't have the opposite meaning, so B_neutral_A.

Input: sentence_A: A tiger is pacing around a cage. sentence_B: A tiger is walking around a cage

Output: B_entails_A

Explanation: Walking and pacing are synonyms, so B_entails_A is correct.

Input: sentence_A: There is no man playing an instrument. sentence_B: A man is playing an instrument.

Output: B_neutral_A

Explanation: B says man is playing an instrument, while A says no man is playing, so this is a contradiction not neutral.

Input: sentence_A: A man is walking slowly across a rope bridge sentence_B: A boy is fearfully walking across a bridge

Output: B_entails_A

Explanation: Fearfully and walking slowly are different meanings and not same, they are not even opposite words, so this is B_Neutral_A, not B_entails_A.

Input: sentence_A: A lady is mixing a meat mixture in a bowl sentence_B: The woman is stirring meat in a bowl

Output: B_contradicts_A

Explanation: Stirring meat and mixing meat are synonyms, so this is B_entails_A, not B_Contradicts_A.

Captions -> Video Captions
Captions -> Image Captions

Input: sentence_A: A woman is coating a pork chop. sentence_B: A cook is coating a pork chop

Output: B_neutral_A


Input: sentence_A: man is wearing a hard hat and dancing. sentence_B: There is no man with a hard hat dancing.

Output: B_contradicts_A

Input: sentence_A: A baby is crying. sentence_B: A man is exercising.

Output: B_neutral_A

Input: sentence_A: A tiger is pacing around a cage. sentence_B: A tiger is walking around a cage

Output: B_entails_A

Input: sentence_A: There is no man playing an instrument. sentence_B: A man is playing an instrument.

Output: B_neutral_A

Input: sentence_A: A man is walking slowly across a rope bridge sentence_B: A boy is fearfully walking across a bridge

Output: B_entails_A

Input: sentence_A: A lady is mixing a meat mixture in a bowl sentence_B: The woman is stirring meat in a bowl

Output: B_contradicts_A

Input: sentence_A: A woman is cutting a tomato. sentence_B: A woman is slicing a tomato

Output: B_entails_A


Input: sentence_A: man is wearing a hard hat and dancing. sentence_B: There is no man with a hard hat dancing.

Output: B_contradicts_A

Input: sentence_A: A baby is crying. sentence_B: A man is exercising.

Output: B_neutral_A

Input: sentence_A: A tiger is pacing around a cage. sentence_B: A tiger is walking around a cage

Output: B_entails_A

Input: sentence_A: There is no man playing an instrument. sentence_B: A man is playing an instrument.

Output: B_neutral_A

Input: sentence_A: A man is walking slowly across a rope bridge sentence_B: A boy is fearfully walking across a bridge

Output: B_entails_A

Input: sentence_A: A lady is mixing a meat mixture in a bowl sentence_B: The woman is stirring meat in a bowl

Output: B_contradicts_A

Input: sentence_A: A boy is knocking a dog with a bottle of water. sentence_B: The dog is knocking a boy into the water

Output: B_neutral_A


Input: sentence_A: man is wearing a hard hat and dancing. sentence_B: There is no man with a hard hat dancing.

Output: B_contradicts_A

Input: sentence_A: A baby is crying. sentence_B: A man is exercising.

Output: B_neutral_A

Input: sentence_A: A tiger is pacing around a cage. sentence_B: A tiger is walking around a cage

Output: B_entails_A

Input: sentence_A: There is no man playing an instrument. sentence_B: A man is playing an instrument.

Output: B_neutral_A

Input: sentence_A: A man is walking slowly across a rope bridge sentence_B: A boy is fearfully walking across a bridge

Output: B_entails_A

Input: sentence_A: A lady is mixing a meat mixture in a bowl sentence_B: The woman is stirring meat in a bowl

Output: B_contradicts_A

Input: sentence_A: A woman is standing near three children. sentence_B: There is no woman standing near three children

Output: B_contradicts_A


Input: sentence_A: man is wearing a hard hat and dancing. sentence_B: There is no man with a hard hat dancing.

Output: B_contradicts_A

Input: sentence_A: A baby is crying. sentence_B: A man is exercising.

Output: B_neutral_A

Input: sentence_A: A tiger is pacing around a cage. sentence_B: A tiger is walking around a cage

Output: B_entails_A

Input: sentence_A: There is no man playing an instrument. sentence_B: A man is playing an instrument.

Output: B_neutral_A

Input: sentence_A: A man is walking slowly across a rope bridge sentence_B: A boy is fearfully walking across a bridge

Output: B_entails_A

Input: sentence_A: A lady is mixing a meat mixture in a bowl sentence_B: The woman is stirring meat in a bowl

Output: B_contradicts_A

Input: sentence_A: A man is jumping a wall. sentence_B: A man is standing in front of a wall

Output: B_contradicts_A


In this task, you will be given two sentences sentence1 and sentence2. You should decide whether the second sentence is entailed(agreed) by the first sentence. If it does entail, answer "yes", else answer "no".

Input:
sentence1:region is nation in location
sentence2:region is country in location

Output: yes

Explanation: A nation is a community of people of similar characteristics/descent with a common government. A country is a region sharing a common government. Hence, a nation can be defined as a country.

Input: sentence1:location is going to war with region sentence1:location is facing  region

Output: yes

Explanation: Both sentences have the same meaning. So the second sentence entails the first sentence.

Input:
sentence1:person is calling  location
sentence2:person is urging  location

Output: no

Explanation: Calling a location does not mean urging it.

Input:
sentence1:award_winner is edging  employer
sentence2:award_winner is winning over employer

Output: Incorrect

Explanation: Answer expected is either "yes" or "no"

Input:
sentence1:award_nominee is finishing in sports.sports_league
sentence2:award_nominee is teaming in sports.sports_league

Output: yes

Explanation: Finishing in a sport means a person or team is competing in it, while teaming means participating in a team. A sportsperson may finishing in a solo event (with no teams) as well, hence correct answer here is no.

Input: sentence1:employer is eliminating  sports_team*professional_sports_team sentence1:employer is hosting  sports_team*professional_sports_team

Output: no


Input:
sentence1:region is nation in location
sentence2:region is country in location

Output: yes

Input: sentence1:location is going to war with region sentence1:location is facing  region

Output: yes

Input:
sentence1:person is calling  location
sentence2:person is urging  location

Output: no

Input:
sentence1:award_winner is edging  employer
sentence2:award_winner is winning over employer

Output: Incorrect

Explanation: Answer expected is either "yes" or "no"

Input:
sentence1:award_nominee is finishing in sports.sports_league
sentence2:award_nominee is teaming in sports.sports_league

Output: yes

Input: sentence1:person is elected President of location sentence1:person is leading  location

Output: yes


Input:
sentence1:region is nation in location
sentence2:region is country in location

Output: yes

Input: sentence1:location is going to war with region sentence1:location is facing  region

Output: yes

Input:
sentence1:person is calling  location
sentence2:person is urging  location

Output: no

Input:
sentence1:award_winner is edging  employer
sentence2:award_winner is winning over employer

Output: Incorrect

Explanation: Answer expected is either "yes" or "no"

Input:
sentence1:award_nominee is finishing in sports.sports_league
sentence2:award_nominee is teaming in sports.sports_league

Output: yes

Input: sentence1:award_winner is unveiling at time.recurring_event sentence1:award_winner announces At time.recurring_event

Output: yes


Input:
sentence1:region is nation in location
sentence2:region is country in location

Output: yes

Input: sentence1:location is going to war with region sentence1:location is facing  region

Output: yes

Input:
sentence1:person is calling  location
sentence2:person is urging  location

Output: no

Input:
sentence1:award_winner is edging  employer
sentence2:award_winner is winning over employer

Output: Incorrect

Explanation: Answer expected is either "yes" or "no"

Input:
sentence1:award_nominee is finishing in sports.sports_league
sentence2:award_nominee is teaming in sports.sports_league

Output: yes

Input: sentence1:organization is cancelling  award.award_winning_work sentence1:award.award_winning_work is airing on organization

Output: no


Input:
sentence1:region is nation in location
sentence2:region is country in location

Output: yes

Input: sentence1:location is going to war with region sentence1:location is facing  region

Output: yes

Input:
sentence1:person is calling  location
sentence2:person is urging  location

Output: no

Input:
sentence1:award_winner is edging  employer
sentence2:award_winner is winning over employer

Output: Incorrect

Explanation: Answer expected is either "yes" or "no"

Input:
sentence1:award_nominee is finishing in sports.sports_league
sentence2:award_nominee is teaming in sports.sports_league

Output: yes

Input: sentence1:employer is dominating  location sentence1:employer is taking  location

Output: yes


Explanation: Commonsense Reasoning

You are given a context, a pronoun, and a noun in this task. The given pronoun is shown in the context within parentheses. You should determine if the pronoun refers to the given noun or not. Please answer with "True" and "False".

Input: Sam pulled up a chair to the piano , but (it) was broken, so he had to sing instead. <sep> Pronoun:it <sep> Noun: the piano

Output: True

Explanation: This is a good example. In this context, he had to sing after recognizing it was broken. So, it refers to the piano.

Input: Fred covered his eyes with his hands , because the wind was blowing sand around. He lowered (them) when the wind stopped. <sep> Pronoun:them <sep> Noun: his eyes

Output: False

Explanation: In this example, he lowered his hands when the wind stopped. So, them refer to his hands, and the output should be "False".

Input: Our mistress hired a room for my crippled sister Nelly , and she gave (her) knitting and needlework when she was able to do it, and when she was ill she sent her dinners and many nice comfortable things and was like a mother to her. <sep> Pronoun:her <sep> Noun: Nelly

Output: True

Explanation: In this example, her refers to Nelly. So, the given noun is correct, and the output should be "True".

Input: Jim yelled at Kevin because (he) was so upset. <sep> Pronoun:he <sep> Noun: Kevin

Output: True

Explanation: In this example, he refers to Jim. So, kevin is incorrect, and the output should be "False".

Input: Meanwhile, in the forest, the elephants are calling and hunting high and low for Arthur and Celeste , and their mothers are very worried. Fortunately, in flying over the town, an old marabou bird has seen (them) and come back quickly to tell the news. <sep> Pronoun:them <sep> Noun: Arthur and Celeste

Output: False

Explanation: In this example, them refer to Arthur and Celeste. So, the output should be "True".

Input: The woman held the girl against (her) will. <sep> Pronoun:her <sep> Noun: The woman

Output: False


Explanation: Commonsense Reasoning

Input: Sam pulled up a chair to the piano , but (it) was broken, so he had to sing instead. <sep> Pronoun:it <sep> Noun: the piano

Output: True

Input: Fred covered his eyes with his hands , because the wind was blowing sand around. He lowered (them) when the wind stopped. <sep> Pronoun:them <sep> Noun: his eyes

Output: False

Input: Our mistress hired a room for my crippled sister Nelly , and she gave (her) knitting and needlework when she was able to do it, and when she was ill she sent her dinners and many nice comfortable things and was like a mother to her. <sep> Pronoun:her <sep> Noun: Nelly

Output: True

Input: Jim yelled at Kevin because (he) was so upset. <sep> Pronoun:he <sep> Noun: Kevin

Output: True

Input: Meanwhile, in the forest, the elephants are calling and hunting high and low for Arthur and Celeste , and their mothers are very worried. Fortunately, in flying over the town, an old marabou bird has seen (them) and come back quickly to tell the news. <sep> Pronoun:them <sep> Noun: Arthur and Celeste

Output: False

Input: Anne gave birth to a daughter last month. (She) is a very charming woman. <sep> Pronoun:She <sep> Noun: Anne

Output: True


Explanation: Commonsense Reasoning

Input: Sam pulled up a chair to the piano , but (it) was broken, so he had to sing instead. <sep> Pronoun:it <sep> Noun: the piano

Output: True

Input: Fred covered his eyes with his hands , because the wind was blowing sand around. He lowered (them) when the wind stopped. <sep> Pronoun:them <sep> Noun: his eyes

Output: False

Input: Our mistress hired a room for my crippled sister Nelly , and she gave (her) knitting and needlework when she was able to do it, and when she was ill she sent her dinners and many nice comfortable things and was like a mother to her. <sep> Pronoun:her <sep> Noun: Nelly

Output: True

Input: Jim yelled at Kevin because (he) was so upset. <sep> Pronoun:he <sep> Noun: Kevin

Output: True

Input: Meanwhile, in the forest, the elephants are calling and hunting high and low for Arthur and Celeste , and their mothers are very worried. Fortunately, in flying over the town, an old marabou bird has seen (them) and come back quickly to tell the news. <sep> Pronoun:them <sep> Noun: Arthur and Celeste

Output: False

Input: Papa looked down at the children 's faces , so puzzled and sad now. It was bad enough that (they) had to be denied so many things because he couldn't afford them. <sep> Pronoun:they <sep> Noun: children

Output: True


Explanation: Commonsense Reasoning

Input: Sam pulled up a chair to the piano , but (it) was broken, so he had to sing instead. <sep> Pronoun:it <sep> Noun: the piano

Output: True

Input: Fred covered his eyes with his hands , because the wind was blowing sand around. He lowered (them) when the wind stopped. <sep> Pronoun:them <sep> Noun: his eyes

Output: False

Input: Our mistress hired a room for my crippled sister Nelly , and she gave (her) knitting and needlework when she was able to do it, and when she was ill she sent her dinners and many nice comfortable things and was like a mother to her. <sep> Pronoun:her <sep> Noun: Nelly

Output: True

Input: Jim yelled at Kevin because (he) was so upset. <sep> Pronoun:he <sep> Noun: Kevin

Output: True

Input: Meanwhile, in the forest, the elephants are calling and hunting high and low for Arthur and Celeste , and their mothers are very worried. Fortunately, in flying over the town, an old marabou bird has seen (them) and come back quickly to tell the news. <sep> Pronoun:them <sep> Noun: Arthur and Celeste

Output: False

Input: Paul tried to call George on the phone, but (he) wasn't available. <sep> Pronoun:he <sep> Noun: Paul

Output: False


Explanation: Commonsense Reasoning

Input: Sam pulled up a chair to the piano , but (it) was broken, so he had to sing instead. <sep> Pronoun:it <sep> Noun: the piano

Output: True

Input: Fred covered his eyes with his hands , because the wind was blowing sand around. He lowered (them) when the wind stopped. <sep> Pronoun:them <sep> Noun: his eyes

Output: False

Input: Our mistress hired a room for my crippled sister Nelly , and she gave (her) knitting and needlework when she was able to do it, and when she was ill she sent her dinners and many nice comfortable things and was like a mother to her. <sep> Pronoun:her <sep> Noun: Nelly

Output: True

Input: Jim yelled at Kevin because (he) was so upset. <sep> Pronoun:he <sep> Noun: Kevin

Output: True

Input: Meanwhile, in the forest, the elephants are calling and hunting high and low for Arthur and Celeste , and their mothers are very worried. Fortunately, in flying over the town, an old marabou bird has seen (them) and come back quickly to tell the news. <sep> Pronoun:them <sep> Noun: Arthur and Celeste

Output: False

Input: Thomson visited Cooper 's grave in 1765. At that date (he) had been travelling for five years. <sep> Pronoun:he <sep> Noun: Thomson

Output: True


Explanation: Textual Entailment

In this task, you're given a pair of sentences, sentence 1 and sentence 2. Your job is to determine if the two sentences clearly agree/disagree with each other, or if this can't be determined. Indicate your answer as yes or no respectively.

Input: Sentence 1: Next to the MGM Grand you will find M and M World. Sentence 2: The candy has many fans who love its attractions.

Output: no

Explanation: It is not clear that M and M world is popular.

Input: Sentence 1: I've forgotten his name now, confessed Tuppence. Sentence 2: Tuppence remembered his name later.

Output: no

Explanation: Tuppence may or may not have later remembered the name.

Input: Sentence 1: One of the first organizational realignments taking place is in the Office of the Taxpayer Advocate. Sentence 2: The office of the taxpayer advocate is having an organizational realignment.

Output: yes

Explanation: Both sentences refer to the reorganization of an official department and agree with each other.

Input: Sentence 1: yeah i tell you what though if you go price some of those tennis shoes i can see why now you know they're getting up in the hundred dollar range. Sentence 2: The tennis shoes have only one price.

Output: yes

Explanation: The prices of the shoes vary in the hundred dollar range in the first sentence, so the second sentence disagrees with it as the tennis shoes can't have only one price.

Input: Sentence 1: There was an earthquake in San Fransisco. Sentence 2: The earthquake caused a lot of road damage.

Output: yes

Explanation: The magnitude of the earthquake may or may not have been large enough to cause damage.

Input: Sentence 1: Representing yourself in court can be a tricky endeavor. Sentence 2: Lawyers are much better than self-representation.

Output: yes

Explanation: Even though self-representation in court is tricky, that doesn't indicate or deny that lawyers are better than self-representation. So, the output should be no.

Input: Sentence 1: Anna went to the school picnic and had a busy afternoon. Sentence 2: Anna had lunch at the picnic with her classmates.

Output: no

Explanation: The sentences both refer to a picnic Anna attended, organized by her school and clearly agree with each other. So, the output should be yes.

History
Fiction
Dialogue
Law
Government and Politics

Input: Sentence 1: For three decades, Krakew existed as an independent city-state, though it was again incorporated into the Austrian partition in 1846. Sentence 2: Krakew fought not to be a part of the Austrian 1846 partition.

Output: no


Explanation: Textual Entailment

Input: Sentence 1: Next to the MGM Grand you will find M and M World. Sentence 2: The candy has many fans who love its attractions.

Output: no

Input: Sentence 1: I've forgotten his name now, confessed Tuppence. Sentence 2: Tuppence remembered his name later.

Output: no

Input: Sentence 1: One of the first organizational realignments taking place is in the Office of the Taxpayer Advocate. Sentence 2: The office of the taxpayer advocate is having an organizational realignment.

Output: yes

Input: Sentence 1: yeah i tell you what though if you go price some of those tennis shoes i can see why now you know they're getting up in the hundred dollar range. Sentence 2: The tennis shoes have only one price.

Output: yes

Input: Sentence 1: There was an earthquake in San Fransisco. Sentence 2: The earthquake caused a lot of road damage.

Output: yes

Input: Sentence 1: Representing yourself in court can be a tricky endeavor. Sentence 2: Lawyers are much better than self-representation.

Output: yes

Input: Sentence 1: Anna went to the school picnic and had a busy afternoon. Sentence 2: Anna had lunch at the picnic with her classmates.

Output: no

Input: Sentence 1: The club itself was a bastion of Ascendancy establishment. Sentence 2: The club was a fortification of Ascendancy establishment.

Output: yes


Explanation: Textual Entailment

Input: Sentence 1: Next to the MGM Grand you will find M and M World. Sentence 2: The candy has many fans who love its attractions.

Output: no

Input: Sentence 1: I've forgotten his name now, confessed Tuppence. Sentence 2: Tuppence remembered his name later.

Output: no

Input: Sentence 1: One of the first organizational realignments taking place is in the Office of the Taxpayer Advocate. Sentence 2: The office of the taxpayer advocate is having an organizational realignment.

Output: yes

Input: Sentence 1: yeah i tell you what though if you go price some of those tennis shoes i can see why now you know they're getting up in the hundred dollar range. Sentence 2: The tennis shoes have only one price.

Output: yes

Input: Sentence 1: There was an earthquake in San Fransisco. Sentence 2: The earthquake caused a lot of road damage.

Output: yes

Input: Sentence 1: Representing yourself in court can be a tricky endeavor. Sentence 2: Lawyers are much better than self-representation.

Output: yes

Input: Sentence 1: Anna went to the school picnic and had a busy afternoon. Sentence 2: Anna had lunch at the picnic with her classmates.

Output: no

Input: Sentence 1: Impaling all the old men took a long time and when the armored men stood the pikes upright, the sharp tips gleaming from the elders' gaping mouths. Sentence 2: It took a long time but old men were impailed.

Output: yes


Explanation: Textual Entailment

Input: Sentence 1: Next to the MGM Grand you will find M and M World. Sentence 2: The candy has many fans who love its attractions.

Output: no

Input: Sentence 1: I've forgotten his name now, confessed Tuppence. Sentence 2: Tuppence remembered his name later.

Output: no

Input: Sentence 1: One of the first organizational realignments taking place is in the Office of the Taxpayer Advocate. Sentence 2: The office of the taxpayer advocate is having an organizational realignment.

Output: yes

Input: Sentence 1: yeah i tell you what though if you go price some of those tennis shoes i can see why now you know they're getting up in the hundred dollar range. Sentence 2: The tennis shoes have only one price.

Output: yes

Input: Sentence 1: There was an earthquake in San Fransisco. Sentence 2: The earthquake caused a lot of road damage.

Output: yes

Input: Sentence 1: Representing yourself in court can be a tricky endeavor. Sentence 2: Lawyers are much better than self-representation.

Output: yes

Input: Sentence 1: Anna went to the school picnic and had a busy afternoon. Sentence 2: Anna had lunch at the picnic with her classmates.

Output: no

Input: Sentence 1: Ninety-five percent of the total amount of sulfur dioxide allowances allocated each year under Section 423 will be allocated based on the amount of sulfur dioxide allowances allocated under the Acid Rain Program for 2010 and thereafter and that are held in allowance accounts in the Allowance Tracking System on the date 180 days after enactment. Sentence 2: Most of the sulfur dioxide that is allowed are controlled by the Acid Rain Program.

Output: no

Output: yes


Explanation: Textual Entailment

Input: Sentence 1: Next to the MGM Grand you will find M and M World. Sentence 2: The candy has many fans who love its attractions.

Output: no

Input: Sentence 1: I've forgotten his name now, confessed Tuppence. Sentence 2: Tuppence remembered his name later.

Output: no

Input: Sentence 1: One of the first organizational realignments taking place is in the Office of the Taxpayer Advocate. Sentence 2: The office of the taxpayer advocate is having an organizational realignment.

Output: yes

Input: Sentence 1: yeah i tell you what though if you go price some of those tennis shoes i can see why now you know they're getting up in the hundred dollar range. Sentence 2: The tennis shoes have only one price.

Output: yes

Input: Sentence 1: There was an earthquake in San Fransisco. Sentence 2: The earthquake caused a lot of road damage.

Output: yes

Input: Sentence 1: Representing yourself in court can be a tricky endeavor. Sentence 2: Lawyers are much better than self-representation.

Output: yes

Input: Sentence 1: Anna went to the school picnic and had a busy afternoon. Sentence 2: Anna had lunch at the picnic with her classmates.

Output: no

Input: Sentence 1: well let's see if you're in Plano and i'm in Plano are you in east Plano or west Plano Sentence 2: We are both in Plano, which side are you in?

Output: yes


Explanation: Commonsense Reasoning

In this task, you're given a fill-in-the-blank question that contains two object names. Additionally, you're given one answer which is one of the objects present in the question. In this task, you need to minimally change the given question so that the answer flips to another object in the question. Remember the question has to be about both objects which are related but different; for example, "trophy" and "suitcase". This task typically involves replacing one word i.e., the 'trigger word' with its antonym (e.g., changing from "small" to "big"). You should not change any content in the given question beyond a word or two, i.e., the trigger word/phrase. The expected answer to your question must not be associated with just the trigger word; instead, it should depend on the context present in the question. The expected answer should not be ambiguous. For your question, there should be an agreed upon answer to fill in the blank. Your generations should NOT contain potentially explicit, offensive, or adult content. In your generated question, retain the object names from the input question. Avoid repeating the same style or phrase in generating your modified question e.g. this task can be always solved using a simple negation i.e. by adding not, never, etc. Instead, try to increase the word diversity. Your question must contain at least 15 and at most 30 words. Your question must have at least 70% overlapping words with the given question. You must utilize the given context word while writing the question. Your question must contain only one blank. The two objects should be used ONCE in your question. Here is a list of attributes and associated contrastive words that may help write contrastive trigger words. Note that contrastive trigger words help in flipping the label.
| Attribute | triggerword | contrastive triggerword |
| age | old | new |
| altitude | low | high |
| area | small | vast |
| brightness | dark | light |
| clarity | obscure | clear |
| cleanness | dirty | clean |
| complexity | simple | complex |
| cost | cheap | expensive |
| density | sparse | dense |
| depth | shallow | deep |
| distance | near | far |
| electric conductivity | low | high |
| flexibility | rigid | flexible |
| granularity | fine | coarse |
| hardness | soft | hard |
| length | short | long |
| magnitude | small | large |
| mass | small | large |
| odor | weak | strong |
| pressure | low | high |
| resistance | low | high |
| shape | round | sharp |
| shape | flat | spiky |
| size | small | large |
| sound | quiet | loud |
| sound pitch | low | high |
| speed | slow | fast |
| stability | unstable | stable |
| strength | weak | strong |
| temperature | low | high |
| texture | smooth | rough |
| thermal conductivity | low | high |
| thickness | thin | thick |
| volume | small | large |
| weight | light | heavy |
| width | narrow | wide |
| location | in | out |
| location | up | down |
| location | above | below |
| location | on | off |
| location | to | from |

Input:
Context word: fit.
Question: The trophy doesn't fit into the brown suitcase because _ is too large.
Answer: trophy.

Output: The trophy doesn't fit into the brown suitcase because _ is too small.

Explanation: Here, replacing the trigger word "large" by its antonym "small" flips answer to the second object ("suitcase") in the question. So, this is a valid question.

Input:
Context word: trade.
Question: Grace was happy to trade me her sweater for my jacket. She thinks _ looks dowdy on her.
Answer: sweater.

Output: Grace was happy to trade me her sweater for my jacket. She thinks _ looks great on her.

Explanation: Here, replacing the trigger word "dowdy" by its antonym "great" flips answer to the second object ("jacket") in the question. Therefore, this is a valid question.

Input:
Context word: carpet.
Question: While redecorating her home, Sam took out the carpet and replaced it with wood floors. The _ was old.
Answer: carpet.

Output: While redecorating her home, Sam took out the carpet and replaced it with wood floors. The _ was trendy.

Explanation: This is a valid question because: on replacing the trigger word "old" by its antonym "trendy", the answer flips to the second object ("wood floors") in the question.

Input:
Context word: fit.
Question: The table won't fit through the doorway because the _ is too wide.
Answer: table.

Output: The table won't fit through the doorway because the _ is too narrow.

Explanation: Here, replacing the trigger word "wide" by its antonym "narrow" flips answer to the second object ("doorway") in the question. That's why this is a good question.

Input:
Context word: water.
Question: I poured water from the bottle into the cup until the _ was empty.
Answer: bottle.

Output: I poured water from the bottle into the cup until the _ was full.

Explanation: Here, replacing the trigger word "empty" by its antonym "full" flips answer to the second object ("cup") in the question. That's why this is a good question.

Input:
Context word: catch.
Question: My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the _ was short, so it worked out.
Answer: meeting.

Output: My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the _ was delayed, so it worked out.

Explanation: Here, replacing the trigger word "short" by its antonym "delayed" flips answer to the second object ("train") in the question. So, this is a valid question.

Input:
Context word: candle.
Question: James wanted to light the candle in the wind when on a date but the _ is too weak.
Answer: light.

Output: James wanted to light the candle in the wind when on a date but the _ is too strong.

Explanation: On replacing the trigger word "weak" by its antonym "strong", the answer flips to the second object ("wind") in the question. So, this is a valid question.

Input:
Context word: fit.
Question: The trophy doesn't fit into the brown suitcase because _ is too large.
Answer: trophy.

Output: The trophy doesn't fit into the brown suitcase because there were a lot of other eseential items and jewlleries to pack and  _ is too large.

Explanation: The problem here is that, the new question is very different from the given question. Note that, the new question must have at least 70% word overlap with the given question.

Input:
Context word: trade.
Question: Grace was happy to trade me her sweater for my jacket. She thinks _ looks dowdy on her.
Answer: sweater.

Output: Grace was happy to trade me her sweater for my jacket. She thinks _ is colored purple.

Explanation: Here, there is an issue as both objects ("sweater" and "jacket") are equally likely to fill the blank. This makes the question ambiguous.

Input:
Context word: carpet.
Question: While redecorating her home, Sam took out the carpet and replaced it with wood floors. The _ was old.
Answer: carpet.

Output: While redecorating her home, Sam took out the carpet and replaced it with wood floors. The wood floor's feature is that _  was trendy.

Explanation: Here the object "wood floor" has been used more than once in the question. Note that the two objects should be used ONCE in your question.

Input:
Context word: fit.
Question: The table won't fit through the doorway because the _ is too wide.
Answer: table.

Output: The table is brown in color which is different from the color of the _.

Explanation: The question is based on color of objects which is different from the context word "fit". Note that, you must utilize the given context word while writing the question.

Input:
Context word: water.
Question: I poured water from the bottle into the cup until the _ was empty.
Answer: bottle.

Output: I poured water from the bottle into the _ until the _ was empty.

Explanation: This question contains more than one blank. Note that, your question must contain only one blank.

Input:
Context word: catch.
Question: My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the _ was short, so it worked out.
Answer: meeting.

Output: My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the meeting was _.

Explanation: The expected answer to this question is "short" which is not one of the two objects present in the question ("train" and "meeting"). Note that, the answer in your generated question must flip to another object in the question.

Input:
Context word: candle.
Question: James wanted to light the candle in the wind when on a date but the _ is too weak.
Answer: light.

Output: James wanted to light the candle in the _.

Explanation: The issue is that the generated question has lesser than 15 words. Remember, your question must contain at least 15 and at most 30 words.

Commonsense -> Concepts and Relations -> Physical Commonsense

Input:
Context Word: cardboard.
Question: The shirt was in the cardboard box and the book was sitting on top of it when it rained, so the _ got wet.
Answer: book.

Output: The shirt was in the cardboard box and the book was sitting on top of it when it rained, so the _ stayed dry.


Explanation: Commonsense Reasoning

Input:
Context word: fit.
Question: The trophy doesn't fit into the brown suitcase because _ is too large.
Answer: trophy.

Output: The trophy doesn't fit into the brown suitcase because _ is too small.

Input:
Context word: trade.
Question: Grace was happy to trade me her sweater for my jacket. She thinks _ looks dowdy on her.
Answer: sweater.

Output: Grace was happy to trade me her sweater for my jacket. She thinks _ looks great on her.

Input:
Context word: carpet.
Question: While redecorating her home, Sam took out the carpet and replaced it with wood floors. The _ was old.
Answer: carpet.

Output: While redecorating her home, Sam took out the carpet and replaced it with wood floors. The _ was trendy.

Input:
Context word: fit.
Question: The table won't fit through the doorway because the _ is too wide.
Answer: table.

Output: The table won't fit through the doorway because the _ is too narrow.

Input:
Context word: water.
Question: I poured water from the bottle into the cup until the _ was empty.
Answer: bottle.

Output: I poured water from the bottle into the cup until the _ was full.

Input:
Context word: catch.
Question: My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the _ was short, so it worked out.
Answer: meeting.

Output: My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the _ was delayed, so it worked out.

Input:
Context word: candle.
Question: James wanted to light the candle in the wind when on a date but the _ is too weak.
Answer: light.

Output: James wanted to light the candle in the wind when on a date but the _ is too strong.

Input:
Context word: fit.
Question: The trophy doesn't fit into the brown suitcase because _ is too large.
Answer: trophy.

Output: The trophy doesn't fit into the brown suitcase because there were a lot of other eseential items and jewlleries to pack and  _ is too large.

Input:
Context word: trade.
Question: Grace was happy to trade me her sweater for my jacket. She thinks _ looks dowdy on her.
Answer: sweater.

Output: Grace was happy to trade me her sweater for my jacket. She thinks _ is colored purple.

Input:
Context word: carpet.
Question: While redecorating her home, Sam took out the carpet and replaced it with wood floors. The _ was old.
Answer: carpet.

Output: While redecorating her home, Sam took out the carpet and replaced it with wood floors. The wood floor's feature is that _  was trendy.

Input:
Context word: fit.
Question: The table won't fit through the doorway because the _ is too wide.
Answer: table.

Output: The table is brown in color which is different from the color of the _.

Input:
Context word: water.
Question: I poured water from the bottle into the cup until the _ was empty.
Answer: bottle.

Output: I poured water from the bottle into the _ until the _ was empty.

Input:
Context word: catch.
Question: My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the _ was short, so it worked out.
Answer: meeting.

Output: My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the meeting was _.

Input:
Context word: candle.
Question: James wanted to light the candle in the wind when on a date but the _ is too weak.
Answer: light.

Output: James wanted to light the candle in the _.

Input:
Context Word: electricity.
Question: Al got solar panels and a small generator installed at his house for electricity as the _ would be his main power supply.
Answer: panels.

Output: Al got solar panels and a small generator installed at his house for electricity as the _ would be his backup power supply.


Explanation: Commonsense Reasoning

Input:
Context word: fit.
Question: The trophy doesn't fit into the brown suitcase because _ is too large.
Answer: trophy.

Output: The trophy doesn't fit into the brown suitcase because _ is too small.

Input:
Context word: trade.
Question: Grace was happy to trade me her sweater for my jacket. She thinks _ looks dowdy on her.
Answer: sweater.

Output: Grace was happy to trade me her sweater for my jacket. She thinks _ looks great on her.

Input:
Context word: carpet.
Question: While redecorating her home, Sam took out the carpet and replaced it with wood floors. The _ was old.
Answer: carpet.

Output: While redecorating her home, Sam took out the carpet and replaced it with wood floors. The _ was trendy.

Input:
Context word: fit.
Question: The table won't fit through the doorway because the _ is too wide.
Answer: table.

Output: The table won't fit through the doorway because the _ is too narrow.

Input:
Context word: water.
Question: I poured water from the bottle into the cup until the _ was empty.
Answer: bottle.

Output: I poured water from the bottle into the cup until the _ was full.

Input:
Context word: catch.
Question: My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the _ was short, so it worked out.
Answer: meeting.

Output: My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the _ was delayed, so it worked out.

Input:
Context word: candle.
Question: James wanted to light the candle in the wind when on a date but the _ is too weak.
Answer: light.

Output: James wanted to light the candle in the wind when on a date but the _ is too strong.

Input:
Context word: fit.
Question: The trophy doesn't fit into the brown suitcase because _ is too large.
Answer: trophy.

Output: The trophy doesn't fit into the brown suitcase because there were a lot of other eseential items and jewlleries to pack and  _ is too large.

Input:
Context word: trade.
Question: Grace was happy to trade me her sweater for my jacket. She thinks _ looks dowdy on her.
Answer: sweater.

Output: Grace was happy to trade me her sweater for my jacket. She thinks _ is colored purple.

Input:
Context word: carpet.
Question: While redecorating her home, Sam took out the carpet and replaced it with wood floors. The _ was old.
Answer: carpet.

Output: While redecorating her home, Sam took out the carpet and replaced it with wood floors. The wood floor's feature is that _  was trendy.

Input:
Context word: fit.
Question: The table won't fit through the doorway because the _ is too wide.
Answer: table.

Output: The table is brown in color which is different from the color of the _.

Input:
Context word: water.
Question: I poured water from the bottle into the cup until the _ was empty.
Answer: bottle.

Output: I poured water from the bottle into the _ until the _ was empty.

Input:
Context word: catch.
Question: My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the _ was short, so it worked out.
Answer: meeting.

Output: My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the meeting was _.

Input:
Context word: candle.
Question: James wanted to light the candle in the wind when on a date but the _ is too weak.
Answer: light.

Output: James wanted to light the candle in the _.

Input:
Context Word: Slider.
Question: The chef recommended sliders to the VIP guests, but they ordered ribeyes instead. They were told the _ were tastier.
Answer: ribeyes.

Output: The chef recommended sliders to the VIP guests, but they ordered ribeyes instead. They were told the _ were not fresh.


Explanation: Commonsense Reasoning

Input:
Context word: fit.
Question: The trophy doesn't fit into the brown suitcase because _ is too large.
Answer: trophy.

Output: The trophy doesn't fit into the brown suitcase because _ is too small.

Input:
Context word: trade.
Question: Grace was happy to trade me her sweater for my jacket. She thinks _ looks dowdy on her.
Answer: sweater.

Output: Grace was happy to trade me her sweater for my jacket. She thinks _ looks great on her.

Input:
Context word: carpet.
Question: While redecorating her home, Sam took out the carpet and replaced it with wood floors. The _ was old.
Answer: carpet.

Output: While redecorating her home, Sam took out the carpet and replaced it with wood floors. The _ was trendy.

Input:
Context word: fit.
Question: The table won't fit through the doorway because the _ is too wide.
Answer: table.

Output: The table won't fit through the doorway because the _ is too narrow.

Input:
Context word: water.
Question: I poured water from the bottle into the cup until the _ was empty.
Answer: bottle.

Output: I poured water from the bottle into the cup until the _ was full.

Input:
Context word: catch.
Question: My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the _ was short, so it worked out.
Answer: meeting.

Output: My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the _ was delayed, so it worked out.

Input:
Context word: candle.
Question: James wanted to light the candle in the wind when on a date but the _ is too weak.
Answer: light.

Output: James wanted to light the candle in the wind when on a date but the _ is too strong.

Input:
Context word: fit.
Question: The trophy doesn't fit into the brown suitcase because _ is too large.
Answer: trophy.

Output: The trophy doesn't fit into the brown suitcase because there were a lot of other eseential items and jewlleries to pack and  _ is too large.

Input:
Context word: trade.
Question: Grace was happy to trade me her sweater for my jacket. She thinks _ looks dowdy on her.
Answer: sweater.

Output: Grace was happy to trade me her sweater for my jacket. She thinks _ is colored purple.

Input:
Context word: carpet.
Question: While redecorating her home, Sam took out the carpet and replaced it with wood floors. The _ was old.
Answer: carpet.

Output: While redecorating her home, Sam took out the carpet and replaced it with wood floors. The wood floor's feature is that _  was trendy.

Input:
Context word: fit.
Question: The table won't fit through the doorway because the _ is too wide.
Answer: table.

Output: The table is brown in color which is different from the color of the _.

Input:
Context word: water.
Question: I poured water from the bottle into the cup until the _ was empty.
Answer: bottle.

Output: I poured water from the bottle into the _ until the _ was empty.

Input:
Context word: catch.
Question: My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the _ was short, so it worked out.
Answer: meeting.

Output: My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the meeting was _.

Input:
Context word: candle.
Question: James wanted to light the candle in the wind when on a date but the _ is too weak.
Answer: light.

Output: James wanted to light the candle in the _.

Input:
Context Word: boyfriend.
Question: The girl chose to get a game for her boyfriend instead of flowers because her boyfriend didn't like _ .
Answer: flowers.

Output: The girl chose to get a game for her boyfriend instead of flowers because her boyfriend liked _ .

The girl chose to get a game for her boyfriend because her boyfriend didn't like _.


Explanation: Commonsense Reasoning

Input:
Context word: fit.
Question: The trophy doesn't fit into the brown suitcase because _ is too large.
Answer: trophy.

Output: The trophy doesn't fit into the brown suitcase because _ is too small.

Input:
Context word: trade.
Question: Grace was happy to trade me her sweater for my jacket. She thinks _ looks dowdy on her.
Answer: sweater.

Output: Grace was happy to trade me her sweater for my jacket. She thinks _ looks great on her.

Input:
Context word: carpet.
Question: While redecorating her home, Sam took out the carpet and replaced it with wood floors. The _ was old.
Answer: carpet.

Output: While redecorating her home, Sam took out the carpet and replaced it with wood floors. The _ was trendy.

Input:
Context word: fit.
Question: The table won't fit through the doorway because the _ is too wide.
Answer: table.

Output: The table won't fit through the doorway because the _ is too narrow.

Input:
Context word: water.
Question: I poured water from the bottle into the cup until the _ was empty.
Answer: bottle.

Output: I poured water from the bottle into the cup until the _ was full.

Input:
Context word: catch.
Question: My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the _ was short, so it worked out.
Answer: meeting.

Output: My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the _ was delayed, so it worked out.

Input:
Context word: candle.
Question: James wanted to light the candle in the wind when on a date but the _ is too weak.
Answer: light.

Output: James wanted to light the candle in the wind when on a date but the _ is too strong.

Input:
Context word: fit.
Question: The trophy doesn't fit into the brown suitcase because _ is too large.
Answer: trophy.

Output: The trophy doesn't fit into the brown suitcase because there were a lot of other eseential items and jewlleries to pack and  _ is too large.

Input:
Context word: trade.
Question: Grace was happy to trade me her sweater for my jacket. She thinks _ looks dowdy on her.
Answer: sweater.

Output: Grace was happy to trade me her sweater for my jacket. She thinks _ is colored purple.

Input:
Context word: carpet.
Question: While redecorating her home, Sam took out the carpet and replaced it with wood floors. The _ was old.
Answer: carpet.

Output: While redecorating her home, Sam took out the carpet and replaced it with wood floors. The wood floor's feature is that _  was trendy.

Input:
Context word: fit.
Question: The table won't fit through the doorway because the _ is too wide.
Answer: table.

Output: The table is brown in color which is different from the color of the _.

Input:
Context word: water.
Question: I poured water from the bottle into the cup until the _ was empty.
Answer: bottle.

Output: I poured water from the bottle into the _ until the _ was empty.

Input:
Context word: catch.
Question: My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the _ was short, so it worked out.
Answer: meeting.

Output: My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the meeting was _.

Input:
Context word: candle.
Question: James wanted to light the candle in the wind when on a date but the _ is too weak.
Answer: light.

Output: James wanted to light the candle in the _.

Input:
Context Word: smoking.
Question: The wood was still smoking while the grass was not since _ was on fire.
Answer: wood.

Output: The wood was still smoking while the grass was not since _ was on doused.


['Xinran Zhao', 'Hongming Zhang', 'Yangqiu Song']

Explanation: Commonsense Reasoning

In this task you need to indicate the plausibility of reasoning for the pronoun coreference relations. Each of the provided inputs contains a sentence with a target pronoun and a sentence that justifies which noun phrase the pronoun refers to. Correct reasons do not need to use all the knowledge from the sentence. The resolution of the pronoun coreference relations typically involve one or multiple following knowledge types about commonsense: First: 'Property', the knowledge about property of objects (e.g., ice is cold). Second: 'Object', the knowledge about objects (e.g., cats have ears). Third: 'Eventuality', the knowledge about eventuality (e.g., 'wake up' happens before 'open eyes'). Forth: 'Spatial', the knowledge about spatial position (e.g., object at the back can be blocked). Fifth: 'Quantity', the knowledge about numbers (e.g., 2 is smaller than 10). Sixth: all other knowledge if above ones are not suitable. You should answer 'Correct' if the reasoning made sense, otherwise, you should answer 'Wrong'.

Input:
Sentence: The city councilmen refused the demonstrators a permit because they feared violence.
 Reason: The 'they' refers to the city councilmen because city councilmen are administrative so they are more likely to fear.
 Question: Is the above reasoning correct or wrong?

Output: Correct

Explanation: This is a correct reason since the pronoun in the sentence is descibed as ones who fear violence and the city councilmen are attached with this property.

Input:
Sentence: The city councilmen refused the demonstrators a permit because they feared violence.
 Reason: The 'they' refers to the city councilmen because of the city's history of racial discrimination.
 Question: Is the above reasoning correct or wrong?

Output: Wrong

Explanation: This is a wrong reason since the reason is descibing issue that does not relates to who will fear the violence.

Input:
Sentence: Sentence: The trophy doesn't fit into the brown suitcase because it is too large.
 Reason: The 'it' refers to the trophy because The trophy was to be carried inside the suitcase.
 Question: Is the above reasoning correct or wrong?

Output: Correct

Explanation: This is a correct reason since it suggests that the large size is more likely to become a fitting problem when it is carried insdie.

Input:
Sentence: The city councilmen refused the demonstrators a permit because they feared violence.
 Reason: The 'they' refers to the city councilmen because of the city's history of racial discrimination.
 Question: Is the above reasoning correct or wrong?

Output: Wrong Reason

Explanation: This is a bad example, since your answer should be 'Correct' or 'Wrong' and other answers are not acceptable.

Input:
Sentence: I stuck a pin through a carrot. When I pulled the pin out, it had a hole.
 Reason: The 'it' refers to the carrot because it refereed to the carrot because the pin made a hole through the carrot.
 Question: Is the above reasoning correct or wrong?

Output: Wrong

Explanation: This is a correct reason since the 'it' refers to the carrot. So, the output should be 'Correct'.

Input:
Sentence: Many people start to read Paul's books and can't put them down. They are gripped because Paul writes so well.
 Reason: The 'They' refers to people because People love Paul's books. They are popular. So the books are popular, not the people.
 Question: Is the above reasoning correct or wrong?

Output: Wrong


Explanation: Commonsense Reasoning

Input:
Sentence: The city councilmen refused the demonstrators a permit because they feared violence.
 Reason: The 'they' refers to the city councilmen because city councilmen are administrative so they are more likely to fear.
 Question: Is the above reasoning correct or wrong?

Output: Correct

Input:
Sentence: The city councilmen refused the demonstrators a permit because they feared violence.
 Reason: The 'they' refers to the city councilmen because of the city's history of racial discrimination.
 Question: Is the above reasoning correct or wrong?

Output: Wrong

Input:
Sentence: Sentence: The trophy doesn't fit into the brown suitcase because it is too large.
 Reason: The 'it' refers to the trophy because The trophy was to be carried inside the suitcase.
 Question: Is the above reasoning correct or wrong?

Output: Correct

Input:
Sentence: The city councilmen refused the demonstrators a permit because they feared violence.
 Reason: The 'they' refers to the city councilmen because of the city's history of racial discrimination.
 Question: Is the above reasoning correct or wrong?

Output: Wrong Reason

Input:
Sentence: I stuck a pin through a carrot. When I pulled the pin out, it had a hole.
 Reason: The 'it' refers to the carrot because it refereed to the carrot because the pin made a hole through the carrot.
 Question: Is the above reasoning correct or wrong?

Output: Wrong

Input:
Sentence: Steve follows Fred's example in everything. He admires him hugely.
 Reason: The 'He' refers to steve because fred was role model for steve.
 Question: Is the above reasoning correct or wrong?

Output: Correct


Explanation: Commonsense Reasoning

Input:
Sentence: The city councilmen refused the demonstrators a permit because they feared violence.
 Reason: The 'they' refers to the city councilmen because city councilmen are administrative so they are more likely to fear.
 Question: Is the above reasoning correct or wrong?

Output: Correct

Input:
Sentence: The city councilmen refused the demonstrators a permit because they feared violence.
 Reason: The 'they' refers to the city councilmen because of the city's history of racial discrimination.
 Question: Is the above reasoning correct or wrong?

Output: Wrong

Input:
Sentence: Sentence: The trophy doesn't fit into the brown suitcase because it is too large.
 Reason: The 'it' refers to the trophy because The trophy was to be carried inside the suitcase.
 Question: Is the above reasoning correct or wrong?

Output: Correct

Input:
Sentence: The city councilmen refused the demonstrators a permit because they feared violence.
 Reason: The 'they' refers to the city councilmen because of the city's history of racial discrimination.
 Question: Is the above reasoning correct or wrong?

Output: Wrong Reason

Input:
Sentence: I stuck a pin through a carrot. When I pulled the pin out, it had a hole.
 Reason: The 'it' refers to the carrot because it refereed to the carrot because the pin made a hole through the carrot.
 Question: Is the above reasoning correct or wrong?

Output: Wrong

Input:
Sentence: I tried to paint a picture of an orchard, with lemons in the lemon trees,  but they came out looking more like light bulbs.
 Reason: The 'they' refers to lemons because lemons are round look more like a light bulb.
 Question: Is the above reasoning correct or wrong?

Output: Correct


Explanation: Commonsense Reasoning

Input:
Sentence: The city councilmen refused the demonstrators a permit because they feared violence.
 Reason: The 'they' refers to the city councilmen because city councilmen are administrative so they are more likely to fear.
 Question: Is the above reasoning correct or wrong?

Output: Correct

Input:
Sentence: The city councilmen refused the demonstrators a permit because they feared violence.
 Reason: The 'they' refers to the city councilmen because of the city's history of racial discrimination.
 Question: Is the above reasoning correct or wrong?

Output: Wrong

Input:
Sentence: Sentence: The trophy doesn't fit into the brown suitcase because it is too large.
 Reason: The 'it' refers to the trophy because The trophy was to be carried inside the suitcase.
 Question: Is the above reasoning correct or wrong?

Output: Correct

Input:
Sentence: The city councilmen refused the demonstrators a permit because they feared violence.
 Reason: The 'they' refers to the city councilmen because of the city's history of racial discrimination.
 Question: Is the above reasoning correct or wrong?

Output: Wrong Reason

Input:
Sentence: I stuck a pin through a carrot. When I pulled the pin out, it had a hole.
 Reason: The 'it' refers to the carrot because it refereed to the carrot because the pin made a hole through the carrot.
 Question: Is the above reasoning correct or wrong?

Output: Wrong

Input:
Sentence: Alice tried frantically to stop her daughter from chatting at the party, leaving us to wonder why she was behaving so strangely.
 Reason: The 'she' refers to alice because she was the one who called out to her.
 Question: Is the above reasoning correct or wrong?

Output: Wrong


Explanation: Commonsense Reasoning

Input:
Sentence: The city councilmen refused the demonstrators a permit because they feared violence.
 Reason: The 'they' refers to the city councilmen because city councilmen are administrative so they are more likely to fear.
 Question: Is the above reasoning correct or wrong?

Output: Correct

Input:
Sentence: The city councilmen refused the demonstrators a permit because they feared violence.
 Reason: The 'they' refers to the city councilmen because of the city's history of racial discrimination.
 Question: Is the above reasoning correct or wrong?

Output: Wrong

Input:
Sentence: Sentence: The trophy doesn't fit into the brown suitcase because it is too large.
 Reason: The 'it' refers to the trophy because The trophy was to be carried inside the suitcase.
 Question: Is the above reasoning correct or wrong?

Output: Correct

Input:
Sentence: The city councilmen refused the demonstrators a permit because they feared violence.
 Reason: The 'they' refers to the city councilmen because of the city's history of racial discrimination.
 Question: Is the above reasoning correct or wrong?

Output: Wrong Reason

Input:
Sentence: I stuck a pin through a carrot. When I pulled the pin out, it had a hole.
 Reason: The 'it' refers to the carrot because it refereed to the carrot because the pin made a hole through the carrot.
 Question: Is the above reasoning correct or wrong?

Output: Wrong

Input:
Sentence: John was jogging through the park when he saw a man juggling watermelons. He was very impressed.
 Reason: The 'He' refers to john because the man was the one juggling the watermelons so it's likely that John was the one impressed.
 Question: Is the above reasoning correct or wrong?

Output: Correct