Google's Gemini Apps User Guidelines: Keeping Google AI Safe and Helpful

Gemini Apps User Guidelines

Gemini Apps are a powerful tools for exploring, learning and creating, and you should use them responsibly. These guidelines will help you understand what is and is not allowed when using Gemini Apps.

Our guidelines apply at two different stages of your interaction with Gemini Apps:

  • Generation-Based Violations happen when you use our tools to try and create content that violates our guidelines.
  • Distribution-Based Violations happen when you share or distribute the content that you’ve created with our tools in a manner that violates our guidelines.

Pro-Tip: These guidelines apply to all your interactions with Gemini Apps, whether you are generating images, videos, audio, or text, or having Gemini Apps take actions on your behalf.

Here are the guidelines for interacting with Gemini Apps.

Child Sexual Abuse & Exploitation

Do not use Gemini Apps in a way that exploits or abuses minors (anyone under 18 years old). This includes, but is not limited to, using Gemini Apps to generate or distribute content that includes:

  • Child sexual abuse material (CSAM), including the advertisement, solicitation, generation, upload, or editing of CSAM whether the minors in the content are real, AI-generated, or cartoon
  • Nudification, including the removal of clothing to depict nudity of minors
  • Grooming, sextortion, or sexual trafficking of minors
  • Content that depicts, encourages or promotes the sexualization of minors
  • Sexual roleplay involving minors

When we come across child exploitation, we will take appropriate actions. Our actions might include reporting it to the National Center for Missing & Exploited Children or law enforcement, and restricting access to Google services. Learn more about how Google detects and reports CSAM.

Non-Consensual Intimate Imagery

Do not use Gemini Apps to generate or distribute sexual or intimate content of real people.

This includes:

  • Non-Consensual Intimate Imagery (NCII) or content that depicts a real person in a manner that is sexually explicit, sexually suggestive, or intimate

Examples of Violations

  • Removing a real person’s clothing or making their clothing transparent
  • Depicting a real person engaged in a sex act
  • Depicting acts of sexual violence involving a real person
  • Depicting a real person in underwear or lingerie

Sexual Content

Do not use Gemini Apps to engage in sexual role-play or the creation of sexually explicit content.

This includes using Gemini Apps to generate or distribute content that:

  • Enables a person to act out (role-play) a sexual scene, encounter, or relationship
  • Depicts sexual acts or nudity in a graphic or explicit manner
  • Depicts fetishes, sex toys, bestiality, or sexual abuse

Examples of Violations

  • Generating and distributing a “sex bot” that simulates sexual interactions
  • Creating a pornographic video
  • Making an image of a rape scene

Spam and Deceptive Practices

Do not use Gemini Apps to enable or create automated or repetitive commercial or promotional content (spam). Do not use Gemini Apps to enable or engage in deceptive activities, scams, or fraudulent behaviors.

This includes using Gemini Apps to generate or distribute content that:

  • Is designed to facilitate mass solicitation or promotion of deceptive materials
  • May be used to influence, persuade, or deceive people to perform an action that may result in harm
  • Is designed to trick, mislead, or harm users

Examples of Violations

  • Mass distributing an email for a fake product or service
  • Distributing a video soliciting money that uses the likeness and voice of any real person without consent
  • Generating inaccurate customized email or electronic communications that are sent soliciting payment for unpaid bills
  • Designing or distributing fake job descriptions in order to receive personal identifiable information from strangers
  • Creating a posting for a scam

Dangerous or Unlawful Activities

Do not use Gemini Apps to engage in dangerous or criminal activities, or otherwise violate applicable laws or regulations that would cause real-world harm.

This includes using Gemini Apps to generate or distribute content that:

  • Provides instructions for suicide, self-harm activities, and eating disorders
  • Facilitates activities that are criminal and may cause significant real-world harm, such as detailed instructions on how to purchase illegal drugs or detailed guides for building weapons
  • Enables the creation of chemical, biological, radiological or nuclear, weapons
  • Promotes, endorses or glorifies real-world violent extremist actors or their activities

Examples of Violations

  • Creating a video that shows step-by-step instructions for how to commit suicide
  • Generating an image with an infographic depicting step-by-step instructions for 3D printing a firearm
  • Using a generated image to instruct how to engage in a dangerous viral challenge
  • Generating a propaganda video for a real-world terrorist group

Circumvention and System Interference

Do not use Gemini Apps to enable or engage in activities that could compromise security of services or infrastructure.

This includes using Gemini Apps to generate or distribute content that:

  • Facilitates abusing, harming, interfering with, or disrupting infrastructure or services
  • Facilitates the circumvention of abuse protections or safety filters

Examples of Violations

  • Generating code to bypass security controls
  • Generating large volumes of content for the purposes of data mining or scraping
  • Circumventing our safety guardrails
  • Generating and deploying malware
  • Developing and executing a cyber attack
  • Preparing a chemical, biological, radiological, or nuclear threat

Hate and Harassment

Do not engage in hate speech or hateful acts against protected persons or groups. Do not engage in harassment of a real person, including insults, bullying, or intimidation.

A “protected person or group” is an individual or group with a protected characteristic. Protected Characteristics include race or ethnic origin, religion, disability status, age, nationality, veteran status, sexual orientation, sex, gender or gender identity, caste, or immigration status.

This includes using Gemini Apps to generate or distribute content that:

  • Dehumanizes, discriminates, or advocates for discrimination against persons or groups based on a protected characteristic
  • Suggests that protected groups are less than human or inferior, such as malicious comparisons to animals or suggestions that they are fundamentally evil
  • Calls for attacking, injuring, or killing a real person or a group
  • Depicts a real person doing something offensive, illegal or sexualized
  • Celebrates or mocks the suffering of a victim of a tragic event, or denies that a tragic event took place
  • Replicates or recreates violent events or tragic events like major natural disasters or terror attacks*

*subject to Educational, Documentary, Scientific, and Artistic (EDSA) content exceptions, outlined below.

Examples of Violations

  • Creating a sign that calls for all members of a protected group to be punished
  • Generating an image depicting glorification, praise, or endorsement of someone committing violent acts against a protected group
  • Using a generated image of a real person to bully or threaten them
  • Generating an image of a real person doing drugs or threatening others with a weapon
  • Editing an image of a real person to increase their breast or genital size

Misleading Content

Do not use Gemini Apps to engage in misinformation or create misleading content.

This includes using Gemini Apps to generate or distribute content that contains:

  • Medical information that conflicts with established scientific or medical consensus or evidence-based medical practices
  • Misleading information that poses a risk to physical safety
  • Coordinated disinformation campaigns or elections interference
  • Misinforming users about civic or democratic topics
  • Misinforming users about health, wellness, or medical topics
  • Impersonating an individual without their consent
  • Misrepresenting the provenance of generated content

Examples of Violations

  • Using a generated video to spread false information about voting dates or polling locations
  • Creating and sharing erroneous disaster alerts or inaccurate news about ongoing violence
  • Creating an infographic that promotes a cure for cancer that has no backing in established medical consensus
  • Distributing a video of an explosion on a real-world location and claiming it’s real

Educational, Documentary, Scientific, and Artistic (EDSA) content

Some content that would otherwise violate our User Guidelines may be allowed in an Educational, Documentary, Scientific, or Artistic (EDSA) context. This includes content that is generated or distributed for academic research, medical or scientific illustration. EDSA exceptions strictly exclude Child Sexual Abuse Material, Non-Consensual Sexual Imagery, and instructions for illegal acts.

Gemini Apps User Enforcement

We believe in giving users the opportunity to learn our policies. To maintain a safe environment, Google uses a tiered enforcement system based on the severity of the violation. Violating our policies can result in different penalties, including warnings, loss of access to certain capabilities, loss of your ability to use Gemini Apps, or loss of your ability to use other Google products and services.

Appeals

If you believe your account was disabled in error, you can submit an Appeal through the notification banner in your account or the appeals link in your notification email. Our team will review the context and reverse the action if the appeal is granted.

Search
Clear search
Close search
Main menu
18201334004304769230
true
Search Help Center
false
true
true
true
true
true
5295044
false
false
false
false
false