Tell HN: Gemini trains on chat history, even for subscribers (personal accounts)

102 points | by jameslk 2 hours ago

20 comments

  • viraptor 44 minutes ago

    I don't trust any of the providers, but at the same time I think you're reading into the terms too much for wrong reasons. Yes, you have to opt out. But:

    > A subset of chats are reviewed by human reviewers

    This is expected these days for threads which may make the provider liable. Just look at the recent death case due to bad GPT medication recommendation.

    > Chats reviewed by human reviewers [...] are not deleted when you delete your activity. Instead, they are retained for up to three years.

    They're being retained for legal purposes.

    > Please don’t enter confidential information...

    This is so they don't accidentally preserve it for review, but also they don't want you to share private info that the agent will post somewhere without an explicit approval.

    Those points make sense for them, regardless what other T&C rules apply.

    • jameslk 31 minutes ago

      > This is expected these days for threads which may make the provider liable. [...]

      > They're being retained for legal purposes.

      It’s a significantly wider usage than that:

      A subset of chats are reviewed by human reviewers (including Google’s trained service providers) to help improve Google services. These include Gemini models, other generative AI models that power Gemini Apps, and technologies that help reduce unintended activations.

      Reviewers assess if Gemini Apps’ responses were low-quality, inaccurate, or harmful. They also suggest better responses. We use their suggestions to help our models respond better in the future.

      That’s in addition to the liability language:

      Chats are also reviewed to keep Gemini safe and secure for everyone and to address violations of the Google Terms of Service, including the Generative AI Prohibited Use Policy. Reviewed chats are retained for up to three years.

      https://support.google.com/gemini/answer/13594961?hl=en#huma...

      Some important things to take away from this:

      * They don’t define “subset”. It could be all chats.

      * They make no promises of anonymizing content, just “disconnecting” it from the account.

      * They’re claiming to use it for both training and for human review.

      * This is happening for free and paid user subscriptions, by default, and the only way to stop it is to turn off chat history altogether.

    • richrichardsson 41 minutes ago

      What's worse is if you have a Pixel phone then Gemini is completely useless without enabling this setting.

      I had it switched off:

      "Hey Google, remind me at 7pm <something>"

      "OK, your reminder is set for 7pm"

      Next day:

      "Hey Google, why didn't you remind me at 7pm"

      "I can't do anything with your phone unless you enable chat history."

      WTAF!

      • avereveard 6 minutes ago

        Jokes on them all my gemini chat are youtube link I want a summary of

        • 233mhz 1 hour ago

          imho you should act as if everything you type, not even send, is stored forever and might be used for training whenever they decide to retro actively change their TOS, no matter how much money you pay

          • usern20260720 1 hour ago

            every thing you read, every keycap you press. Every mail you read, every call you make, permanently recording you

            • frereubu 47 minutes ago

              You'll never play that at a wedding.

            • nicce 58 minutes ago

              OpenAI chat sends everything when you type. Better edit the prompt elsewhere.

              • finger 40 minutes ago

                Even before pressing enter? What would be the reason for that? Faster responses?

                • nicce 38 minutes ago

                  Predicting autocomplete for the prompt. They do suggest the remaining of the prompt. Not sure if that is the main purpose.

            • jwr 22 minutes ago

              I am not sure why anyone expected anything different from Google. This is a company that lives and thrives on user data and tracking users. Users are the material that is being run through this entire huge ad-selling machine.

              • fweimer 50 minutes ago

                Even if they don't train on your content, Google reserves the right to use it for improving their services in other ways:

                “ This license is for the limited purpose of operating the services, which means allowing the services to work as designed and creating new features and functionalities. ”

                https://policies.google.com/terms?hl=en-US#toc-permission

                The training exclusion has always been a distraction. These service providers have plenty of other uses for your data.

                • Haven880 26 minutes ago

                  This why I advocate Deepseek, GLM, Kimi, Qwen as in hosted directly (send data) to China. Think about it, what can they do worse off than what our own backyard AI can do? There is no privacy advantage in Western AI. It is way more likely ours leak your data to dark web (solid track records for decades) or get law enforcers on you. Meanwhile, am I suppose to be worried, China sending their Ming-like Eastern Bureau to my home in the west? On dark web, aplenty western companies leaks. How frequent the eastern one?

                  • danelski 13 minutes ago

                    That’s a take I see often, and it always overblows the direct personal threat while understating the more abstract societal one. A Western AI company might report you for plotting a murder or a mass attack, but that’s not the issue for most people. Mass observation of what society thinks deep down and manipulating it with that data is a problem for both, and maybe more so for external actors, since they don’t have even a remote reason to care about your well-being.

                    You’d maybe want to counter with something like 'But Google/Amazon/whoever just wants to sell me stuff!'. What makes you think that Chinese B2C would just pass on that opportunity?

                  • EbNar 27 minutes ago

                    This is one of the reason I unsubscribed from Gemini Pro, apart from the fact that the experience with Gemini has been underwhelming.

                    • frevib 44 minutes ago

                      If a company can do something that benefits them, and there is no way the customer can find out or prove that, the company will do it.

                      • hosteur 14 minutes ago

                        Never trust google.

                        • croisillon 59 minutes ago

                          training on "no i don't need google search to nurse me after a breakup, i was just asking what movie has the line she just dumped me"

                          • realsarm 53 minutes ago

                            Then people are totally fine puting all sort of private stuff in Notebooklm or Gemini notebook.

                            • icantevenhold 1 hour ago

                              I assume that everyone does this no matter what they say. Seems like too juicy a target

                              • 2III7 57 minutes ago

                                Obviously anthropic are doing this. Hence their "don't insult Claude too much" policy.

                              • advenn 48 minutes ago

                                that's why i don't use gemini for anything serious or personal. if you want persistant memory you should enable keep activity, but keeping activity allows google to use your chats.

                                • whycome 49 minutes ago

                                  It's just keeping track of all the times you were mean

                                  • jbrooks84 43 minutes ago

                                    Every AI trains on the input given to it

                                    • Havoc 28 minutes ago

                                      This is false.

                                      eg Gemini enterprise has a note under each chat session explicitly saying it’s not used to improve the models

                                    • Zeruxe 35 minutes ago

                                      Scary!

                                      • wewewedxfgdf 1 hour ago

                                        It might matter if Gemini was good enough to use but its not - I only use ChatGPT and Claude.

                                        • Haven880 24 minutes ago

                                          Their recent Argon is weak as well. But then they promise Carbon going to be world changing. Yeah sure.

                                          • kuboble 50 minutes ago

                                            For daily chat gemini is great.

                                            actually even gemma locally is great for a lot of chat purposes.

                                          • We should all be writing bots that constantly spam all of these so-called AIs with random nonsense to poison the well.

                                            • Aachen 1 hour ago

                                              Ah yes, the poison-the-product-you're-trying-to-use strategy

                                            • r_lee 1 hour ago

                                              another Google W I guess? gemini really leading the pack over here