44 comments

  • bartread 3 days ago

    The thing is, it's not actually that hard to spend at that kind of rate.

    I wouldn't say this was the norm, but I have burned through £1k of tokens in a couple of days before. And, on that same gig, I realised a test I was considering running would burn £2.5k worth of tokens over the course of a few hours so spent a couple of hours of my own time re-engineering it to get that down to £150.

    The point is that I don't necessarily know that spending a shitload of money on tokens really tells us anything useful. If he's getting a return on that investment, fine, whatever.

    Obviously most of us couldn't afford to spend that much ourselves, no matter how much value it might deliver, and many of our employers wouldn't be too happy if we spent it on their dime either. Equally, if you can, and it's delivering real value, then I don't see why you wouldn't?

    • nodesocket 3 days ago

      At what point do you buy a Mac studio or AMD Gorgon Halo and try running some of these tasks in local models? Surely don’t need frontier models for all this work.

      • bartread 2 days ago

        You definitely don't need frontier models for all this work.

        And, in fact, I got it from £2500 to £150 by careful model selection (I ran a trial over a small dataset with different models until I found the least expensive/capable model that would reliably do what I needed), using a local model for one step, and paring down the inputs as well so the token count plummeted.

        • wolvoleo 2 days ago

          Yeah I see the same thing at work. Most of the people burning crazy numbers of tokens aren't doing any amazing work. They're just using fable to write their emails and do their web searches.

          They feel like they're super smart but it's just as smart as hiring a $500k/yr PhD as a PA to schedule your meetings and answer the phone. Sure it does a good job but you're just wasting money and abilities.

          They feel super edgy and bleeding edge but all they really do differently is switching the AI chat from auto to the most expensive option all the time. When I see what they're using it for they're only grasping the basics of its abilities.

          They're also people sending 2 page AI generated emails that make no sense for literally everything where a "Yeah sure let's do that" would have sufficed.

          Unfortunately most of these are business leaders who just want to look edgy and "all in on AI" so we can't really limit their tokens. Yet they're also the ones saying we spend too much and want to limit some of our dev teams actually putting it to good use.

          • bigfatkitten 2 days ago

            I tokenmaxxed in my last role.

            Management succumbed to AI psychosis, and so we were directed to show that we were adopting and using AI, but what we were using it for was not considered important. So we went out of our way to burn as many tokens as possible.

            If you tell Claude to be inefficient and burn as many tokens as it can, it’ll happily oblige. It will also offer useful advice as to how to use even more tokens.

        • jorvi 2 days ago

          You don't.

          Once you factor in cost of electricity and depreciation of hardware, it is more expensive to run locally.

          There are many arguments for running local but cost isn't one of them.

          • nodesocket 2 days ago

            > but cost isn't one of them.

            Let's do quick back of the napkin math.

              - Mac Studio M5 Ultra, 80-core GPU, 256GB memory, 2TB storage -- $11,299.00.
              - Power (385w continually 100% of month) is $40/mo (my regional) or $480 annually. Let's say power is 3x more expensive in California, which it probably is, that's still only $1,440 annually in power.
            
            The Studio M5 Ultra has a worklife of at least 3 years.
            • jcelerier 2 days ago

              it's going to be quite slower than remote providers, won't be able to run full models, only quantised, and for more cost than the highest Claude subscription tier where you can do roughly 60-100M token per month at 200$, e.g. 7200 for three years. It makes sense if you prioritize local AI but not really otherwise sadly.

              • klrefg 1 day ago

                You have to compare with how much Deepseek costs since all the models you will be running will be inferior anyway, certainly not Opus or similar.

              • bitfilped 1 day ago

                You have to be using an incredibly small amount of usage for your math to math here. Go price out a few MW or better site then ask a neo cloud how much that same amount of compute will cost at an API.

            • jmathai 17 hours ago

              If I were spending $200k on tokens then I sure would expect some mind boggling results. I don't know much about what this person is doing with them and maybe they've launched several companies or created several new inventions .... but that's what I'd expect personally at that spend.

              • plusfour 3 days ago

                > would burn £2.5k worth of tokens over the course of a few hours

                details please, if it's interesting

                • deadnomore 3 days ago

                  Evaluation loops do this easily. You have to run hundreds of reasoning jobs in parallel and very quickly you can torch thousands of dollars.

                  • bartread 2 days ago

                    Yeah, it was basically this, and running a whole lot of agents concurrently to churn through the dataset faster.

                    • sixtyj 3 days ago

                      Yup, run multiple agents on expensive model in loop via API.

                      You can do it if your employer has endless pockets.

                      Example: $30/1M input tokens (I don’t count output or cache, for simplification), you have several daily agents for everything => 3M tokens daily per agent * 10 agents ~> $900/day => $328k/year (API spending)

                    • hparadiz 3 days ago

                      Any 3D work in blender can burn that easily. Add video editing to that mix in any capacity.

                  • fantasizr 3 days ago

                    I can't recall software being conspicuous consumption until the advent of the AI token. Maybe the first "I am rich" app in the app store for $999.

                    • johnfn 3 days ago

                      Pretty sure Joel Spolsky said “we purchase the best machines money can buy for our developers” like 20 years ago. So it’s hardly a new concept.

                      • isolatedsystem 2 days ago

                        Not sure why that counts. An engineering workshop buying mint quality lathes would just be considered "Buy once, cry once" in my eyes.

                        • asdff 2 days ago

                          Lathe sure. But what about shiny macbook pro to ssh into aws

                          • trymas 2 days ago

                            eh, compared to salaries even shiniest macs wouldn't register in USA, especially hubs like SV. Especially if it's issued once a couple or four years.

                            With AI spend - especially at Anthropic/OpenAI API prices - spending 0.5-1 macbook a month worth of tokens per employee seems normal (from what I've seen, heard, what happens in this forum and thread and what my employer does).

                            Tokenmaxxxing (followed by commit/PR-maxxxing) is celebrated. Don't think - just launch orchestrator that will create dozen child agent sessions to do useless work to impress your superiors. If buy the end of the day you will ask to increase your token allowance - you're a superhero.

                        • raincole 2 days ago

                          > machines

                          That's hardware.

                          • fantasizr 3 days ago

                            I personally recall hardware flexing going back to SGI, but nothing like "look at my salesforce spend".

                            • ASalazarMX 3 days ago

                              I've seen the other side of that coin: "my program is blazing fast in my machine, I don't know why those naggy users are complaining!"

                              • fantasizr 2 days ago

                                Getting your app to run on the worst devices was artistry. Assuming the lowest IE and windows environment.

                            • asdff 2 days ago

                              Hardware for sure. Big statement giving the entire company macs vs pc. Apple spelled it out in those ads.

                              • itishappy 3 days ago

                                AWS spend and other service bills?

                                • fantasizr 3 days ago

                                  My take was when people would post those large bills it was mostly to complain about Amazon or a process having gone wild for comedic purposes.

                                  • itishappy 3 days ago

                                    My take is that disclosures like these are always humble brags and/or marketting (look at how much I can afford to spend) with minor complaints rolled in to disguise this fact.

                                    > “It’s too expensive right now,” he said, adding that he knows the amount of money he spends on AI agents is “a crazy privilege that not everyone can do.”

                                • maxbond 3 days ago

                                  Superchats and other livestream gifts

                                  • fantasizr 3 days ago

                                    Agree I meant mostly in the vein of "look how much I can spend on XYZ because I'm rich and I can" with questionable value.

                                  • addaon 2 days ago

                                    > I can't recall software being conspicuous consumption

                                    https://en.wikipedia.org/wiki/I_Am_Rich

                                  • sho 2 days ago

                                    As many others have said, that's not even slightly impressive. Someone maxing out a single claude ultra plan on opus 5.5 is already doing ~$160k+ per year if the massively inflated API prices are used. I personally have 5 and the only thing stopping me getting more is concern about being banned, I could easily double my usage if it was safe and convenient. Hell, I could probably 10x it or more.

                                    Once you make the jump to agents managing agents the only limit is your budget and your harness's ability to coordinate. We'll all be using far more tokens than this in a year or two.

                                    • rendaw 4 hours ago

                                      No, he spends that much on tokens. Not he subscribes to ultra and then uses the equivalent amount on tokens.

                                      • mi_lk 2 days ago

                                        What do you do that you are maxing out 5 accounts

                                        • avaer 2 days ago

                                          I want to know if there are any returns on that. Even with the insane discount on API prices.

                                          Or are people paying $1K/mo (subsidized) just because AI is fun? Can you imagine a video game charging $1K/mo?

                                          • roryirvine 2 days ago

                                            I absolutely can imagine a video game doing that, especially if there were some way to make the consumption be conspicuous.

                                            In Tan's case, I think the "fun" thing is the right way to look at it. He gets to play at being a big shot developer and show off on Twitter, so clearly he feels he's getting some value from his spending even if no-one else does.

                                            There is a more serious question about to what degree the AI vendors have a duty of care to prevent addicts from getting themselves into financial trouble - perhaps they might in future face the sort of regulation applied to high street bookmakers. I doubt Tan would fail any putative affordability test, though, so it would still be up to him to seek help for his problem if he feels its getting out of control.

                                            • sho 2 days ago

                                              Well, I run a number of apps that have users who appreciate them (I hope?) and they simply wouldn't exist without AI giving me the leverage to build them. So.. yes? What's a "return", anyway? It's worth it to me, obviously!

                                              But you might have hit the nail on the head - yes, it's extremely fun and maybe that's the main reason after all. And FYI many, many people pay a lot more than $1k/m for video games.

                                              • HWR_14 2 days ago

                                                Even if it was just for fun, $12,000 a year for a hobby is not cost prohibitive for a lot of people.

                                                • tarballing 2 days ago

                                                  Median average single salary in the US is ~64k a year. Spending ~19% of all income on a single hobby is completely out of the question for the vast majority of people.

                                                • killingtime74 2 days ago

                                                  If you claim it as a business/work expense (In Australia, that gives you a 47% discount), 1K is not even one day's salary for a well-paid dev and just about one day for an average paid dev.

                                                  • Zanfa 2 days ago

                                                    Are Australian software devs really averaging 250k USD per year?

                                                    • bigfatkitten 2 days ago

                                                      No, though a very small minority are in that range with equity etc from Big Tech.

                                                      • killingtime74 2 days ago

                                                        Its bimodal. If you are at one of the big ones yes. Its on levels.fyi (you can narrow to Australia)

                                                      • tarballing 2 days ago

                                                        Average base compensation for SWE is ~140k (in the US w/ the highest earning SWEs), so the average is roughly half of that. Earning ~275k is comfortably in the top 20% of all SWEs; 1k a day is easily in the top 5%.

                                                    • sho 2 days ago

                                                      Day job, multiple side projects which are their own entire public apps, research, personal agents, running and developing the custom harness that orchestrates all of the above..

                                                      It sounds like a lot when I type it like that, but it's not actually that much if you delegate brutally. Like I said, I'm constantly token starved and could do a lot more!

                                                      • iLoveOncall 2 days ago

                                                        Feeling productive while achieving nothing.

                                                        • sho 2 days ago

                                                          Very clever - your comment is a description of itself

                                                      • dgellow 2 days ago

                                                        Have you looked at offers from CommandCode and similar? https://commandcode.ai/pricing

                                                        You can get access to DeepSeek 4.1 Flash for almost nothing, on a $1, $10, or $100 subscription. That can complement your 5 Claude accounts, or replace some. DS Flash 4.1 is so fast and cheap it’s ridiculous

                                                        • sho 2 days ago

                                                          All such sites are data harvesting operations. They'll collect your transcripts and sell that data to model companies to train on. It's a big business.

                                                          I occasionally get my agents to do sensitive things; I'm not comfortable having my transcripts collected and sold, so I don't use them. They say they anonymize them but who can ever tell? Not for me, thanks.

                                                        • dimbletimbers 2 days ago

                                                          That there are people like you in a world with starving children sincerely turns my stomach.

                                                          • tikimcfee 2 days ago

                                                            There really is no excuse, is there?

                                                            This is my daily intrusive thought. "Why the hell am I doing any of this? Why am I not yelling louder at people that have so much and give so little?"

                                                            This website is full of people that could save millions of human lives in aggregate, but choose not to and actively argue against the idea because, and I do swear it's a damned curse at this point, "there is no incentive to do it."

                                                            I'm not even remotely rich. I have no "savings" or "investments". Yet I have a comfortable life in a house with access to food and care as I need. Sometimes I really hate it.

                                                            • randysalami 2 days ago

                                                              To your last part, then you’re ok man. Sounds like you have your kindness and empathy intact. It sounds like given the avenue, you would organize for what is right. You have perspective but don’t let it consume you. You need to be healthy because if you care, there might be a chance in the future where you can put that care toward change. And you need to be in your best state to have the largest impact.

                                                              There are many people in this world who have more, view people as dirt, and dedicate their lives to keeping people down. Good, kind people who are disempowered by a system that betrayed us all are not at fault. Feel better man.

                                                              • tikimcfee 1 day ago

                                                                I hope you regularly have people in your life that do this for you. Thank you. Just thank you.

                                                              • tuesdaynight 2 days ago

                                                                You cannot change the world, you need to accept that. However, you can have a hell of an impact on your surroundings, like your close family, neighborhood or city. Focus on that. Social media made us forget that.

                                                                • tikimcfee 1 day ago

                                                                  You're right. And thank you. Sincerely.

                                                              • tuesdaynight 2 days ago

                                                                If that is the case, how do you use HN or any social media without vomiting all day?

                                                            • bix6 3 days ago

                                                              > he’s suffered from “cyber psychosis” and sometimes barely sleeps

                                                              Sleep is one of the most important things in the world. Why not have the agents work while you sleep?

                                                              • hackyhacky 3 days ago

                                                                > Why not have the agents work while you sleep?

                                                                Even better, why not have the agents sleep for you?

                                                                EDIT: for those who say this is not realistic, I've had Claude sleep for 10 hours in just 30 seconds. Saved me an entire night.

                                                                • Freedom2 3 days ago

                                                                  Care to share your agent setup and harness? I've been trying to do something similar but my Claude only sleeps for about 2 hours before waking up.

                                                                  • hackyhacky 3 days ago

                                                                    I use a supervising agent, so if my sleeping agent has insomnia, the supervisor puts it back to sleep. It's helpful to have the supervisor put on relaxing music or read it something boring [1].

                                                                    [1] https://www.amazon.com/Million-Plus-Random-Digits-Symbols-Gu...

                                                                    • r_lee 2 days ago

                                                                      could you make a skill for this? Thanks

                                                                      • trog 2 days ago

                                                                        I can't tell if posts like this are parody or serious

                                                                        • zombot 2 days ago

                                                                          Even if they're parody (this one is), there are enough people now who take them seriously and put them into practice. I have never seen any other tech that surfaces that amount of idiocy.

                                                                          • thewhitetulip 1 day ago

                                                                            Why put an agent to sleep? Store their memory in a file and kill the agent

                                                                            Resume it later.

                                                                      • cozzyd 2 days ago

                                                                        It helps to increase your network latency

                                                                    • thephyber 3 days ago

                                                                      If his brain is the thing malfunctioning, then his brain may not be capable of (1) correctly diagnosing the problem as a lack of sleep or (2) honestly prescribing "do things to get better sleep" as the fix.

                                                                      People in psychosis don't exactly weigh all of the options with a level head. He may not recognize that he has "cyber psychosis" or that his lack of sleep is a bad thing.

                                                                      • killingtime74 2 days ago

                                                                        If he was good at it, he would be sleeping more because you would be doing less work.. The fact that he's sleeping less means he's not as good as optimizing his agents as he thinks he is.

                                                                        • Gud 2 days ago

                                                                          Or, he is operating more agents by staying awake longer.

                                                                          Don’t make me defend Garry Tan…

                                                                        • itishappy 3 days ago

                                                                          That's probably exactly why. Some of my latest nights have been attempting to prepare a long-running overnight task for an agent.

                                                                          It was productive, but as you say, it's dangerous to gamble with sleep.

                                                                        • kats 1 hour ago

                                                                          This thread is so full of negativity and cynicism. It's useless.

                                                                          • stego-tech 3 days ago

                                                                            Headline aside, I agree with him wholeheartedly that the future of AI is personal agents, and that costs have to come down for that to happen.

                                                                            Not cloud costs, though; consumer costs. These agents must run on-device for privacy protections, because anything less will be a global non-starter. That means we need models that excel on phones, tablets, laptops, and desktops; we need home compute modules to run larger, “frontier”-class models for bigger tasks but without guzzling electricity (the Mac Mini’s power envelope is an ideal target); we need smart harnesses that can foist off inference to bigger models elsewhere on your private network of devices as needed without the user prompting for specific thinking modes or model names. All of this has to happen automatically, privately, securely, without leaking data to advertisers or surveillance companies.

                                                                            It’s hard work, but it’s definitely the future of AI. I would argue the business case is solved with being able to build bespoke stacks of kit and run models through neocloud providers with ZDR policies. It’s the consumer angle that’s hard to crack, because everyone wants a repeat of Web 2.0 for ad-dollars instead of a privacy-centric modern tech stack that forces companies into lower revenue streams.

                                                                            • Dr_Birdbrain 3 days ago

                                                                              I don’t think the privacy-centric vision is going to happen. Very few non-tech people care enough about their privacy to figure out the necessary infrastructure.

                                                                              The future of personal assistants is most likely akin to Muse Spark, and yes I expect Meta is training on all of those interactions and using them to target ads.

                                                                              • randysalami 2 days ago

                                                                                Had an idea for rich people where they buy their own AI server. The value add is the handling of hardware and software is all provided by the company. It’s a luxury experience like the iPhone so inherently privacy focused. It’s E2E so non-technical users just see AI at the end delivered in the best way possible with any customizations they want. You build the most comprehensive profile on their life which every AI company would love but it’s possible because you’re actually privacy-focused. Call it MyAI.

                                                                                • argee 3 days ago

                                                                                  > because anything less will be a global non-starter.

                                                                                  I beg to differ.

                                                                                      "People just submitted it. I don't know why. They 'trust me.' Dumb fucks."
                                                                                      - Mark Zuckerberg
                                                                                • ks2048 3 days ago

                                                                                  YC seems big on quantitative metrics. Is there anything that says he is more efficient than 3 or 4 years ago. Is YC as a whole?

                                                                                  • bwfan123 2 days ago

                                                                                    > Is there anything that says he is more efficient than 3 or 4 years ago.

                                                                                    This is a difficult question to answer ! I would ask a related question which is equally hard. Has AI-use increased your human cognitive capability or decreased it ?

                                                                                    • __s 2 days ago

                                                                                      Decreased it. I no longer carry the entire code base in my head. Used to be someone could describe issue to me & I could know exact line where bug was. Sometimes laying in bed I'd realize some line was wrong

                                                                                      I accept this loss because the productivity is there. & hope to retire in a few years if things don't go south. For people entering the field I worry

                                                                                      • chrisandchris 12 hours ago

                                                                                        Is it? For 200k, he has to have the output of 2 humans, otherwise it would also work to "buy" a human for 200k/year.

                                                                                        That's where I struggle - when I would spend 200k/year on AI, i expect me to deliver at least 1 human output more than before.

                                                                                      • asdff 2 days ago

                                                                                        He will say he is and that will be the end of it.

                                                                                      • up2isomorphism 3 days ago

                                                                                        So what has he built?

                                                                                        • qwr1 3 days ago

                                                                                          "Garry's List" for dark money (this is an established political term, look it up!) donations. Basically you can donate anonymously to a SuperPac.

                                                                                          Software? I'm not aware of anything.

                                                                                          • meindnoch 3 days ago

                                                                                            Psychosis?

                                                                                            • dgellow 2 days ago

                                                                                              Markdown files

                                                                                              • jgalt212 3 days ago

                                                                                                a bubble.

                                                                                                • Jtsummers 3 days ago

                                                                                                  A site where he complains about rich people being charitable, among other things.

                                                                                                  • georgemcbay 3 days ago

                                                                                                    Looks like this is getting downvoted, but it is absolutely true.

                                                                                                    Garry Tan is fully aligned with Elon Musk in going after MacKenzie Scott's charitable giving, making spurious arguments that she's doing it in the wrong way when they are all just running cover for the fact that she's one of the few at that level of wealth being charitable at all these days.

                                                                                                    Silly woman, she should give her money away the right way, which I guess is by attempting to buy political power.

                                                                                                    • Jtsummers 3 days ago

                                                                                                      https://news.ycombinator.com/item?id=47042593 - HN discussion (5 comments) on that particular rant of his. And it looks like you were one of the few people to comment on it, so really this is for other people who are missing the context of our comments.

                                                                                                      https://garryslist.org/posts/mackenzie-scott-s-26-billion-su... - The rant itself.

                                                                                                      • rsynnott 2 days ago

                                                                                                        Getting an LLM to _write a blog_ for you is really bizarre behaviour. I mean, really, why bother?

                                                                                                        • Jtsummers 2 days ago

                                                                                                          I'm sure one of his agents could answer that question if you posed it to them.

                                                                                                        • lovich 2 days ago

                                                                                                          I can’t remember with enough clarity if it was obvious when this was published but holy hell was this obviously AI written

                                                                                                          > This isn’t generosity. It’s negligence at scale.

                                                                                                          Is when I realized I was wasting my time reading the article

                                                                                                        • Hikikomori 2 days ago

                                                                                                          Also goes to the same weird SV church that started because of Thiel and where he held the Greta is the anti Christ talk.

                                                                                                          • asdff 2 days ago

                                                                                                            The funniest thing about thiel and his antichrist obsession is how well he fits the description of antichrist

                                                                                                        • bitwize 2 days ago

                                                                                                          1920s, Henry Ford: "I want to build automobiles any man can afford, even the workmen in one of my factories."

                                                                                                          2020s, techbros: "Here's why it's a huge problem for non-billionaires to have things."

                                                                                                      • georgemcbay 3 days ago

                                                                                                        > So what has he built?

                                                                                                        "Garry, this is a text file".

                                                                                                        https://www.youtube.com/watch?v=Q6nem-F8AG8

                                                                                                        • gbnwl 2 days ago

                                                                                                          Larry, I'm on DuckTales.

                                                                                                        • vrganj 3 days ago

                                                                                                          Finally, the perfect yes-man, the thing execs and VCs always wanted.

                                                                                                        • vib_z 2 days ago

                                                                                                          That's a lot of money for one person..I wonder how he manages all his agents and not go insane?

                                                                                                          It's hard for me to burn all my weekly limits of claude ultra, codex pro and grok bot 100$ plans on a weekly basis - they are generous for daily use.

                                                                                                          • nikolay 1 day ago

                                                                                                            It looks like Matt Van Horn, who I've met when he was at the original Digg, also is contributing to all kinds of projects on GitHub and releasing his own. Coding agents could be a curse for a few, and a blessing for many.

                                                                                                            • jgalt212 2 days ago

                                                                                                              His tools, gstack, are 360K lines of code. That's probably a lot of tokens and context.

                                                                                                                git clone https://github.com/garrytan/gstack
                                                                                                                cd gstack/
                                                                                                                git ls-files | xargs wc -l
                                                                                                              • dgellow 2 days ago

                                                                                                                Markdown, not code

                                                                                                                • vips7L 2 days ago

                                                                                                                  Look at this guy using shell commands instead of asking his agent to count the lines. You’re going to get left behind bro! Your boss won’t pay you to do that!

                                                                                                                  • jgalt212 1 day ago

                                                                                                                    The funny thing is I asked an AI how to do this. And then I ran it myself and learnt something!

                                                                                                                    • vips7L 1 day ago

                                                                                                                      Check out the cloc tool. It’ll do it automatically and categorize the type of line it’s pretty cool.

                                                                                                                • anoojb 3 days ago

                                                                                                                  The common trope is, "keep an eye on what the rich want."

                                                                                                                  Gary is rich. Let's assume now, he spends between $10-20K/month USD on tokens. Whether he gets overwhelming tangible value out of that token spend is immaterial.

                                                                                                                  What he's getting out of it is a mix of social signaling value and actual perceived productivity. I don't know, but I doubt he has measuring the ROI on the token investment.

                                                                                                                  Much like someone gets various kinds of value out of a a personal tutor for their child. Or a high powered executive who continues to request budget for a "Chief of Staff" and related personnel in 2026.

                                                                                                                  The question is whether this is signal, or noise. Will everyone who has the budget aspire to spend money on tokens as a subtle way of projecting value with some tangible benefit? How long of a runway does this have?

                                                                                                                  Much like a Chief of Staff office, there's more to manage...but you you get some tangible benefit by having people to whom you can [in theory] delegate tasks and trust they will be completed. To some degree none of this matters, value is in the eye of the beholder.

                                                                                                                  What a time to be alive. Rich people continue to spend money with abandon, just on different things.

                                                                                                                  Edit: I work at technology company. If I were spending $10-20K/month USD in tokens I would immediately get flagged by Finance and receive a note from my EVPs Chief of Staff/Business Admin. My usage and prompts would get audited and I would be asked to create a report justifying the business impact of the spend.

                                                                                                                  • rcko 3 days ago

                                                                                                                    Note, however, that Garry also holds a much longer lever in his hands. It's very likely that he does get a huge ROI from the token spend because if it helps him make just one slightly better investment decision per year, that's millions in return.

                                                                                                                    • anoojb 3 days ago

                                                                                                                      The rich always have leverage. The questions I'm asking are broader market questions...

                                                                                                                      Does it matter that he's spending this much money on tokens? What's the derived signal? Why isn't he spending more?! Spend on intelligence seems to have no limit, and he's rich after all right? What's the limiting rate of return on token spend for the rich? Does Gary represent an archetype of other rich people who also want to spend money on tokens at that rate? ...if not more?!

                                                                                                                    • bix6 3 days ago

                                                                                                                      He has a vested interest in hyping AI / spend because YC overwhelmingly invests in AI startups.

                                                                                                                    • bluegatty 2 days ago

                                                                                                                      the question is not spend it's outcome.

                                                                                                                      what has he produced with that?

                                                                                                                      • fakedang 2 days ago

                                                                                                                        Revenue for Anthropic to use in their S-1.

                                                                                                                        • bluegatty 2 days ago

                                                                                                                          what does that have to do with anything?

                                                                                                                          Gary spending 250K/year on nothing is not strongly related to pros using $200/plan to do much better.

                                                                                                                          • fakedang 1 day ago

                                                                                                                            Still contributes to their topline.

                                                                                                                        • You haven't seen tanstack? He presented to Stanford he wanted to scale that idea to an entire organization not just a solo founder.

                                                                                                                          He's gonna hit the halting problem

                                                                                                                        • clickety_clack 2 days ago

                                                                                                                          He must have the best automatic daily slack summary.

                                                                                                                          • bluegatty 2 days ago

                                                                                                                            Probably not even that, there are off the shelf things.

                                                                                                                            I don't think he has produced anything.

                                                                                                                            Tokenmaxxing was a dumb trend he has not figured out he's out of the loop yet.

                                                                                                                        • _-_-__-_-_- 2 days ago

                                                                                                                          As someone who has only ever used these free AI agents and who is not a software developer or computer scientist by trade, could someone please explain the concepts of tokens and their worth and harnesses and what exactly all of those things accomplish?

                                                                                                                          • ygjb 2 days ago

                                                                                                                            None of these are effective questions for this forum. You should copy and paste your post and my response into your free chatbot of choice.

                                                                                                                            Evaluate the original post and response and build a high level learning plan with citations and references that covers each of the topics in the original post. Start the learning plan with an overview of effective prompting techniques with specific examples to research individual topics.

                                                                                                                            • void-pointer 2 days ago

                                                                                                                              A Token is a unit of data used by large language models. Tokens used to be pretty analogous to 3-6 letters of English text, but things have become more complicated with the advent of multi-modal generation

                                                                                                                              Large language models are usually priced on MTok or “million tokens”. You’ll often see LLMs priced at $X/MTok for input and $Y/MTok for output.

                                                                                                                              A harness is a program that interfaces with a large language model and provides it tools and context to achieve a goal. Codex and Claude Code are good examples of harnesses.

                                                                                                                              What exactly all of this accomplishes is not something I can answer for you :)

                                                                                                                              • x-complexity 2 days ago

                                                                                                                                > the concepts of tokens

                                                                                                                                Tokens are what you get when you have to map a chunk of text to specific numbers, so that the LLM can actually work with it.

                                                                                                                                https://platform.openai.com/tokenizer

                                                                                                                                Reducetively speaking:

                                                                                                                                [Your text] --> [List of numbers (tokens)] --> [List of [List of numbers describing a concept/term/thing/job/item/etc] (embedding)]

                                                                                                                                That final thing (List of embeddings) is what gets fed into the LLM, so that it can produce (List of embeddings most likely to follow afterwards), which is then turned back into text.

                                                                                                                                > and their worth

                                                                                                                                Tokens are priced based on the model you're using. In general, expect to pay more when you need to use larger models. (Note: Exceptions exist, but treat them as exceptions)

                                                                                                                                The space as it is now prices tokens based on:

                                                                                                                                - how many tokens it needs to process (input),

                                                                                                                                - how many it needs to generate (output), and

                                                                                                                                - how often you send the same chunks of text that their system already has on file (cached).

                                                                                                                                > and harnesses

                                                                                                                                A harness is something that adds in tools & directions for the LLM, so that it can do its tasks. In a dumbed-down semi-visual summary:

                                                                                                                                ---

                                                                                                                                [Text about what the LLM should be & what they're allowed/not allowed to do]

                                                                                                                                [Text about available tools & how to call them]

                                                                                                                                [Your text here]

                                                                                                                                ---

                                                                                                                                The harness, if its part of a program/app, then looks at what the models generate in response, and does the (file writing/reading, tool calls, web searches, subagents, etc.), based on the formatted output that the LLMs should produce.

                                                                                                                                > and what exactly all of those things accomplish

                                                                                                                                Depends on the goal of the user. Some use them as assistants, most use it for coding.

                                                                                                                                https://openrouter.ai/rankings?utm_source=share&utm_medium=c...

                                                                                                                              • A_D_E_P_T 3 days ago

                                                                                                                                Come on. If you have a Claude Max 20x plan ($200/month) you're massively subsidized and your API cost is anywhere from $5000-14000 per month.

                                                                                                                                (Figures vary, see e.g. https://www.linkedin.com/posts/christham_4-weeks-on-claude-2... for $13,700/mo.)

                                                                                                                                If you hit your limits on two Max 20x plans, you could very well be exceeding $300k/yr in token use at current API rates.

                                                                                                                                • pu_pe 3 days ago

                                                                                                                                  Is that how these figures are being calculated? Because if so, that's laughable. I always interpret those to mean that they are literally paying $200k/year to Anthropic, not ~$2k.

                                                                                                                                  • TiredOfLife 3 days ago

                                                                                                                                    Not only that. They simply multiply tokens used with API price per token, but ignore that about 90% of tokens are cached ones that are significantly cheaper.

                                                                                                                                    • asdff 2 days ago

                                                                                                                                      Api would be cheaper still if there were no subscriptions

                                                                                                                                • 2001zhaozhao 2 days ago

                                                                                                                                  This figure really depends on whether it's API rates or actual spend. One Claude Ultra subscription ($2400/year) gives you nearly $100k a year in tokens if fully utilized.

                                                                                                                                  • stuaxo 2 days ago

                                                                                                                                    Anyone worked out the carbon footprint of that ?

                                                                                                                                    • flyingsky 2 days ago

                                                                                                                                      Might make sense for him to invest in hosting his own models locally. Prices are only gonna keep going up.

                                                                                                                                      • m3kw9 3 days ago

                                                                                                                                        I wonder how many of those agents get lost in a loop and just uses tokens, asking the same questions over and over and responding and asking

                                                                                                                                        • asdff 2 days ago

                                                                                                                                          I wonder how much this happens in these huge multi agent jobs. Two agents quietly changing the same file back and forth.

                                                                                                                                        • Vishal_Max 2 days ago

                                                                                                                                          For a normal person outside the Startup world this news is super confusing and frustrating while most people who already use ai heavily think this is nothing and they are surprised by the fact that he is not even spending that much!

                                                                                                                                          • alpineman 2 days ago

                                                                                                                                            Someone needs to tell this guy about the subscriptions

                                                                                                                                            • yfw 2 days ago

                                                                                                                                              An employee uses 200k of electricity. Do we fire or promote him?

                                                                                                                                              • asdff 2 days ago

                                                                                                                                                Sun Tsu would probably say do nothing. World sees you have an ordinary employee using 200k of electricity and you don’t care. Quite a show of force.

                                                                                                                                              • miltonlost 3 days ago

                                                                                                                                                > As an early OpenClaw adopter who is now a power user, Tan says one thing he’s learned is not to treat AI agents like traditional software. Some people are so worried about “repeatability and safety that they actually trade off all of the beautiful parts of working with an AI agent, which basically can be so similar to a human,” he said.

                                                                                                                                                This is insane. He's turning the failure of his AI assistants to do what he wants every single time and to do it in a safe manner into a positive thing. Failure as a positive!

                                                                                                                                                • thephyber 3 days ago

                                                                                                                                                  To be fair, using the scientific method to disprove superstitions is what the Enlightenment was all about and that is the most significant engine of growth and flourishing humankind has known.

                                                                                                                                                  That said, I approach AI with deep skepticism. I try to learn it, including its strengths and weaknesses. But I don't blindly trust it.

                                                                                                                                                  Coincidentally, my stock brokerage just yesterday sent an email reminding users that anything their agents do using the user's credentials is the responsibility of the user.

                                                                                                                                                  • zombot 2 days ago

                                                                                                                                                    > Failure as a positive

                                                                                                                                                    Since failure is such a likely outcome in a startup, "failure as a positive" is a mindset that a startup accelerator must propagate to keep founders going. And when you sell a message for long enough, you start to believe it yourself.

                                                                                                                                                  • glennfiedler 3 days ago

                                                                                                                                                    He’s gotta pump those numbers up, those are rookie numbers in this racket

                                                                                                                                                  • mrlonglong 20 hours ago

                                                                                                                                                    $200k buys you a lot of hardware that will save you lots in the long run. Is he incapable of doing the maths?

                                                                                                                                                    • koehr 2 days ago

                                                                                                                                                      That he calls it Cyber Psychosis is so telling! No Garry, were not yet in the Cyberpunk universe and that's not how you get Cyber Psychosis. It's a man with a lot of money spending too much on hyper fixation.

                                                                                                                                                      • jrflowers 2 days ago

                                                                                                                                                        I love that the world’s dumbest guys all get up and pay the computer to tell them they’re big special boys then publicly say stuff like “my brain is bad in a video games way”

                                                                                                                                                        > he’s suffered from “cyber psychosis” and sometimes barely sleeps

                                                                                                                                                        • asdff 2 days ago

                                                                                                                                                          At his level the skill is about getting money out of the right pockets, not really about being particularly smart or even very good at managing business.

                                                                                                                                                          • rhines 2 days ago

                                                                                                                                                            It reminds me of how we laugh at scam emails for being poorly written and obviously a scam, but the theory is that this filters out all but the most gullible people so the conversion rate on anyone that replies is high.

                                                                                                                                                            If your business model is taking money from gullible investors, maybe it's reasonable to appear (or actually be) incompetent so that you don't accidentally waste your time on people who haven't drunk the Kool-Aid.

                                                                                                                                                        • ShadowOfThePit 3 days ago

                                                                                                                                                          > ...his agent also helps him run his life. “It’s read all of my email and all of my Dropbox. It’s read, like, all of my Apple Notes, even my therapy notes going back 20 years”.

                                                                                                                                                          > He describes using AI agents as getting help with “almost anything that you do in your day-to-day life. (...) Almost anything you want to do, it knows you, and it’s there to help. And it will actually sort of run ahead and say, ‘What about this?’ Or it’ll help you see around corners.”

                                                                                                                                                          Wow, impressive. Both the capabilities and how much he's willing to share.

                                                                                                                                                          Is it worth $17k per month? For me, absolutely not. But people spend more on luxurious cars and such, so if you've got money to spare...

                                                                                                                                                          > Y Combinator is also using an agent that is “rebuilding the way we operate at YC. We now have an internal AI agent, for instance, named Stray Light that kind of has a personality, and then it has a company brain. It actually has the total context of every founder we’ve ever backed, anyone who’s ever emailed us, like all the applications.”

                                                                                                                                                          Holy anthropomorphization. But besides that, what's the goal of doing this? Keeping a handy overview of when and why someone said something?

                                                                                                                                                          • pythonaut_16 2 days ago

                                                                                                                                                            Still doesn't explain where $17k of tokens is going. I can believe someone could burn that many tokens, but most of what he's described there could be managed pretty easily on one of the $100-200 a month subscriptions I'd think.

                                                                                                                                                            The only way I can imagine to burn that many tokens is just to run every task fully through the most expensive LLM with no real strategy. Like indexing emails should be a combo of scripts and small summarizing prompts I'd think.

                                                                                                                                                            • switchers 3 days ago

                                                                                                                                                              Naming your internal AI agent after the massive run down home of an uber rich but probably insane family of confusing clones who made god level AIs (from Neuromancer)... Classy.

                                                                                                                                                              • dreadsword 3 days ago

                                                                                                                                                                That was my thought --- an odd and offputting choice of identity

                                                                                                                                                                • PebblesRox 2 days ago

                                                                                                                                                                  I always thought this about Soylent but it never seemed to stop anybody.

                                                                                                                                                                  • timmytokyo 3 days ago

                                                                                                                                                                    When they show you what they are, believe them.

                                                                                                                                                                  • zbentley 2 days ago

                                                                                                                                                                    Major “we built an AI to help our business called Torment Nexus” vibes, yes.

                                                                                                                                                                  • SpicyLemonZest 3 days ago

                                                                                                                                                                    > Holy anthropomorphization. But besides that, what's the goal of doing this? Keeping a handy overview of when and why someone said something?

                                                                                                                                                                    You'd be surprised how important such an overview can be in relationship-based businesses. People spend a lot of time trying to track down a vague memory they have of someone telling them something. CRM platforms are big for a reason, after all.

                                                                                                                                                                    • 27183 3 days ago

                                                                                                                                                                      He must be the most annoying person to try to interact with. Clodslop for days.

                                                                                                                                                                      • dgellow 2 days ago

                                                                                                                                                                        I like how the can absolutely never provide anything specific. It’s always „it helps with everything!“. Like what exactly Gary?

                                                                                                                                                                        • randysalami 3 days ago

                                                                                                                                                                          “ Holy anthropomorphization. But besides that, what's the goal of doing this?”

                                                                                                                                                                          Because they can. It’s as simple as that. To find meaning, to feel in control, to win. To dominate.

                                                                                                                                                                          • dd3ddaa 2 days ago

                                                                                                                                                                            [dead]

                                                                                                                                                                          • tibbydudeza 2 days ago

                                                                                                                                                                            So what has he shipped - let me guess - nothing of wrong.

                                                                                                                                                                            • bill10 2 days ago

                                                                                                                                                                              Interesting he doesn't get free accounts?

                                                                                                                                                                              • flyingsky 2 days ago

                                                                                                                                                                                Whats in it for the labs if they give Gary Tan free tokens for uhm, Gstack?

                                                                                                                                                                              • opengrass 3 days ago

                                                                                                                                                                                That's only 1 SWE or half with sloppy results.

                                                                                                                                                                                • didntknowyou 1 day ago

                                                                                                                                                                                  so if he hired a PA instead would he have been more productive?

                                                                                                                                                                                  • bamboozled 2 days ago

                                                                                                                                                                                    What does he have to show for it? It helps him out to do research, seems like an expensive helper.

                                                                                                                                                                                    • hartjer 3 days ago

                                                                                                                                                                                      Kind of low isn't it?

                                                                                                                                                                                      • wahnfrieden 3 days ago

                                                                                                                                                                                        I spend that much at API rates with a couple subscriptions

                                                                                                                                                                                        • lbrito 3 days ago

                                                                                                                                                                                          "Do my job, make no mistakes"

                                                                                                                                                                                          That's basically gstack

                                                                                                                                                                                          • slopinthebag 3 days ago

                                                                                                                                                                                            he just needs to put the finishing touches on g-stack and then programming will be solved. just another $50k will do it i think!

                                                                                                                                                                                            • ex1fm3ta 3 days ago

                                                                                                                                                                                              hmm isn't that the job of a concierge, or an assistant ?

                                                                                                                                                                                              • xhkkffbf 3 days ago

                                                                                                                                                                                                Didn't you mean to use past tense? "Wasn't that the job ...."

                                                                                                                                                                                                • ShadowOfThePit 3 days ago

                                                                                                                                                                                                  Touché.

                                                                                                                                                                                                  Counter-point, they can't serve as a knowledgeable discussion partner, programmer, search engine, or your personal psychologist. Not saying that they should.

                                                                                                                                                                                              • digitaltrees 3 days ago

                                                                                                                                                                                                Why not buy hardware at that point?

                                                                                                                                                                                                • TiredOfLife 3 days ago

                                                                                                                                                                                                  That usage probably comes from a couple of 200$ a month subscriptions. Hardware to run something that approaches frontier at acceptable speed is at least a million.

                                                                                                                                                                                                • lambdadelirium 3 days ago

                                                                                                                                                                                                  Website looks still like shit

                                                                                                                                                                                                • siddhant_d777 2 days ago

                                                                                                                                                                                                  [flagged]

                                                                                                                                                                                                  • Olumia 2 days ago

                                                                                                                                                                                                    [flagged]

                                                                                                                                                                                                    • lrvick 2 days ago

                                                                                                                                                                                                      I cannot even comprehend how someone spends that much without realizing you can just buy GPUs.

                                                                                                                                                                                                      • cromka 2 days ago

                                                                                                                                                                                                        Presumably they spend this much on frontier models. You don't run frontier models on GPU you "just buy".

                                                                                                                                                                                                        • lrvick 2 days ago

                                                                                                                                                                                                          You can run GLM 5.3 or Kimi K3 on maybe 40k in hardware these days.

                                                                                                                                                                                                      • siva7 3 days ago

                                                                                                                                                                                                        Just 200k a year? If this amount is for some folks news worthy get a reality check.

                                                                                                                                                                                                        • trog 2 days ago

                                                                                                                                                                                                          The question thst matters is: is he more productive than someone with a standard $30/mo Claude subscription? Or with no AI?

                                                                                                                                                                                                          It's pretty obvious $200k/yr in tokens is a ludicrously huge spend. Trying to pretend it's not to show how leet you are is weird. But the interesting topic buried here is what value he's creating with such a spend and how it benchmarks against alternatives.

                                                                                                                                                                                                          Because that is the value prop of AI. If it doesn't stand up against options when measured clinically and objectively then what's the point of it