Reality has a surprising amount of detail (2017)

(johnsalvatier.org)

351 points | by vinhnx 5 days ago

37 comments

  • WastedCucumber 20 hours ago

    The first time I built a freestanding bookshelf, I put a lot of effort into making the feet level and the back straight and at a right angle to the feet. Once I put it up against the wall I'd built it for, I realized I'd solved completely different problem than the problem I really had. I needed crooked bookshelf, since the wall was totally tilted.

    In the end I screwed some wall shelves in and called it good enough.

    • farfatched 19 hours ago

      > If you’re a programmer, you might think that the fiddliness of programming is a special feature of programming, but really it’s that everything is fiddly, but you only notice the fiddliness when you’re new, and in programming you do new things more often.

      I think I'm drawn to programming because the fiddliness is tractable, and fixable.

      In which other domain can I:

      * introspect the relevant processes/state, step by step

      * snapshot/undo

      * fix niggles, once and for all, and for everyone; and get their fixes too

      * probe and test my inputs and outputs, checking for quality. Get notified if a part changes in a way that breaks me.

      And the only tool I need is a commodity general purpose PC.

      When I try woodwork, or even electronics, I'm struck by much friction is in even simple tasks: tools, parts, lead time, safety, space, physical effort, cost, ...

      • smalltorch 5 hours ago

        >Consider building some basement stairs for a moment. Stairs seem pretty simple at first, and at a high level they are simple, just two long, wide parallel boards (2” x 12” x 16’), some boards for the stairs and an angle bracket on each side to hold up each stair. But as you actually start building you’ll find there’s a surprising amount of nuance.

        I have to point out stairs aren't typically made like this. That's a really complicated way to do it.

        I really like this article though. Something that stuck out to me early in my career was a master trim carpenter who told me God is in the Details.

        Carpenters constantly battle physics and make dozens of little micro adjustments with the end result being something that is pleasing to the eye that will stand the test of time.

        Can't help but think that translates to anything in life no matter what you're doing. Mastering those micro adjustment, whatever your craft may be, takes things to a whole new level.

        • Jtsummers 20 hours ago
          • mparramon 18 hours ago

            Related, amazing read about Meccano teaching you reality-based work, in contrast with Lego:

            https://contraptions.venkateshrao.com/p/truth-in-inconvenien...

            • gobdovan 8 hours ago

              I usually view it the opposite way from the article's perspective. There's surprisingly little detail we rely on, yet things work out somehow.

              There's the Popper observation that any model of reality has zero chance to be true, since our models are finite, yet we're trying to describe a fractal reality. It's amazing how few levels of decomposition we need to go through to get something useful, like the stairs in the article (3 decomposition steps, as compared to thousands). If I were to never interact with reality and rely on pure reason alone, I would expect nothing humans ever do to work.

              Abstraction and exploration are unreasonably effective.

              • mlsu 18 hours ago

                I have read this article already and "reality has a surprising amount of detail" has become a phrase for me. But, I read it again today because the writing is so good. This guy is a gifted writer.

                • mcswell 17 hours ago

                  One thing he didn't mention is getting the first and last steps to be the same vertical distance as the others. Nothing will trip you up (literally!) so easily as a final step that is a different height than the other steps.

                  I thought of this because this morning I was putting a small fence around some plants we want to protect from deer. The fence consisted of 20 sections (bought on Amazon), each about 24 inches wide. Our ground is like rock, and the fence was not that sturdy, so I had to pound a heavy spike into the ground to the depth of the fence posts, then pull the spike out and put each section's legs in, leaving room for the next section's leg to go into the same spike hole. I wanted to be sure I was putting each section in at the right position, lest I end up with a 12 inch gap and have to go back and adjust lots of sections. Long story short, I pretty much succeeded, although when it cools down I may adjust a few sections. But the problem was sort of like the stairs: I wanted an integer number of fence sections, each the same length, to exactly fit around the bushes---just like you want an integer number of vertical steps in a diagonal stair, each of the same (more or less standard) height.

                  • adi_pradhan 5 hours ago

                    One of my favorite articles. I see people using this as an argument for why LLMs are fundamentally flawed, but that fails to realize that most humans don't get into the details. In fact, many don't have the vocabulary to be in the details.

                    There is an argument to be made for using humans, but I think we need humans to be more capable, more curious, more adaptive. LLMs are far better than the average human, but they are fundamentally inferior to the motivated human working with an LLM to augment themselves at the frontier.

                    • BatFastard 2 hours ago

                      As someone who has spent years creating virtual environments, all I can say is "Its turtles all the way down" every detail contains more details.

                      • usernametaken29 5 hours ago

                        This article is awesome. It should be required reading for all engineers but probably mostly ML researchers. I’ve encountered my fair share of geniuses that are oblivious to the fact that the world is indeed complex and has a near infinite amount of detail. Of course, they’ve been trained as engineers, so they think in models and abstractions, but reality is almost always more complex than what people at desks estimate it to be.

                        • didgetmaster 18 hours ago

                          I think we have all written some code that looks bulletproof to us. We run a set of tests with all the inputs we can think of, and it passes with flying colors (after several iterations of course).

                          Then we give it to someone else and it fails on their first or second attempt. They simply tried to use it in a way that we did not anticipate. It doesn't mean that we are dumb for not thinking of those possibilities; it just means that we did not think of every one of them.

                          • cadamsdotcom 20 hours ago

                            This sentence is the exact reason laying people off and replacing them with AI doesn’t work.

                            • mapcars 19 hours ago

                              Reality does not have amount of details, it is infinite in all directions. Its only that we perceived certain amount of details, some more some less. One can spend their whole life mastering a single aspect and there always will be room to improve.

                              • kfarr 19 hours ago

                                Tell me about it, I maintain an open source project in the civil engineering space and it's ... detailed.

                                • elfly 7 hours ago

                                  So how do you trace the boards?

                                  I am assuming that you put the board at the correct angle on the floor, let it go over the upper entry floor, use a ruler to extend the line of the wall over to the board, trace that, cut it, then reverse the process but this time the part you just cut can go on the floor which will produce the correct angle on the wall?

                                  • arzmir 19 hours ago

                                    Lovely article!

                                    Contemplating the details of a thing is really satisfying. At times I find myself sitting there and trying to decompose the astonishing amount of work, research, both evolutionary and revolutionary progress that has gone into reaching the current level of something. Buying myself a coffee and stare at the local ferry and acknowledge that someones life's work went into figuring out how to make the paint stick to metal.

                                    Naturally the other point also sticks.. I too often get stuck on the details. :P

                                    • utopiah 9 hours ago

                                      As a prototypist I can share :

                                      - you genuinely learn once your assumptions about how a system works break, you realize it, try differently, validate, get a better model of that system

                                      - your interfaces must remain permissive while providing feedback, namely you provide wiggle room then only once it behaves roughly as expected do you tighten then up

                                      • MASNeo 11 hours ago

                                        With the complexity of the systems we build it’s humbling and refreshing at the same time to read this. Indeed we are quick to default to what we know. Yet the answer may lie well outside of our expertise. I often build things many consider impossible and find that exactly the attention to detail and seeking contrarian views has helped avoid the worst mistakes.

                                        • ChuckMcM 13 hours ago

                                          This is one of my all time favorite blog posts. Why? Because it strikes at something that is both true, and a huge trap for smart people. Specifically, people who are experts in one discipline will often imagine that something in some other discipline is "pretty straight forward." And yet, my experience is that it never is. But that doesn't stop smart people from promising something that turns out to be waaaaaay harder to do than they imagined it could be.

                                          • lilerjee 14 hours ago

                                            This is one of basic reasons why current AI cannot solve many problems.

                                            No matter how many data centers are built, it is impossible to accommodate that level of detail.

                                            • jlightfire 11 hours ago

                                              Hanging a curtain rail that is centered both vertically and horizontally between the window and the ceiling, and it is leveled (with a bubble level), while in a ladder. Mark and then drill. It is harder than it seems at first. Maybe I'm just too a computer guy.

                                              • wxw 16 hours ago

                                                > Surprising detail is a near universal property of getting up close and personal with reality.

                                                > As you learn, notice which details actually change how you think.

                                                Lovely article. The older I get the more I appreciate this.

                                                One point worth making: in many cases, after learning to see & appreciate the details, you gain the power to ignore the details that don't matter to you. This can be quite freeing.

                                                • hobonation 19 hours ago

                                                  Really generally shitty collision detection and detail. It's just that when you notice, it rolls back and adds resources until you think it's fine.

                                                  • smokefoot 17 hours ago

                                                    Yes but what about AI? (Perhaps the most annoying words written in the last few years mostly on LinkedIn).

                                                    But actually in the years since this was written, I do think the world has shifted. Doing things on a computer used to be really hard. Even just installing a framework or getting >python to call the right python on windows. Then install Django and get Django to work with nginx etc. It was just a lot of thankless, frustrating work to get from zero to 1%.

                                                    Aside from AI, the tools and packages and culture of computing has gotten better. But AI means you just get all the trivial but difficult stuff for free. And I think a lot of people who would have given up now make it through to see something work and they’ll feel the thrill of building something. It’s just better and easier now.

                                                    • gregorymichael 18 hours ago

                                                      My favorite post on HN. Upvote it everytime. Use this phrase so often now.

                                                      • rconti 17 hours ago

                                                        This hits for to me because I'm currently adding on to my house. Or rather, paying professionals to add on to my house, because I actually want it to get finished.

                                                        I visit every couple of days. It's REMARKABLE how fast things get done. One day, there were no walls. The next day, almost all of the walls were in place!

                                                        ... and yet, at the same time, things take a long amount of time because reality has a surprising amount of detail. I haven't taken into account how much you have to do to frame a house. So incredible amounts of work get done, day after day, but 3/4 of them are things I had no idea needed to get done! Gazing up into the roof, the detail is incredible. The PSL beams, the brackets, the joists, the trusses, just.. EVERYTHING!

                                                        I thought the structural engineer's plans had an incredible amount of detail on them, and they do, but they also don't really say anything about _how_ to build the thing. How to put up the walls, how to hold them together temporarily, how to lift beams into place. In what order things can and should be done. That all just takes experience.

                                                        • boron1006 20 hours ago

                                                          This has always been the fun part of programming to me. I know most people hate it, but I really don’t mind being on-call (ok I hate being woken up) and fixing weird bugs that users run into. All these small edge cases that people run into because reality is odd. Of course I’m in scientific programming so that probably colors my view.

                                                          It’s always a little disappointing to me when I think I’ve run into something unique but it ends up being user error or something.

                                                          • nerdright 19 hours ago

                                                            Such a great read. This sentence is particularly chilling:

                                                            > you could be intellectually stuck right at this very moment, with the evidence right in front of your face and you just can’t see it.

                                                            • bigbangcmbr 13 hours ago

                                                              i like to think along these lines too. sometimes it's paralyzing. one of the biggest mind blowing facts is that all this complexity started at a point in time: big bang. no one explicitly programmed it. all of it came from a soup of elementary particles 13.8b yrs ago.

                                                              • qsera 16 hours ago

                                                                This is exactly why I stick to programming computers and building "things" using it.

                                                                • ekjhgkejhgk 5 hours ago

                                                                  I like this passage

                                                                  > Frames are made out of the details that seem important to you. The important details you haven’t noticed are invisible to you, and the details you have noticed seem completely obvious and you see right through them. This all makes makes it difficult to imagine how you could be missing something important.

                                                                  • ekjhgkejhgk 5 hours ago

                                                                    Reading this for the N-th time inspired in me the observation that one difference betweent software engineers and carpenters is that software engineers tend to spend most of their time dealing with things they've never seen before, or variations therefore (new bug, new OS, new framework, new programming langauge, etc etc) whereas carpenters tend to spend most of their time doing the things that they know how to do perfectly.

                                                                    • benmccarthy 18 hours ago

                                                                      One of my favourite essays. xkcd has a good take too 1741-Work

                                                                      • morpheos137 20 hours ago

                                                                        Based on what is the level of detail to reality suprising? To me suprising means mysteriously or improbably unexpected. Why should we expect reality to be simple. Note complex and simple are somewhat subjective. The human brain evolved to just sufficient baseline level be able to handle the level of complexity of reality. So why would it be unexpected that humans find realty complex when our brains are calibrated just enough to handle it.

                                                                        • Boom890 5 days ago

                                                                          Good read

                                                                          • cynicalsecurity 20 hours ago

                                                                            An ancient article that now looks even cheesier. It's so hard to make those goddamn stairs. So complex, such wisdom.