83 comments

  • voidUpdate 7 hours ago ago

    > "the resulting congestion required law enforcement to manually manage intersections"

    Does anyone know if a Waymo vehicle will actually respond to a LEO giving directions at a dark intersection, or if it will just disregard them in favour of treating it as a 4 way stop?

    • fc417fc802 6 hours ago ago

      I suddenly find that I really want an answer to this as well because I'm now imagining what might ensue if one of these attempted to board a car ferry. Typically there's a sign "turn headlights off", you're expected to maintain something like 5 mph (the flow of traffic should never stop), and you get directed by a human to cross multiple lane markings often deviating from the path that the vehicle immediately in front of you took.

      • voidUpdate 6 hours ago ago

        I think that Waymo isn't concerned about those types of scenario because they only operate in a limited area, and can tune their systems to operate best in that area (EG not worrying about car ferries, human-operated parking lots etc)

        • jvanderbot 3 hours ago ago

          Right. People still imagine that Level 5 is going to happen, and it is at best a long way off. You're talking full AI at some point.

    • throwaway2037 4 hours ago ago

      Your scenario seems to have a lot of overlap with a construction worker directing traffic around a road construction site. I have no idea if Waymo is any good at navigating these, but I am sure there is a lot of model training around these scenarios because they are common in urban driving environments.

      • voidUpdate 4 hours ago ago

        Don't they just have a stop/go board? Whereas an LEO at a crossing would have to use hand signals

    • nashashmi 6 hours ago ago

      This was found to be one of the early challenges of self driving: reading traffic signal gestures of traffic agents. It does it. But the jury is out if it does it well.

    • testfrequency 3 hours ago ago

      The amount of times this has been asked with no confirmation leads me to believe they still do not.

      Tesla fanboys gush about how FSD can understand LEO at irregular traffic conditions, but no company I’m aware of has confirmed their systems are capable.

      • krisoft 2 hours ago ago

        > The amount of times this has been asked with no confirmation leads me to believe they still do not.

        They do follow hand signals from police. There are many videos documenting the behaviour. Here is one from waymo: https://waymo.com/blog/2024/03/scaling-waymo-one-safely-acro...

        Look for the embed next to the text saying “The Waymo Driver recently interpreting a police officer’s hand signals in a Los Angeles intersection.”

        Or here is a video observing the behaviour in the wild: https://youtu.be/3Qk_QhG5whw?si=GCBBNJqB22GRvxk1

        Do you want confirmation about something more specific?

      • HarHarVeryFunny 2 hours ago ago

        Teslas currently have a driver in the front who could take over in these situations.

        Waymo said they normally handle traffic light outages as 4-way stops, but sometimes call home for help - perhaps if they detect someone in the intersection directing traffic ?

        Makes you wonder in general how these cars are designed to handle police directing traffic.

        • dham 23 minutes ago ago

          It kind of makes sense. Why program or train on such a rare occurrence. Just send it off to a human to interpret and be done with it. If that's the case then Tesla is closer to Waymo then previously thought. Maybe even ahead.

  • yonran an hour ago ago

    The blog post makes no mention of the cellular network congestion/dropped packets that affected people during the power outage. I had bars but was unable to load websites for most of the day. Were Waymos unaffected by the network problems, or were request timeouts encompassed in the word “backlog” used by the blog post?

    • AlotOfReading 36 minutes ago ago

      The networking on AVs is usually redundant across multiple cellular networks to deal with coverage and outage issues. They also use business sims, which usually have a slightly higher network priority than consumers. If waymo's also negotiated to use one of the infrastructure QCIs instead, it would take some seriously disastrous network conditions for them to experience meaningful congestion.

  • schwede 26 minutes ago ago

    Sending power outage context to the vehicles does not seem like enough of a response. I hope at least they have internal plans for more. For large, complex systems, you want multiple layers of protections. The response feels way too reactive when they could use this incident to guide improvements across the board.

  • nzoschke 3 hours ago ago

    > we are now implementing fleet-wide updates

    That ~1000 drivers on the road are all better trained on what to do in the next power outage is incredible.

    There will always be unexpected events and mistakes made on the roads. Continual improvement that is locked in algorithmically across the entire fleet is way better than any individual driver's learning / training / behaviorior changes.

    • imoverclocked 2 hours ago ago

      Humans seemed to navigate this just fine, even with all the Waymo road blocks and without extra training. If every unknown requires a software update, this system is doomed to repeat this behavior over and over in the long term.

      • xnx 2 hours ago ago

        Humans do dumb stuff like drive their cars into flowing floodwaters and they show no signs of stopping. The Waymo Driver (the name for the hardware and software stack) is getting smarter all the time.

      • charcircuit 2 hours ago ago

        >seemed to navigate this just fine

        From my understanding the reason the Waymos didn't handle this was because humans were breaking traffic rules and going when they shouldn't have been. If most humans navigated it correctly, then waynos would have handled this better.

  • jtchang 11 hours ago ago

    How is this mode not a standard part of their disaster recovery plan? Especially in sf and the bay area they need to assume an earthquake is going to take out a lot of infrastructure. Did they not take into account this would happen?

    • vlovich123 9 hours ago ago

      > While we successfully traversed more than 7,000 dark signals on Saturday, the outage created a concentrated spike in these requests. This created a backlog that, in some cases, led to response delays contributing to congestion on already-overwhelmed streets. We established these confirmation protocols out of an abundance of caution during our early deployment, and we are now refining them to match our current scale. While this strategy was effective during smaller outages, we are now implementing fleet-wide updates that provide the Driver with specific power outage context, allowing it to navigate more decisively.

      Sounds like it was and you’re not correctly understanding the complexity of running this at scale.

      • jeroenhd 3 hours ago ago

        Sounds like their disaster recovery plan was insufficient, intensified traffic jams in already congested areas because of "backlog", and is now being fixed to support the current scale.

        The fact this backlog created issues indicates that it's perhaps Waymo that doesn't understand the complexity of running at that scale, because their systems got overwhelmed.

        • kotaKat 38 minutes ago ago

          DR always stands for "didn't realize" in the aftermath of an event.

          That's what they're learning and fixing for in the future to give the cars more self-confidence.

        • shafyy 2 hours ago ago

          They probably do, they just don't give a shit. It's still the "move fast and break things" mindset. Internalize profits but externalize failures to be carried by the public. Will there be legal consequences for Waymo (i.e. fines?) for this? Probably not...

          • browningstreet an hour ago ago

            What Waymo profits?

            They're one-of-one still. Having ridden in a Waymo many times, there's very little "move fast and break things" leaking in the experience.

            They can simulate power outages as much as they want (testing) but the production break had some surprises. This is a technical forum.. most of us have been there.. bad things happened, plans weren't sufficient, we can measure their response on the next iteration in terms of how they respond to production insufficiencies in the next event.

            Also, culturally speaking, "they suck" isn't really a working response to an RCA.

          • atherton94027 2 hours ago ago

            Waymo cars have been proven safer than human drivers in California. At the same time, 40k people die each year in the US in car accidents caused by human drivers.

            I'm very happy they're moving fast so hopefully fewer people die in the future

    • Animats 8 hours ago ago

      If the onboard software has detected an unusual situation it doesn't understand, moving may be a bad idea. Possible problems requiring a management decision include flooding, fires, earthquakes, riots, street parties, power outages, building collapses... Handling all that onboard is tough. For different situations, a nearby "safe place" to stop varies. The control center doesn't do remote driving, says Waymo. They provide hints, probably along the lines of "back out, turn around, and get out of this area", or "clear the intersection, then stop and unload your passenger".

      Waymo didn't give much info. For example, is loss of contact with the control center a stop condition? After some number of seconds, probably. A car contacting the control center for assistance and not getting an answer is probably a stop condition. Apparently here they overloaded the control center. That's an indication that this really is automated. There's not one person per car back at HQ; probably far fewer than that. That's good for scaling.

      • michaelt 2 hours ago ago

        > For example, is loss of contact with the control center a stop condition?

        Almost certainly no - you don’t want the vehicle to enter a tunnel, then stop half way through due to a lack of cell signal.

        Rather, areas where signal dropouts are common would be made into no-go areas for route planning purposes.

      • gorfian_robot 2 hours ago ago

        relying on essentially remote dispatch to resolve these errors states is a disaster

  • rdiddly 10 hours ago ago

    No one seems sufficiently outraged that a private company's equipment blocked the public roads during an emergency.

    • jlebar 8 hours ago ago

      No one seems sufficiently outraged that human drivers kill 40,000 people a year in the US.

      It's approximately one 9/11 a month. And that's just the deaths.

      Worldwide, 1.2m people die from vehicle accidents every year; car/motorcycle crashes are the leading cause of death for people aged 5-29 worldwide.

      https://www.transportation.gov/NRSS/SafetyProblem

      https://www.who.int/news-room/fact-sheets/detail/road-traffi...

      • jeroenhd 3 hours ago ago

        Road casualties are tied to geographical areas and America is an infamously dangerous place to live in when it comes to traffic. By fixing education, road design, and other factors, those 40k killed can be reduced by seven times before you even need to bother with automation. There's a human driver problem, but it's much smaller than the American driver problem.

        Also, that still doesn't excuse Waymo blocking roads. These are two different, independent problems. More people die in care crashes than they do in plane crashes but that doesn't mean we should be replacing all cars by planes either.

        • gruez 34 minutes ago ago

          >By fixing education, road design, and other factors, those 40k killed can be reduced by seven times before you even need to bother with automation.

          1. [citation needed]

          2. Just because it's theoretically possible, doesn't mean it's an option that actually exists. I'm sure you can dream up of some plan for a futuristic utopia where everybody lives in a 15 minute city, no private cars are needed, and the whole transportation system is net zero, but that doesn't mean it's a realistic option that'll actually get implemented in the US, nor does it mean that we we should reject hybrid or EVs on the basis that they're worse than the utopian solution, even though they're better than the status quo of conventional ICE cars.

        • mensetmanusman 2 hours ago ago

          Exactly, I tell people every order of magnitude more we spend on infrastructure reduces the self driving complexity as much likewise.

          The education bit can’t be fixed by the government though in the short term, as the outcomes correlate too strongly with stable home life conditions (which are in free fall over the past 50 years).

          • mrguyorama 11 minutes ago ago

            And also because America has an extremely strong anti-education demographic that is very well represented in congress and presidents.

            "Parental authority" should not be an educational goal.

      • hackable_sand an hour ago ago

        I believe that is caused by having lots of cars driving around.

        • mikeyouse an hour ago ago

          American roads are uniquely dangerous for passengers in cars and for pedestrians compared to other developed countries..

      • scoofy 7 hours ago ago

        Seriously. People are outraged about the theoretical potential for human harm while there is a god damn constant death rate here that is 4x higher than every other western country.

        I mean really. I’m a self driving skeptic exactly because our roads are inherently dangerous. I’ve been outraged at Cruise and Tesla for hiding their safety shortcomings and acting in bad faith.

        Everything I’ve seen from Waymo has been exceptional… and I literally live in a damn neighborhood that lost power, and saw multiple stopped Waymos in the street.

        They failed-safe, not perfect, definitely needs improvement, but safe. At the same time we have video of a Tesla blowing through a blacked out intersection, and I saw a damn Muni bus do the same thing, as well as a least a dozen cars do the same damn thing.

        People need to be at least somewhat consistent in their arguments.

        • paddleon 6 hours ago ago

          Hey, I hear you. And I'm sad. Because I'd like to say that the right way is to:

          build infrastructure that promotes safe driving, and

          train drivers to show respect for other people on the road

          However, those are both non-starters in the US. So your answer, which comes down to "at least self-driving is better than those damn people" might be the one that actually works.

          • ACCount37 2 hours ago ago

            Your "right way" is to try to fix human nature. A complete nonstarter.

            If we could do anything like "train drivers to show respect for other people on the road" at scale, then we'd live in a different world by now.

            • forshaper 33 minutes ago ago

              I currently live in a place where, when walking on the street, I routinely almost get hit by vehicles while crossing crosswalks with the cross light on.

              However, I used to live in a place where every local driver did an 'after you' that included pedestrians, regardless of road rules, and generally drove the speed limit (and usually less).

              Both of these places in the United States!

              The latter is not impossible, just rare.

          • citrin_ru 4 hours ago ago

            I've spend some time driving in both the US and the UK and while infrastructure in the US could be improved I don't think that's the main issue.

            What's different is driver training and attitude. Passing a driving test in the US is too easy to encourage new drivers to learn to drive. And an average American driver shows less respect to pedestrians, cyclists and other drivers, aggressive driving is relatively common. Bad drivers can be encountered in the UK of course but on average British drive better.

            Huge SUV and pickup trucks are also part of the problem - they are more dangerous for everyone except people in such vehicle.

        • nkrisc 3 hours ago ago

          The difference is those human-driven cars all have a driver who can be held accountable.

          If I kill someone with my car, I’m probably going to jail. If a Waymo or otherwise kills someone, who’s going to jail?

          • benlivengood an hour ago ago

            Presumably, like Cruise, if the safety rate is appalling then they get their permits revoked which is 99% the same as jail for a company that only does self driving cars.

          • xnx 2 hours ago ago

            > If I kill someone with my car, I’m probably going to jail

            This is rarely true in the US. A driver's license is a license to kill with near impunity.

            https://www.cbsnews.com/chicago/news/man-gets-10-days-in-jai...

          • ACCount37 2 hours ago ago

            Should Waymo hire an "accountable" human who would go to jail if a Waymo car kills someone?

            "Accountability" is fucking worthless, and I am tired of pretending otherwise.

        • TylerE 5 hours ago ago

          Why lie? If you have a valid point, make it. Don't pull made up stats out of your ass.

          The US isn't close to being the highest per traffic fatality rate in the western hemisphere.

          I count 14 countries higher.

          https://en.wikipedia.org/wiki/List_of_countries_by_traffic-r...

          • DharmaPolice 5 hours ago ago

            When people say "western" they often don't mean "western hemisphere" but the "first world". So Peru wouldn't be "western" by this definition but Australia might be.

            • throwaway2037 4 hours ago ago

              Yeah, HN just loves the term "The West" / "Western", which weirdly includes Australia and New Zealand, but excludes Japan, South Korea, and Taiwan. (What about South Africa? Unsure.) To me, it is better to say something like "G7-like" (or OECD) nations, because that includes all highly developed nations.

              • trollbridge 3 hours ago ago

                It’s referring to a specific culture of people.

          • xnorswap 4 hours ago ago

            I thought the UK ranked well, I didn't realise it ranked that well.

            Maybe there's something to be said for left-hand driving, I see Japan ranks very highly too. ;)

            The real reason is I guess we take road safety seriously, we have strict drink-driving laws, and our driving test is genuinely difficult to pass.

            I seem to remember road safety also featuring prominently throughout the primary national curriculum.

            And of course, our infamous safety adverts that you never quite forget, such as: https://www.youtube.com/watch?v=mKHY69AFstE

            • throwaway2037 4 hours ago ago

                  > Maybe there's something to be said for left-hand driving
              
              Is this written in jest, or is there something more serious behind it? Off the top of my head, I cannot think of an obvious reason why "road handedness" (left vs right) would matter for road safety. Could it something about more people are right-handed so there is some 2nd order safety effect that I am overlooking?
              • tzs 19 minutes ago ago

                Their comment was in jest, but I've wondered before if left vs right hand driving could affect safety. As you note right-handed people are more common. The countries with the highest percentages of left-handed people are around 12-13%.

                In countries that drive on the right then drivers use their dominant hand for any controls that are on the inward side and their other hand for the control that are on the outward side of the driver.

                Generally that means that the non-dominant hand handles exterior lighting, turn signals, windows, and locks. The dominant hand handles windshield wipers, transmission, and anything on the center console such as the climate and entertainment systems, and often also the navigation system.

                In left drive counties that is mostly reversed for right-handed people, with the possible exception of the exterior lighting, turn signals, and windshield wipers. Those exceptions are the controls that are usually on stalks attached to the steering column. From what I've read sometimes manufactures use the same stalk positions in left and right drive models instead of reversing them like they do the rest of the controls.

                Could dominant vs non-dominant hand for operating things on the center console make a difference? If everyone obeyed safety recommendations I'd expect it to not make enough difference to be noticeable, but not everyone obeys safety recommendations 100% of the time.

                If someone for example tried to type in a destination using the on-screen keyboard on the navigation system console while driving I'd expect that they would take longer to do so if they were using their non-dominant hand, so they would be distracted longer.

              • xnorswap 2 hours ago ago

                Yes, it was in jest.

                  ;)
            • TylerE 4 hours ago ago

              The US is just a big place. We drive a lot. Average annual mileage is about 13k vs 7k in the UK.

              • adrianN 4 hours ago ago

                The USA don’t do very well on the deaths per km metric either.

          • TulliusCicero 4 hours ago ago

            > The US isn't close to being the highest per traffic fatality rate in the western hemisphere.

            Is this a serious comment? Is that actually what you think they meant by "Western"? When people talk about Russia vs "the West", do you also think they mean Russia vs the Western hemisphere?

    • tengbretson 9 hours ago ago

      > No one seems sufficiently outraged

      Harvesting outrage is about the only reliable function the internet seems to have at this point. You're not seeing enough of it?

      • rdiddly 8 hours ago ago

        I've seen plenty but about the wrong things.

    • throwawaysoxjje 2 hours ago ago

      Why would I be, when I don’t have any standard for comparison.

      How many human drivers did similar because the power went out?

    • TeMPOraL 7 hours ago ago

      > a private company's equipment blocked the public roads

      That would be like every traffic incident ever? I don't think US has public cars or state-owned utilities.

      • SequoiaHope 5 hours ago ago

        My concern is that one company can have a malfunction which shuts down traffic in a city. That seems new or historically rare. I understand large scale deployment will find new system design flaws so I’m not outraged, but I do think we should consider what this means for us, if anything.

        • gruez 27 minutes ago ago

          >My concern is that one company can have a malfunction which shuts down traffic in a city.

          That's hardly new. What do you think happens to traffic when a semi flips over on a busy interstate, or electricity goes out, turning all traffic lights into 4 way stops and severely limiting throughput?

          • mrguyorama a minute ago ago

            It blocks a single road and yet that makes the news and people have to route around it and it disrupts a day.

            What happens when one company's engineering failure does that to most roads?

            For reference, the US considers tactically blocking traffic to be something that smart terrorists or nation state adversaries would want to do to significantly harm the US economically.

            What do these cars do if Google's entire self driving infrastructure falls over because some component gets misconfigured? It will happen eventually.

        • mcny 4 hours ago ago

          I think the blog is strongly hinting us to focus on the real problem -- the electrical utility and I have to agree.

          The only other option I can think of is to build some kind of high density low power solar powered IoT network that is independent of current infrastructure but then where is the spectrum for that?

          • trollbridge 3 hours ago ago

            A power outage should not cause robot cars to block intersections.

            • TeMPOraL 4 minutes ago ago

              Lack of Internet access should not prevent cars - or any other devices - from starting, yet here we are.

      • adammarples 6 hours ago ago

        Typically people move aside for emergency vehicles

        • jdietrich 4 hours ago ago

          Ask any EMT or paramedic - an astonishingly large proportion of human drivers panic in the presence of an ambulance and just slam their brakes on.

    • doctorpangloss 9 hours ago ago

      On the contrary, I would prefer HN detach all threads expressing "concern." That way we don't have to make a subjective call if a comment is "concern" or "concern trolling" at all - they are equally uninteresting and do not advance curiosity.

      • ACCount37 8 hours ago ago

        Based. Anyone complaining about HN being "insufficiently outraged" should go to Twitter and never return.

        • rdiddly 7 hours ago ago

          I was actually wondering more about the people whose streets they are. Didn't mean to indicate that I or anyone cares what HN thinks.

  • prpl 9 hours ago ago

    I suspected this. They were moving, but randomly to an observer. I’d seen about 2 out of maybe 20 stopped Waymos navigating around Arguello and Geary area in SF Saturday at 6PM. What was worse was that there was little to no connectivity service across all 3 main providers deeper in the power outage area as well - Spruce and Geary or west of Park Presidio (I have 2 phones, with Google Fi/T-Mobile, AT&T, and Verizon).

  • xnx 10 hours ago ago

    Interesting that some legacy safety/precaution code caused more timid and disruptive driving behavior than the current software route planner would've chosen on its own.

  • joshribakoff 4 hours ago ago

    This reads to me, an angry resident, as an AI generated article that attempts to leverage the chaos that they caused, for marketing purposes — not as any sort of genuine remorse — underscoring why we shouldn’t be banning AI regulation in the USA.

  • ec109685 8 hours ago ago

    Do Waymo’s have Starlink or another satellite based provider backup? Otherwise, what do they if cell service goes down and they need to phone home for confirmation?

    • apexalpha 8 hours ago ago

      Cell services is usually around for a while when power goes down.

      I doubt they have more than that.

      • trollbridge 3 hours ago ago

        That seems like a major oversight. Adding Starlink wouldn’t add that much marginal cost.

        • multjoy 36 minutes ago ago

          It would encourage Starlink to put yet more crap into Low Earth Orbit and see them fill the atmosphere with barely understood pollutants.

        • snake_doc 2 hours ago ago

          Cell towers just need power to keep functioning, starlink adds no utility in an urban dense environment with fiber.

  • ChrisArchitect 12 hours ago ago

    Related context:

    Waymo halts service during S.F. blackout after causing traffic jams

    https://news.ycombinator.com/item?id=46342412

  • moomoo11 4 hours ago ago

    Tesla FSD would never have this issue according to Elon Musk.

    • bagels 4 hours ago ago

      - written from my flying roadster

  • Papazsazsa 10 hours ago ago

    The symbolic irony of this situation is almost too rich to bear.